Skip to main content
announcement

[Update] Upcoming changes to the Related topics widget

  • January 10, 2019
  • 8 replies
  • 324 views

Yoeri
Forum|alt.badge.img+3
  • Gainsight Employee ⭐️⭐️⭐️
  • 400 replies
Update: changes mentioned in this topic are live

We're working on improvements for the related topics widget (finally). As you've pointed out earlier here, here and to a certain extend here the related topics widget can use some improvements.

We'll change the datapoint that is currently providing recommended topics to the same datapoint that we use for our live-search engine. The goal is to make the related topics suggestions more accurate and relevant to the topic. Another benefit is that these improvements will decrease load time (and therefore increase performance) on your platform.

One of the consequences for switching data points is that we can no longer show a relative timestamp below the topic title. Instead we will show the category to which the topic was posted to provide more context about the topic.

Other suggestions for improvements such as manually recommending topics or only listing topics between a specific time range are not included. Our priority is to make Related topics results more accurate.

These improvements will be automatically rolled out to your platform in the upcoming weeks. We'll let you know when it's there.

8 replies

bjoern_schulze
Forum|alt.badge.img+2
  • Helper ⭐️⭐️⭐️
  • 344 replies
  • January 14, 2019
Thanks for picking this issue up!

My understanding is that the new "related topics" widget will use the same logic / datapoint as the current live-search engine. Can you give us a list of all factors that are taken into account when it comes to sort the relevance?

You also say that "other suggestions for improvements [...] are not included". But in our opinion this contradicts the following sentence that your "priority is to make Related topics results more accurate". Because we think that factors like date, number of helpful votes, number of clicks, number of comments and/or the subforum are also relevant to determine a better list of results.

We're happy to provide more detailed feedback and are also happy to support you regarding testing and improving the widget, because for us the "Related topics" widget (if done right) is an important function to lower the bounce rate and increase activity, as well as giving users a quick glimpse into the depth of our content.

Yoeri
Forum|alt.badge.img+3
  • Author
  • Gainsight Employee ⭐️⭐️⭐️
  • 400 replies
  • January 24, 2019
Hey,

The changes mentioned above are now in effect.

Can you give us a list of all factors that are taken into account when it comes to sort the relevance?

The following factors are taken into account: Searchable attributes (= which attributes do we search for) and Ranking formula (= how hits are sorted)

Searchable attributes (ordered by importance)
  • Title
  • First post
  • Answer
  • Reply
  • Tags
  • Category
  • Category group
Ranking formula
  • Number of words from the query that match,
  • Typos
  • Position of the matching words
  • Was the topic solved (y/n)
  • When was the topic last updated
  • Number of likes
  • Views
  • Replies
You also say that "other suggestions for improvements [...] are not included".

In this case I was referring to the suggestions manually recommending topics and only listing topics between a specific time range should appear. We agree that the factors mentioned by you are important to determine a better list of results. As you can see in the lists above a lot of the attributes are taken into account. Recently we added the 'Helpfulness score' attribute to our search engine, when we have sufficient data we can start including this attribute in the ranking formula as well. Topics with a higher helpfulness score will appear higher/first in list of results 🙂

Jurgen
Forum|alt.badge.img
  • Helper ⭐️
  • 178 replies
  • January 25, 2019
Thanks for paying attention to this feature @Yoeri

First off, just a nitpicking thing: can you add some more space between the title 'Related topics' and the related topics?

Secondly: I'd prefer it if new features would be announced and activated on staging by default, so that we can have a week or 2 to test and get used to them before general rollout. Anyone with me?

Third: it would be nice to measure performance improvements after rollout of these features, in this case when it comes to customers finding an answer. I'd suggest using A/B-testing for this.

bjoern_schulze
Forum|alt.badge.img+2
  • Helper ⭐️⭐️⭐️
  • 344 replies
  • January 25, 2019
Jurgen wrote:
Secondly: I'd prefer it if new features would be announced and activated on staging by default, so that we can have a week or 2 to test and get used to them before general rollout. Anyone with me?

Yes. A 100%.

Third: it would be nice to measure performance improvements after rollout of these features, in this case when it comes to customers finding an answer. I'd suggest using A/B-testing for this.

Yes. A 100%.

I also submitted a ticket:
The field that is shown below the title is the name of the category the topic’s subforum belongs to. I think it would be far better to show the subforum's name itself (and also link to it) as this is far more relevant information.

Yoeri
Forum|alt.badge.img+3
  • Author
  • Gainsight Employee ⭐️⭐️⭐️
  • 400 replies
  • January 28, 2019
Thanks for the feedback.
We're going to add some more whitespace between the title 'Related topics' and the list of topics below. We will also change the Category to the Subforum, we agree this makes more sense.

I'd prefer it if new features would be announced and activated on staging by default, so that we can have a week or 2 to test and get used to them before general rollout


We'll take this into account for future releases.

I'd suggest using A/B-testing for this.


Keen to hear your ideas on this, can you elaborate this? 🙂

Suvi Lehtovaara
Forum|alt.badge.img
bjoern_schulze wrote:

I also submitted a ticket
The field that is shown below the title is the name of the category the topic’s subforum belongs to. I think it would be far better to show the subforum's name itself (and also link to it) as this is far more relevant information.


I agree on this 100 %.

Yoeri
Forum|alt.badge.img+3
  • Author
  • Gainsight Employee ⭐️⭐️⭐️
  • 400 replies
  • January 30, 2019
We deployed some improvements to the related topics widget:
  • Added whitespace between 'Related topics' title and the list of topics
  • Display the subforum a topics belongs to (not the category)
  • Made the subforum a link
Thanks for your feedback!

Jurgen
Forum|alt.badge.img
  • Helper ⭐️
  • 178 replies
  • February 14, 2019
Yoeri wrote:

I'd suggest using A/B-testing for this.
Keen to hear your ideas on this, can you elaborate this? :)


I'm elaborating here 🙂

Reply


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings