Skip to main content
revote
VIP ⭐️⭐️⭐️⭐️⭐️
July 31, 2024

Experiences about different survey types for the community visitors / members

  • July 31, 2024
  • 19 replies
  • 318 views

Hi folks,

do you use surveys for the visitors or members, to improve community´s user experience? How they have worked?

We use and I think you use as well.

Background:

We have run our community for years. We have started with pop up -surveys. First tweaks we made we adjusted the trigger time how quick survey triggers, after user landed to the community.

After those tweaks we got less feedback that survey is annoying because “I just wanted to read the topic and pop up filled my screen!#”%%&6”. So tweaks we made were ok.

Most of the feedback were mostly about our products. Only few feedback were for the community itself. And it is sad if you are community captain. It is ok for the company of course.

Then we made new changes to the survey. We choosed to get rid of the pop up -survey and we added floating feedback button to each and every community page. After this change, number of feedbacks dropped dramatically. I understand, especially when using mobile, floating buttons are difficult on small screen. When using desktop you dont pay attention to the button. Feedbacks we still got were about the products.

Now we have made latest changes. We asked from the users couple of months back, what kind of survey users would like to answer the most. They said that embedded is the best so we added HTML widget to the Topic sidebar and now we collect feedback in each and every topic (discussion, question, article).

We have 5 smileys there, where user can choose. We ask also to explain their response freely with words. Lastly we ask what people want to read in the community in the future. With this survey we want to improve our content.

Addition this embedded survey, we added pop up -survey to the community as well. With this survey we collect feedback about the overall experience about the community. We adjust the timing still, we dont want to annoy the users. We added pop up -survey because users said it is ok, if it doesn´t appear too soon.

We´ll see how this combination works.

 

--

 

I would like to hear your thoughts:

  • Have you used embedded surveys in the community and how they have worked?
  • What kind of survey type works the best you think? Pop up, embedded, floating feedback button, feedback button in the page or something else?
  • What kind of feedback you mostly get from the user surveys - feedback about the products or feedback about the community?

I´d say even I ask feedback about the content and the community, because most of the users come to our community to solve their problem and this is the only thing they can think about in that moment, this is the reason they give the feedback about the product. No matter what kind of survey type is in use and what I ask from them.

    19 replies

    Suvi Lehtovaara
    Helper ⭐️⭐️
    January 16, 2025

    We recently made a change to our surveys as an experiment. We used to have FCR and later on “Did you find what you were looking for”, but the results were surprisingly similar. I mean that the percentage of the “No” respondents was as large in both.

    So we decided to change it to CSAT - let’s see what happens 😊

     

    Now we have made latest changes. We asked from the users couple of months back, what kind of survey users would like to answer the most. They said that embedded is the best so we added HTML widget to the Topic sidebar and now we collect feedback in each and every topic (discussion, question, article).

    We have 5 smileys there, where user can choose. We ask also to explain their response freely with words. Lastly we ask what people want to read in the community in the future. With this survey we want to improve our content.

    Addition this embedded survey, we added pop up -survey to the community as well. With this survey we collect feedback about the overall experience about the community. We adjust the timing still, we dont want to annoy the users. We added pop up -survey because users said it is ok, if it doesn´t appear too soon.

    We´ll see how this combination works.

     

     ​@revote can you share us how this combination works? Are people answering the embedded survey?

    https://yhteiso.elisa.fi/
    revote
    revoteAuthor
    VIP ⭐️⭐️⭐️⭐️⭐️
    January 16, 2025

    Now we have made latest changes. We asked from the users couple of months back, what kind of survey users would like to answer the most. They said that embedded is the best so we added HTML widget to the Topic sidebar and now we collect feedback in each and every topic (discussion, question, article).

    We have 5 smileys there, where user can choose. We ask also to explain their response freely with words. Lastly we ask what people want to read in the community in the future. With this survey we want to improve our content.

    Addition this embedded survey, we added pop up -survey to the community as well. With this survey we collect feedback about the overall experience about the community. We adjust the timing still, we dont want to annoy the users. We added pop up -survey because users said it is ok, if it doesn´t appear too soon.

    We´ll see how this combination works.

     

     ​@revote can you share us how this combination works? Are people answering the embedded survey?

    We haven´t got much negative feedback because of the pop up. It is matter of timing, pop up should not activate too early. But I knew this, we have used pop up -survey earlier also. Number of feedback is ok.

    What is surprising is that number of feedback from the embedded survey is very, very low. User can choose to press just smiley or to add free text as well. We don´t get none of them much.

    I think this is because most of users use mobile and the embedded survey is bottom of the page. Most of the users doesn't notice it.

    --

    So now, after few months I can say that if you want to measure your community performance and gather feedback, if you think about embedded or pop up -survey, pop up -survey is better. Just choose (test) carefully the timing.

     

    EDIT: Reason for the embedded survey is to improve the content (if possible). As you can imagine, most of the users gives feedback about the situation, not for the content. So from that perspective either, I am not fan of embedded surveys 😀

    BradleyOVO
    Contributor ⭐️⭐️⭐️
    January 16, 2025

    What a great and interesting topic/thread to read ​@revote - Thanks for raising this matter for discussion.

     

    This is something, like ​@DannyPancratz we lean on to satifsy internal business stakeholders in regards to the value that our forum brings. However, as I’m learning via this thread, lots of you are running into similar difficulties around the usefulness of the pop out surveys. 

     

    I’ve noticed that the embedded ‘Yes’, ‘No’ survey on each topic garners the most engagement from our online user community - but then is slightly ‘scuppered’ by the inaccuracies of our pop out survey (timing of pop up is a major concern as well as accuracy of qaulitative feedback provided).

     

    I’m really keen to know of any survey processes that Forum Community Managers may have adopted outside of these mentioned above? We’ve been getting some incredibly profound email campaign data that indicates utilising this feature could support a more direct survey approach (concious of doing this infrequently as to not bombard our users). 

    Have people tried any other means or experiments around this that yeilded surprising results?

     

    Thanks all😊

    I'm not lazy, I'm just in energy saving mode!
    DannyPancratz
    VIP ⭐️⭐️⭐️⭐️⭐️
    January 16, 2025

    @BradleyOVO can you tell us a bit more what you mean by this? 

    We’ve been getting some incredibly profound email campaign data that indicates utilising this feature could support a more direct survey approach (concious of doing this infrequently as to not bombard our users). 

    FYI: I am no longer active in this community
    BradleyOVO
    Contributor ⭐️⭐️⭐️
    January 16, 2025

    Apologies ​@DannyPancratz  - Was clearly too eager to get a reply to this thread without taking the time to properly explain!

     

    Hopefully I can share the following image for context: 

    Example of email campaigns Sent Data

    I’ve been aware of the Email Campaign feature on the Control platform for some time and have been eager to use it to help support engagement to our platform.

    Since September we started holding monthly competitions where users could sign up and be in the running to win a set of free event tickets to one of our branded venues.

    (Here’s one of the competition topics for context: https://forum.ovoenergy.com/ovo-live-164/it-s-october-ready-to-win-some-more-tickets-with-ovo-live-18478)

    I set the reciepient audience to be ‘Registered Users’ (Which I’m thankful only targets those who’ve been active over the last year) and sent it away, crossing my fingers and hoping for the best.

    I was expecting the spam and unsubscribe rates to be extremely high, especially where the email campaign is about a competition. However, they’ve surprisingly remained low and engagement has remained steady. We’d see a topic go from a normal footfall of below 100 views shoot up to around 1000 after a targeted email had been sent also!

     

    This experience has got my cogs turning and my team excited that we could try more targeted survey campaigns around surveys, which may give us some more realiable and direct feedback on how we’re performing. This, on top of the pop out and embedded surveys.

     

    Hope this makes much more sense?

    I'm not lazy, I'm just in energy saving mode!
    DannyPancratz
    VIP ⭐️⭐️⭐️⭐️⭐️
    January 16, 2025

    @BradleyOVO thanks for the additional details! 

    FYI: I am no longer active in this community
    revote
    revoteAuthor
    VIP ⭐️⭐️⭐️⭐️⭐️
    January 17, 2025

    This experience has got my cogs turning and my team excited that we could try more targeted survey campaigns around surveys, which may give us some more realiable and direct feedback on how we’re performing. This, on top of the pop out and embedded surveys.

    Have you already though how you reach the visitors? Who just lurks in the background 😀

    BradleyOVO
    Contributor ⭐️⭐️⭐️
    January 17, 2025

    This is the double edged sword issue - Driving and maintaining overall engagement as well as getting real, informative feedback at the same time! 😅

    I’ll let you all know how the potential email campaign survey request goes when we attempt it and what sort of engagement we received...😶

    I do find all of the challenges around this super exciting! 

    I'm not lazy, I'm just in energy saving mode!
    revote
    revoteAuthor
    VIP ⭐️⭐️⭐️⭐️⭐️
    January 17, 2025

    I got idea ​@BradleyOVO from you to use Email Campaign as a tool to gather feedback from the users who have participated. This is new point of view, for me at least. And it is good that we can automate this message.

    Sadly, if users unsubscribe, then they dont receive any other messages from us.