Skip to main content
steve_davis
Gainsight Employee ⭐️⭐️
March 29, 2017
Discovery

A/B Testing for JO

Related products:CS Journey Orchestrator
  • March 29, 2017
  • 31 replies
  • 965 views

We are looking for an easy way to split a power list in half to send a message to one sub group and a slightly different one to another sub group to compare the results. Of course, we can set up a flag and populate it. I am just looking to see if we can do it easier than that. Is this something we have considered as a feature for JO?

    31 replies

    scott_sigsci
    Helper ⭐️
    December 21, 2019

    @dan_ahrens now I remember why I put that in… I keep getting this error. Any thoughts? (Note: I didn’t see this error in the first two transformations)

     

    dan_ahrens
    Expert ⭐️⭐️⭐️
    December 23, 2019

    Hi Scott, without working in your org specifically, it’s hard to dig very deep on troubleshooting and advising using screenshots, but you might find it helpful to do that field length calculation in it’s own step and then merging that data back in with your other company data. Your Gainsight Customer Success Manager can probably work 1 on 1 with you to tune this query. 

    VP of Customer Success at Forcepoint
    scott_sigsci
    Helper ⭐️
    December 23, 2019

    Thank you @dan_ahrens , much appreciated.

    scott_sigsci
    Helper ⭐️
    January 7, 2020

    @dan_ahrens I figured out what the issue is. In this case, you don’t use a “calculated field,” you use “numeric expression.”

    mkolacek
    Contributor ⭐️⭐️
    March 27, 2020

    @dan_ahrens: Thanks a lot for the idea with LENGTH and MEDIAN above. Very interesting angle to look at it! Is it, however,  – statistically speaking – random enough? Have you maybe considered adding a distinct random function, i.e. similar to RAND() function in MySQL? We currently use exactly that, just with a bit of extra complexity and pushing it to Gainsight from our internal data warehouse.

    In any case, I think it would be great to have the fork functionality that @dale_parent suggested above. Having that option directly in the flow and, ideally, also being able to compare the results directly in the Analytics would be absolutely amazing!

    kelly
    Helper ⭐️⭐️⭐️
    October 14, 2020

    Do posts tagged ‘Work around available’ ever get revisited? This would be nice to have as an actual feature and not a 3 task transformation. It also doesn’t solve for powerlists or segments, as that feature grows in adoption.

    dan_ahrens
    Expert ⭐️⭐️⭐️
    October 20, 2020

    We are looking at some options to do this in Journey Orchestrator and might have some more updates closer to the start of the new year. 

    VP of Customer Success at Forcepoint
    Contributor ⭐️⭐️
    February 10, 2021

    Is there any update to make this a feature? All of our account IDs are exactly the same length, so this crazy complicated workaround is really not feasible for us. It would be really helpful to have this as a feature with similar parity to other email systems where I can just configure the A/B settings and let it deploy with randomization. 

    This would also help with company conversion. My marketing team is showing more interest in using JO rather than Marketo for certain drip campaigns and surveys, but this is a basic functionality they use all the time. 

    dan_ahrens
    Expert ⭐️⭐️⭐️
    February 10, 2021

    This is a feature that is being planned for 1H 2021. 

    VP of Customer Success at Forcepoint
    Chelsea.holfield
    Contributor ⭐️⭐️⭐️⭐️
    June 30, 2022

    Hello! I wanted to follow up and see if there was still hope for this to be a feature in JO? Our company would love to start doing some A/B testing as we bring more complicated programs into Gainsight and adding the additional transformations would complicate things a bit leaving more room for error when trying to complete the testing.