Skip to main content
New Idea

Display a progress bar towards max payload side in DD / HRE and Query Builder

Related products:CS Data Management & IntegrationsCS Journey Orchestrator, Email & NotificationsCS Rules Engine
  • amanda_neil
    amanda_neil
  • diane_morneau
    diane_morneau
  • theresalucius
    theresalucius
  • parimala_agnihotri

alizee
  • VIP ⭐️⭐️⭐️⭐️⭐️
  • 659 replies

All

I’ve recently hit an invisible limit in data designer: the 16mb payload size limit.

Long story short:

I had a decently sized data design pictured below, 24 tasks and trying to create 4 union tasks to bring my data set together(bringing it to 28 tasks - NOT MY LARGEST DESIGN). The 4th union (circled in red below, and at some point the 3rd one) refused to create itself with an unknown error message.

Turned out to be that the payload size would have been over the limit of 16mb with my 4th union.

YET there is NO indicator that we are approaching the feature limit anywhere in the UI and the error code is cryptic at best and helping no one: not the solution designer and not Gainsight who is getting tickets for things we could self-resolve.

 

Enhancement request:

We need a visual cue such as a progress bar, in query builder, data designer and rules engines showing us HOW FAR or HOW CLOSE from the product limitations showing both the current size of the payload (a figure, in bites ideally) and the progress towards the limit (the 16mb), ideally from green to red to show good and bad.

Since tasks and field size in the payload varies and can’t be predicted, we need to see that live calculation and progress bar. Besides the need to avoid limitations, I’m certain it would help us optimize our designs, including those that don’t hit the limits but perhaps could be further optimized. 

 

And for those who want to know the end of the story:

The culprit was trying to bring in the time zone of the recipient (required to send emails in the person’s time zone - first task highlighted in yellow) and the sender’s time zone (“users fetch”, highlighted in yellow, because our standard Outlook email signature features that info and we’re trying to mimic the signature for consistency).

Picklists with a lot of values apparently increase the payload drastically, and time zone has 432 system values. After changing the sender time zone to a string (duplicate as string function, I could create the 4 union tasks BUT the design failed to run and error logs indicated this message:  Payload document size is larger than maximum of 16793600. At that point, the error message was more helpful. So I needed the two fields but I was NOT ABLE to use both, including with the conversion to string (despite it working up to creating my last union). Using both apparently would require me to nest two designs together, and without proper chaining capabilities… what could possibly go wrong

 

3 replies

romihache
Forum|alt.badge.img+8
  • VIP ⭐️⭐️⭐️⭐️⭐️
  • 429 replies
  • April 1, 2025

This is a great idea!
Implementing a progress bar for DD/Rules designs would significantly optimize workflows. Knowing the status of background operations eliminates the risk of investing (wasting) time in designs that ultimately fail.
 


dayn.johnson
Forum|alt.badge.img+6
  • VIP ⭐️⭐️⭐️⭐️⭐️
  • 647 replies
  • April 1, 2025

☝ 100%.

Just saying “16 MB limit for DDs” or “x number of unions” does not help us plan these workflows. Being able to see this in a progress bar would be great.

What would be even better was if admins had Gainsight Admin Copilot AI that we could ask questions such as “I want to build a Data Design with this number of tasks, merges, and unions, will there be any issues?” and get a response that says “Actually, that won’t work with the current system limits because the payload will be over the limit.”


alizee
Forum|alt.badge.img+12
  • Author
  • VIP ⭐️⭐️⭐️⭐️⭐️
  • 659 replies
  • April 1, 2025
dayn.johnson wrote:

☝ 100%.

Just saying “16 MB limit for DDs” or “x number of unions” does not help us plan these workflows. Being able to see this in a progress bar would be great.

What would be even better was if admins had Gainsight Admin Copilot AI that we could ask questions such as “I want to build a Data Design with this number of tasks, merges, and unions, will there be any issues?” and get a response that says “Actually, that won’t work with the current system limits because the payload will be over the limit.”

 

#aiwillsolvethis 


Reply


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings