Skip to main content

We currently have a bunch of Biquery connector jobs, all upserting into completely different MDA objects.  Due to the size of data in each job, along with the number of jobs, this takes a lot of time to run every job.  Compounded by the lack of ability to tie a dependency on Data Designers or rule chains to these jobs completing, if queues back things up, then our entire rule chain is compromised and makes our data state at best, at worst case some right, some wrong.

So, similar to being able to run multiple rules at same time, if connector jobs are writing to different MDA objects, be able to run “X” number of jobs concurrently to help process data quicker.

Be the first to reply!