Improve outer merge output data sets
Hey All,
I have found the outer join/merge data tasks in Data Designer falls a little short.
Currently, when you perform an outer merge on two data sets, for example with a merge on GSID, the final data set looks like this

This is not as useful as could be as despite merging on GSID, GSID values have not been parsed to both GSID columns. Instead, we have no values. That means effectively merging the data sets in a useful manner will involve the use of case expressions (which are limited in capability, both criteria and case statements).
When performing an outer merge, we consider the join on field as the identifier. There is no reason why we shouldn’t consequently be appending records that exist only in one of the datasets to the bottom of each of the other data sets as part of the merge.

We could then just take the following data points:
- GSID Data Set 1
- Name Data Set 1
- Version Data Set 2
And have a data set with all the information I need, against an identifier that would be available from each of the GSID columns.
The below result would instead allow us to drop one of the two GSID columns (like we do in other merge types), and to effectively use the data for reporting purposes or in Journey Orchestrator. It would also help rationalize queries and data designs by not having to add other data set with a merge left and a final transformation to eliminate empty values (and further transformation to require duplicates). See below two additional tasks to achieve the desired outcome (further transformation required to eliminate duplicates too).

Thanks!