Skip to main content
Syed
Contributor ⭐️⭐️⭐️
Jul 10, 2022 4:36 PM UTC
Solved

How to remove duplicate values from Union in Data Designer or from Rule?any suggestion?

Combined 2 tables in Data Designer via Union but gives me duplicate rows.How should i remove them?

    WayneAnswer
    Expert ⭐️
    Aug 26, 2022 12:15 AM UTC

    You could probably get away with just applying a filter where Serial 1 != null AND Serial 2 != null AND Serial 3 != null AND Serial 4 != null post this union. That would remove those blank rows. 

     

    Unless it’s possible for an ID to be blank in both data sets and you want to reflect that. If that is the case then you will need a different solution.

     

    Merging instead of union and then case statement your duplicate fields to combine them. If Table 1.Serial 1 != null then output Table 1.Serial 1 Else Output Table 2.Serial 1

    View in thread

    4 replies

    rakesh
    Gainsight Employee ⭐️
    rakesh
    Lets put your data to work!
    Jul 10, 2022 5:30 PM UTC

    @Syed 

    The best possible path is to avoid duplicates when you do a union itself. Make sure you use the right filters so that a single record doesnt come in both datasets. If there is any usecase that makes this impossible, could you please post that here? 

     

    That being said, one way to remove duplicates is to load the data to an(other) object and use correct identifiers. 

    Translate
    SyedAuthor
    Contributor ⭐️⭐️⭐️
    Jul 10, 2022 8:49 PM UTC

    Hi @rakesh 

    Below are as an example 2 samples. when i union them.It gives me 4 rows.what filter i should add that

    it should not  show rows which have not values in Serial 1, Serial 2, serial 3 andIf any row has value iether of these fields then it should show.In this example Table 1 should show ID 2 and Table 2 should show ID 1

     

    Translate
      jpgamboa
      jpgamboa
      Contributor ⭐️
      Aug 25, 2022 4:39 PM UTC

      @Syed - I believe I’m having the same issue as you. I was using Union to combine based on Advanced Outreach Name but it’s splitting up both like so. Is that correct?

       

       

      Translate
      WayneAnswer
      Expert ⭐️
      Aug 26, 2022 12:15 AM UTC

      You could probably get away with just applying a filter where Serial 1 != null AND Serial 2 != null AND Serial 3 != null AND Serial 4 != null post this union. That would remove those blank rows. 

       

      Unless it’s possible for an ID to be blank in both data sets and you want to reflect that. If that is the case then you will need a different solution.

       

      Merging instead of union and then case statement your duplicate fields to combine them. If Table 1.Serial 1 != null then output Table 1.Serial 1 Else Output Table 2.Serial 1

      Translate
      Terms & ConditionsAccessibility statement