Loading Historical Usage to Existing Usage Table

  • 28 August 2019
  • 0 replies

Userlevel 1
Badge +2
  • Team Captain
  • 30 replies
During our initial implementation we created a usage table that's populated via an S3 ingest job. We recently added a phase 2 for metrics to include in the existing table, which are new columns that have been added to the table. Future data files will map to the new columns, but we are looking to backfill historical data for the new columns. In order to backfill historical data for the new metrics, I wanted to check if there is a best way to do this that keeps the existing metrics as is and only updates the new columns with the historical data.

My initial thinking is to create an S3 ingest rule that uses Date and SFDC ID as the unique identifiers, and only map the columns I want to upsert, leaving all other columns I want unchanged as "None." Would this be the best way to accomplish this?

0 replies

Be the first to reply!