Skip to main content
Question

Adoption Explorer: Filter down rows pre-ingest?

  • July 27, 2022
  • 0 replies
  • 10 views

matthew_lind
Forum|alt.badge.img+11

Within Adoption Explorer, how can add a filter or otherwise limit the number of rows the AE job reads?

My data team recently increased an already sizable table by 4x, bringing it close to 8 million rows daily. I know I will never need 7 million of those rows, because they include data not needed by Gainsight. However, I haven’t found a way to filter the number of rows the AE job reads.

With a “read” filter, or some pre-ingest filter in place, I’d benefit from faster ingests and also a reduction in the processing power required by the AE tool by identifying logically which rows I know I want AE to process further. By “dropping rows” at the initial read, I can process and ingest a more targeted dataset, improving my ingest speed and decreasing the processing load.