Better method for delimiting or otherwise outputting long, formatted text fields to S3?
(cross-posted to Rules Engine and Data Platform)
Having some trouble with outputting long text fields to S3 for automated pickup and ingest by Cisco. Because these fields have line breaks in them, CSVs get jumbled - and tab delimited can get broken up by tabs in the formatted text being exported.
Any thoughts on making this easier? How to integration apps handle moving formatted text? At the least, offering a pipe or other delimiter not usually found in formatted text? Or adding a function to remove line breaks when exporting a delimited file?
Definitely interested in both solutions on our roadmap, and potential short-term workarounds. Cisco will probably start to escalate this soon as it is blocking a clean, automated flow of info back to their data warehouse, so if we can avoid that with a good suggestion or coming enhancement, I'd be a fan!
This will be a common use case for Enterprise customers - I know there are multiple customers, including Cisco, who want a bi-directional API, but in the short term, making the data output more consumable would be a great start.
Thanks!
Having some trouble with outputting long text fields to S3 for automated pickup and ingest by Cisco. Because these fields have line breaks in them, CSVs get jumbled - and tab delimited can get broken up by tabs in the formatted text being exported.
Any thoughts on making this easier? How to integration apps handle moving formatted text? At the least, offering a pipe or other delimiter not usually found in formatted text? Or adding a function to remove line breaks when exporting a delimited file?
Definitely interested in both solutions on our roadmap, and potential short-term workarounds. Cisco will probably start to escalate this soon as it is blocking a clean, automated flow of info back to their data warehouse, so if we can avoid that with a good suggestion or coming enhancement, I'd be a fan!
This will be a common use case for Enterprise customers - I know there are multiple customers, including Cisco, who want a bi-directional API, but in the short term, making the data output more consumable would be a great start.
Thanks!