Vast Sized File split up for data processing.
Earlier when we get the huge sized files from S3 connectors, the data processing through rules become too slow and for time being the files were manually splitted up. So current idea is to create a File splitter option in connector to automate the splitting process based on our requirement.