Move dated data files for data engineers before pipeline run

Your incoming data files with embedded dates sit in a general folder, delaying scheduled ingests and model refreshes. Engineers get files routed into a dated processing folder so pipelines start before the next scheduled run.

Move dated data files for data engineers before pipeline run

Move dated data files for data engineers before pipeline run