How to read Last Partitioned File from ADLS using ADF mapping Data Flow

David Tuñon 1 Reputation point
2021-12-02T17:06:04.56+00:00

Hi All,

we have a requirement to read last ingested partitioned parquet files which are available in ADLS folders.

ADLS folder structure: XXX/processed/year=yyyy/month=MM/day=dd

Can any give me idea how to read last date partitioned files dynamically in ADF mapping data flow. I mean how to recover partitioned folders and select last in time.

Thank you!
Regards,
David

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,138 questions
{count} votes