Multiple variables in wildcard source in Data Flows ADF

Degenocrat 27 Reputation points
2022-12-19T10:39:41.263+00:00

Hello,
I have partitioned files in my data lake by year and month. I would like to read multiple 'year' folders as a single source in Azure Data Factory Data Flow using wildcard.
Currently I managed to read just a single year in my wildcard and added another source for a different year. I then union the two datasets. See pictures below.
272073-screenshot-2022-12-19-at-113144.png
272044-screenshot-2022-12-19-at-113121.png
The years and months are parameters in the screenshots, but when exploring particular years I just add them as strings directly in the wildcard path. They represent a folder under which the childs are months with their respective datasets. So far I have tried passing (2022|2021) in various formats, but this results in an error.

How do I pass multiple specific variables in a wildcard path?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,365 questions
{count} votes

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.