Partition dimension of parquet files copied in hierarchical folders respect to year, month and date

pmscorca 877 Reputation points
2023-11-25T22:12:00.1533333+00:00

Hi,

I've implemented a Synapse mapping data flow, called by a pipeline, to copy source parquet files (NYC green taxi data) into a hierarchical folders, partitioning for year, month and date keys:

User's image

At the leaf level of these hierarchical folders I've noticed that some partitions were created, but is it possible to change the dimension or the number of these partitions maintaning their related distribution in the year-->month-->date folders? Thanks

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,652 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,073 questions
{count} votes