This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 17%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGR%3C/text%3E%3C/svg%3E)
Hi, In On-premises, I have a table with a size of around 100GB (5 years of data). I intend to upload the 100GB table as a parquet file to the data lake storage account. While moving data to the storage account, Table data must be split and copied to the parquet file based on the date column in the table. Is it possible to do this dynamically in data factory?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(54.400000000000006, 12%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESV%3C/text%3E%3C/svg%3E)
Hi @GOVIND RAJ ,
Thanks for using the MS Q&A portal for posting your query.
Please check this blog. Instead of round robin partition, you can choose key based partition and mention the date column.
To know more about partitioning schemes: check here
Please let us know if you have any question
Thanks
Hi @GOVIND RAJ
Just writing to know if you could follow the blog post and implement partitioning. Please feel free to write to us in case you are stuck somewhere.
Thanks
Hi @Subashri Vasudevan Since the source is on-prem , The self hosted IR doesn't support data flow. Can this is achievable in copy activity partition?
Thanks.
Hi @GOVIND RAJ ,
Yes, you can leverage the partitioning option in copy activity abd see if it does the trick.
Here is a relatively similar thread, which discusses some basics about partitioning in copy activity. Please check it that helps.
Kindly reach out for more clarification
Hi @GOVIND RAJ ,
Just checking in to see if the above answer helped. Please do consider clicking Accept Answer as accepted answers help community as well. If you have any further query do let us know.