Batching file i want to write in single file

Question

Suppose we have 10k entities in JSON and i want to publish any target location then i can achieve them through batching and i will get multiple files in target location but my question is that while batching i am getting batch file with batch size entities value and trying to write into a single file in azure blob .

Do we have ability to write multiple file entities into a single file of Azure blob.

Answer 1

@Rashid Iqbal Apologies for the delayed response here and any inconvenience it might have caused.

One option that might work for you is using Azure Data Factory. For copy activity you can merge the files using blob storage as the destination. There is a property called MergeFiles which can be specified for copyBehavior and this will merge all the files from the source folder to one file.

Hope this helps! Let us know if you have further questions or issues and we will be happy to assist.

-------------

Please don’t forget to "Accept the answer" and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.