ADF Copy Activity Taking Long Time to copy data from ADLS to CosmosDB

Question

Hi In my current requirement i need to copy data from adls to cosmosdb the size of file is 1.5GB and cosmosdb RU's are selected as 40K the pipeline taken 12 hrs to run . is there any way to speed up the Pipeline run time.

Thanks& Regards
Prapul Kumar.D

Answer 1

Hello @Prapul Kumar Dongari ,
Thanks for the question and using MS Q&A platform.
As we understand the ask here is how to speed the pipeline run , please do let us know if its not accurate.
Are the ADF , ADLS & CosmsoDB all in the same region ? I will start with this basix check and tyhen move to the below document .To copy a file of 1.5 GB if it takes 12 hours for sure thats slow . Also if you change the time of execution of the pipeline , does the execution time improves ? I am just trying to check if any other process writing/Reading the Cosmosdba nd if its RU deprived .

https://learn.microsoft.com/en-us/azure/data-factory/copy-activity-performance-troubleshooting#troubleshoot-copy-activity-on-azure-ir

Also I suggest to check the details in the copy activity .

Please do let me if you have any queries.
Thanks
Himanshu

---

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators