This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(51.2, 19%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENC%3C/text%3E%3C/svg%3E)
I have REST API as source and Azure SQL as sink. There are around 80M rows (300 rows per page) in API. I am using copy activity with AbsoluteURL as pagination method.
The problem is that the copy activity is very slow. It take about 21 hours to read 2GB and write 1GB data.
The throughput is maximum 30 KB/s.
My configuration:
DIU units (in copy activity setting): Auto
Pool DTUs : 50
Service Tier: Standard(For workloads and typical performance requirements).
Can Anyone please help me with this? I can't wait for days to copy few amount of data.
Thankyou
Hi @Neeraj Chimwal ,
Is any selfhosted IR is getting used while making API call or Azure SQL side? if yes, could you please check any CPU on the self hosted IR system if there is any other process eating more resources?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(240, 12%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESA%3C/text%3E%3C/svg%3E)
Hi @Neeraj Chimwal , this has been quite a few times, please go through below threads:
https://learn.microsoft.com/en-us/answers/questions/445951/azure-data-factory-performance.html
Hi @Samy Abdul
Thank you for the reply.
I looked up in the threads you provided but didn't find any solution there.
I tried using parallel copies and setting manual DIU to 4. Still the throughput remains the same.
I have a single copy activity which simply takes data from REST API and copy it on Azure SQL database.
Can you please suggest me any alternative method?
Did you tried increasing DIUs? Above shared links has details about how we can increase performance with some best practices. Hope that might have helped.