synapse vs adf pipeline speed

Question

hello,
for the same pipeline, in synapse it appears the speed of running a pipeline is quicker than datafactory.
Have you noticed this too?
do you know why this is the case?
Thanks

Answer 1

Hello @arkiboys ,

Thanks for the question and using MS Q&A platform.

AFAIK, both the pipelines in ADF and Synapse are pretty much same and should behave same unless there is a change in pipeline flow or different integration runtimes used and the regions between ADF and Synapse as not the same. If pipelines flows are identical (activities, regions, IRs, source and sink data size same) then you should see pretty much same performance across both.

1. Could you please confirm if it is the same pipeline with same number of activities between ADF and Synapse pipelines? If they are identical what are the activities being used?
2. Are you noticing this behavior consistently between ADF and Synapse?
3. Were you able to troubleshoot from beginning to end of the flow to identify at which point it is taking more time between both? If you are using Copy activity, then I would suggest going through this document to identify at which point the process is taking more time - https://learn.microsoft.com/en-us/azure/data-factory/copy-activity-performance-troubleshooting

Hope this info helps. If you have further questions, please do share above details so that we can assist accordingly.

Thank you