Azure Data Factory's Copy Data Activity and Microsoft Dataverse Web API's ExecuteMultipleRequest

Question

Hello All,

I see that Azure Data Factory's Copy Data activity can be used to ingest records in bulk into Dataverse.

Does it make batching requests like ExecuteMultipleRequest to export/import bulk data?

There is no mention about it in the documentation.

Thanks

Dinesh

Answer 1

Hello @Uthayakumar, Dinesh

Azure Data Factory's Copy Data activity can be used to ingest records in bulk into Dataverse.

However, it does not use batching requests like ExecuteMultipleRequest to export/import bulk data.

The Copy Data activity uses a scalable compute infrastructure to move data between source and sink data stores.

It can read data from various sources, transform the data, and write the data to various sinks. The activity is powered by a globally available service that can copy data between various data stores in a secure, reliable, and scalable way. If you need to use batching requests like ExecuteMultipleRequest to export/import bulk data, you can use the Microsoft Dataverse Web API directly. The Web API provides a programming model that you can use to interact with Dataverse data from your own custom code.

---

I hope that this response has addressed your query and helped you overcome your challenges. If so, please mark this response as Answered. This will not only acknowledge our efforts, but also assist other community members who may be looking for similar solutions.

Answer 2

Hello Uthayakumar, Dinesh,

Welcome to the Microsoft Q&A and thank you for posting your questions here.

I understand that you are trying to determine if Azure Data Factory's Copy Data activity can batch requests similar to the ExecuteMultipleRequest in the Microsoft Dataverse Web API for bulk data export/import, since the documentation does not mention this capability.

Azure Data Factory's Copy Data Activity:

It is designed to move data between various data stores securely and reliably.

• It does not inherently support batching requests in the same way as ExecuteMultipleRequest.
• https://learn.microsoft.com/en-us/azure/data-factory/copy-activity-overview

Microsoft Dataverse Web API:

The ExecuteMultipleRequest is specifically designed to handle high-throughput bulk message passing scenarios.

• It allows multiple requests to be executed in a single call, improving performance by reducing network latency2.
• https://learn.microsoft.com/en-us/power-apps/developer/data-platform/org-service/execute-multiple-requests

Therefore, to achieve the functionality of batching requests for bulk data operations, you should use the Microsoft Dataverse Web API with ExecuteMultipleRequest. This method is explicitly designed for such scenarios and will provide the performance benefits you are looking for.

I hope this is helpful! Do not hesitate to let me know if you have any other questions.

---

Please don't forget to close up the thread here by upvoting and accept it as an answer if it is helpful.