How is the refresh of data triggerred when synching data from Dataverse to Data Lake using Azure Synapse Link?

Jay Tuck 126 Reputation points
2022-10-18T10:09:54.313+00:00

We have some tables in Dataverse synching data to our Synapse workspace using Azure Synapse Link. However, the synch sometimes takes a while to trigger and bring the data across.

Is there any way to trigger this manually or at least turn up the frequency of it checking itself?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,696 questions
0 comments No comments
{count} votes

Accepted answer
  1. PRADEEPCHEEKATLA-MSFT 85,746 Reputation points Microsoft Employee
    2022-10-19T10:53:45.523+00:00

    Hello @Jay Tuck ,

    Thanks for the question and using MS Q&A platform.

    Adding multiple tables to the Azure Synapse Link profile will impact performance in following scenario:

    Delta sync: After the initial sync of tables are completed, any change in Dataverse for selected tables is added to a common queue in Azure Synapse Link. The queue is processed with a fixed set of parallel listeners. If you add more tables to the queue, Azure Synapse Link will process the messages, but if the number of messages are higher, it will add latency for data to sync to synapse and/or the data lake.

    For more details, refer to Azure Synapse Link for Dataverse FAQ.


0 additional answers

Sort by: Most helpful