Share via

pipeline fails because of file lock out

SethuRam 66 Reputation points
2022-04-14T00:06:52.603+00:00

Hi , We have Azure Synapse Link for Dataverse to get realtime changes from CRM dynamics 365, all the data from dataverse is linked to Azure Synapse Analytics and/or Azure Data Lake Storage Gen2. We have a data factory pipeline which is sourcing the data from synapse dataverse database ( which is accessing the files from data lake on the background), when data factory pipeline is accessing some of the objects/tables from synapse dataverse , the pipeline is failing because of the lock timeout issues , as realtime replication is happening from crm dynamics 355 to synapse link dataverse objects .

Is there a way we can stop the adf pipeline from failing whenever the corresponding dataverse files are locked by crm dynamics 365 ?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,697 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,196 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. KranthiPakala-MSFT 46,442 Reputation points Microsoft Employee
    2022-04-28T00:15:55.33+00:00

    Hello @SethuRam ,
    As per the confirmation from product team, this is a known issue from the product side and product is actively working on a feature wherein we will provide read-only snapshots, every hour to create a read isolation and prevent locks issue.

    I would recommend you to please subscribe to Azure updates page for latest info regarding Azure product releases.

    Thank you