Copy Data Lineage Activity is not reported in Purview

Ravineesh 40 Reputation points
2024-07-26T14:58:02.5+00:00

Hi,

Context: I have a data pipeline in ADF. The pipeline contains the following activities

  • A total of 15 number of copy data activity
  • Total 1 number of Data Flow activity
  • The data source for all activities is a common blob storage account.
  • The data sink for all activities is a different but common blob storage account.

The data source and data sink are registered in Purview. Data Factory is also successfully connected with Microsoft Purview. Data Factory managed identity has the Data Curator access at the root collection level in Purview. There is no firewall neither any network issue exists between ADF and Purview.

Problem: Out of all activities only the Data Flow activity Lineage is reported in Purview, whereas the Lineage status for all Copy Data activity shows the error: Status: Timed Out, Failed to report lineage to catalog in 00:02:00.

User's image

Please help me figure out how to fix this issue.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,194 questions
Microsoft Purview
Microsoft Purview
A Microsoft data governance service that helps manage and govern on-premises, multicloud, and software-as-a-service data. Previously known as Azure Purview.
1,065 questions
0 comments No comments
{count} votes