Share via

Azure databricks unity, data lineage without notebooks, Azure purview

Dondapati, Navin 291 Reputation points
2023-02-07T14:11:14.1433333+00:00

Implementations of data lineage with Azure Purview and Databricks Unity (without the use of notebooks) Any videos/github will help.

Instead re reading all notebooks, cant we just hook to existing unity meta store get required details.

Microsoft Security | Microsoft Purview

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Bhargava-MSFT 31,261 Reputation points Microsoft Employee Moderator
    2023-02-10T16:38:47.4466667+00:00

    Hello @Navin Dondapati,

    Welcome to the MS Q&A platform.

    You can use the Azure Purview Data Catalog to connect to your Databricks Unity Metastore and extract the required lineage information. Here you can use the Azure Purview Data Scan feature to scan your Databricks Unity Metastore and extract the lineage information.

    You can also use the Azure Purview Data Flow feature to create a data flow that connects to your Databricks Unity Metastore and extracts the required lineage information.

    Please see the below GitHub purview lineage solutions videos

    https://github.com/microsoft/Purview-ADB-Lineage-Solution-Accelerator#videos

    https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/data-lineage

    I hope this helps. Please let us know if you have any further questions.

    1 person found this answer helpful.

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.