Are there plans to enhance Unity Catalog scans and lineage capture in Microsoft Purview (Data Governance)?

Hi Piotr Tybulewicz
Thank you for your question.

Microsoft is actively working to enhance Azure Databricks Unity Catalog integration within Microsoft Purview (Data Governance). However, as of now, the new Purview experience does not yet support fully granular (scoped) scans or comprehensive lineage capture for all Unity Catalog activities beyond Databricks notebooks.

Planned Enhancements (2025)

• The Microsoft Purview roadmap includes plans for scoped and incremental Unity Catalog scans within the Unified Catalog, allowing more control over what assets are scanned. This feature is in development, but no general availability (GA) date has been announced yet.
• For expanded lineage capture, Microsoft is developing support for additional sources - such as SQL queries, jobs, and pipelines, to extend beyond notebook-level lineage. Early previews are expected later in 2025, though timelines remain TBD.
• Existing functionality supports lineage from Databricks notebooks, and incremental updates are improving column-level and process-level lineage tracking within the Unified Catalog.
• You can monitor progress and upcoming feature announcements in the Microsoft Purview Roadmap and What’s New pages.

In the meantime, for more detailed lineage or scan coverage, you can supplement Purview’s capabilities using Unity Catalog system tables or Databricks lineage APIs and automate metadata integration via Azure Functions or Logic Apps.

You can monitor updates and release timelines here:

• Microsoft Purview roadmap
• Microsoft Purview Unified Catalog overview
• Microsoft Purview Feedback Portal

Hope this helps. Do let us know if you any further queries.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.