I can't discover/scan assets in Unity Catalog within purview.

Question

I can't discover/scan assets in Unity Catalog within purview.

Usman Khan 0

I have tables in unity catalog and used Managed Identity and Access token to scan the unity catalog but the it just comes empty. I have attached the image as well. I have given all the relevant access to my account and to the purview managed identity. But I'm unable to solve the problem.

Smaran Thoomu 24,575 Reputation points Microsoft External Staff Moderator

2025-03-26T12:30:10.0566667+00:00
Hi @Usman Khan

It sounds like the scan is not retrieving assets from Unity Catalog despite using Managed Identity and an access token. Here are a few things to check:

Permissions: Ensure that both your user account and the Microsoft Purview managed identity have the necessary Unity Catalog permissions (USE CATALOG, SELECT on tables, and USE SCHEMA if applicable).

Scan Configuration: When setting up the scan, confirm that you've selected Unity Catalog as the extraction method and properly defined the scan scope (Catalogs, Schemas, and Tables).

Databricks Unity Catalog Connector: Ensure that you are using the correct connector for Databricks Unity Catalog in Purview. The latest version may have fixes or improvements.

Token Expiry and Authentication Issues: If using an access token, verify that it is still valid and has the right scope for accessing Unity Catalog. If using Managed Identity, confirm that Databricks is configured to trust the Managed Identity.

Purview Scan Logs: Check the scan logs in Microsoft Purview for any warnings or errors that might provide more insight into the failure.

If the issue persists, could you share more details such as error messages or specific access configurations you've set?
I hope this information helps. Please do let us know if you have any further queries.

Kindly consider upvoting the comment if the information provided is helpful. This can assist other community members in resolving similar issues.
Usman Khan 0 Reputation points

2025-03-26T13:24:23.7466667+00:00

I have done everything and checked the results using the access token and managed identity but nothing changed.

I have added all the screenshots so that it can help you in troubleshooting.
Dileep Raj Narayan Thumula 330 Reputation points Microsoft External Staff Moderator

2025-03-28T12:13:33.42+00:00

@Usman Khan As Prerequisite Azure Databricks workspace with Unity Catalog enabled and linked to the target metastore.

Need user account with the metastore admin role.

Managing privileges in Unity Catalog

Unity Catalog privileges and securable objects

To perform classification, the user must also have the SELECT privilege on tables/views to access sample data.

Step 1 Create a SQL Warehouse in Databricks.

Step 2 Generate a Personal Access Token [PAT]

Step 3 Register the PAT token in Azure Key Vault as a Secret.

Step 4 Enable access schema from the system schemas for Lineage on your Databricks workspace

Step 5 Register Databricks as a Source in Purview

Step 6 Create a Scan to fetch the metadata from Unity Catalog and hydrate Purview.

Step 7 Search the Data Catalog for Databricks assets

Reference: Unlocking Unified Data Governance with Microsoft Purview and Databricks Unity Catalog

Disclaimer: This response contains a reference to a third-party World Wide Web site. Microsoft is providing this information as a convenience to you. Microsoft does not control these sites and has not tested any software or information found on these sites; therefore, Microsoft cannot make any representations regarding the quality, safety, or suitability of any software or information found there. There are inherent dangers in the use of any software found on the Internet, and Microsoft cautions you to make sure that you completely understand the risk before retrieving any software from the Internet.
Anonymous

2025-04-01T04:06:41.8933333+00:00

@Usman Khan, we haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Anonymous

2025-04-02T04:28:35.3266667+00:00

@Usman Khan, we haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

Your answer

Smaran Thoomu 24,575 Reputation points Microsoft External Staff Moderator

2025-03-26T12:30:10.0566667+00:00

Hi @Usman Khan

It sounds like the scan is not retrieving assets from Unity Catalog despite using Managed Identity and an access token. Here are a few things to check:

Permissions: Ensure that both your user account and the Microsoft Purview managed identity have the necessary Unity Catalog permissions (USE CATALOG, SELECT on tables, and USE SCHEMA if applicable).

Scan Configuration: When setting up the scan, confirm that you've selected Unity Catalog as the extraction method and properly defined the scan scope (Catalogs, Schemas, and Tables).

Databricks Unity Catalog Connector: Ensure that you are using the correct connector for Databricks Unity Catalog in Purview. The latest version may have fixes or improvements.

Token Expiry and Authentication Issues: If using an access token, verify that it is still valid and has the right scope for accessing Unity Catalog. If using Managed Identity, confirm that Databricks is configured to trust the Managed Identity.

Purview Scan Logs: Check the scan logs in Microsoft Purview for any warnings or errors that might provide more insight into the failure.

If the issue persists, could you share more details such as error messages or specific access configurations you've set?
I hope this information helps. Please do let us know if you have any further queries.

Kindly consider upvoting the comment if the information provided is helpful. This can assist other community members in resolving similar issues.
Usman Khan 0 Reputation points

2025-03-26T13:24:23.7466667+00:00

I have done everything and checked the results using the access token and managed identity but nothing changed.

I have added all the screenshots so that it can help you in troubleshooting.
Dileep Raj Narayan Thumula 330 Reputation points Microsoft External Staff Moderator

2025-03-28T12:13:33.42+00:00

@Usman Khan As Prerequisite Azure Databricks workspace with Unity Catalog enabled and linked to the target metastore.

Need user account with the metastore admin role.

Managing privileges in Unity Catalog

Unity Catalog privileges and securable objects

To perform classification, the user must also have the SELECT privilege on tables/views to access sample data.

Step 1 Create a SQL Warehouse in Databricks.

Step 2 Generate a Personal Access Token [PAT]

Step 3 Register the PAT token in Azure Key Vault as a Secret.

Step 4 Enable access schema from the system schemas for Lineage on your Databricks workspace

Step 5 Register Databricks as a Source in Purview

Step 6 Create a Scan to fetch the metadata from Unity Catalog and hydrate Purview.

Step 7 Search the Data Catalog for Databricks assets

Reference: Unlocking Unified Data Governance with Microsoft Purview and Databricks Unity Catalog

Disclaimer: This response contains a reference to a third-party World Wide Web site. Microsoft is providing this information as a convenience to you. Microsoft does not control these sites and has not tested any software or information found on these sites; therefore, Microsoft cannot make any representations regarding the quality, safety, or suitability of any software or information found there. There are inherent dangers in the use of any software found on the Internet, and Microsoft cautions you to make sure that you completely understand the risk before retrieving any software from the Internet.
Anonymous

2025-04-01T04:06:41.8933333+00:00

@Usman Khan, we haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Anonymous

2025-04-02T04:28:35.3266667+00:00

@Usman Khan, we haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

Share via

I can't discover/scan assets in Unity Catalog within purview.

Your answer