Issue in Microsoft Purview data quality with MS fabric

Question

Facing the Issue in Microsoft Purview data quality with MS fabric

Not able to do data profiling and data quality in purview, need some help to resolve the Data source is Fabric

and also not getting Access policies in the newly created Key Vault and secrets are also not showing/saving

Answer 1

@Mallikharjuna Rao Koppolu

It sounds like you're having a tough time with Microsoft Purview and Microsoft Fabric, especially around data quality and access policies in your Key Vault. Let's tackle your issues one at a time.

Data Profiling and Quality in Purview:

• Make sure that your Lakehouse tables are discoverable in the Data Map with the correct schema.
• Verify that you're using a Service Principal Name (SPN) for the Data Map scan and Managed Service Identity (MSI) for the Data Quality (DQ) scan.
• Check if you've configured the DQ connection correctly with MSI.
• Ensure that the Purview MSI has contributor access to your Fabric workspace.
• If applicable, enable the OneLake setting which allows users to access data stored in OneLake with apps external to Fabric.
• It might be helpful to follow the troubleshooting guide for data quality for more detailed steps.

Access Policies in Key Vault:

• For the Key Vault issues, ensure you've correctly set up the Key Vault access policies. If secrets aren't showing, it could be due to insufficient permissions or incorrect settings.
• Make sure the identity you're using has the necessary access granted in the Key Vault settings.
• You can refer to Key Vault documentation for further assistance on setting up access policies.

To better help you, could you provide a bit more detail?

• Are you seeing any specific error messages when you attempt to do data profiling or access the Key Vault?
• Do you have the necessary permissions set up in both Microsoft Purview and the Key Vault?
• Can you confirm if the integration between Purview and Fabric is set up correctly in your tenant?

Answer 2

For getting data quality to work, head over to the Fabric Admin portal. Search for metadata. Two settings need to be enabled: ‘

• Enhance admin APIs responses with detailed metadata
• Enhance admin APIs responses with DAX and mashup expressions

Please be aware that it may take approximately 15 minutes for these configuration sessions to be processed. -Default Power BI semantic models in Microsoft Fabric

Note: Purview Data Map Fabric scan connector doesn’t directly access the Lakehouse tables. Instead, it utilizes the Semantic models for populating metadata in the data map catalog

1. Setup Microsoft Fabric scanning - choose the Data Map from your Microsoft Purview overview and then selecting ‘Register’. From the options, choose ‘Fabric’ as your data source.
2. Create and publish a data product - select the DataCatalog, followed by Data management and then Business domains. After selecting a business domain, select the ‘Go to data products’ link under Business concepts. A new data product can be created and published at this point. Once you’ve completed the initial steps, click on the “+ Add data assets” button. Then, search for the data assets related to Microsoft Fabric. So, these are the Lakehouses with their semantic models.
3. Setup Data Quality - For profiling data, a data source connection to Microsoft Fabric needs to be set up. This can be done from the Microsoft Purview Data Catalog by selecting the Data Management menu and Data quality submenu. After selecting a business domain, choose the ‘Manage’ button and select ‘Connections’ from the menu to open the connections page. A new connection for the data products and data assets of your business domain can be created by selecting the ‘New’ tab and choosing ‘Microsoft Fabric’ as the Source type. The connection setup can then be completed by submitting the connection configuration