Can we check Duplicates in Purview?

Maria Diana 45 Reputation points


Can we check for duplicates in purview? For example; If the data in SQL Server database and the data in Azure Cosmos DB is same or partially same and I scan these both in purview, How can I find out that the data in both the data sources are same?

Many Thanks,
Maria Diana

Microsoft Purview
Microsoft Purview
A Microsoft data governance service that helps manage and govern on-premises, multicloud, and software-as-a-service data. Previously known as Azure Purview.
753 questions
0 comments No comments
{count} vote

Accepted answer
  1. BhargavaGunnam-MSFT 21,336 Reputation points Microsoft Employee

    Hello Maria Diana,

    Welcome to the Microsoft Q&A forum.

    Unfortunately, Microsoft Purview doesn't have an inbuilt feature to detect duplicate data between two registered data sources(Ex: SQL server and Azure cosmos DB)

    However, there are some workarounds(as discussed in the below document) that you can use to identify duplicate data in your scenario. One approach is to use a data integration tool such as Azure Data Factory to extract data from both data sources and compare them using a data comparison tool. You can then use the results of the comparison to identify any duplicate data.

    I see a similar feedback item requested in the Purview feedback channel. I suggest upvote and comment on this feedback item. All the feedback shared in this forum is actively monitored and reviewed by the engineering team, who will prioritize them accordingly based on the number of requests.

    I hope this helps. Please let me know if you have any further questions.

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful