validate data from 2 sources using ADF

Mohammed Sohail 66 Reputation points

I have 2 files of different format i.e csv,parquet. I need to validate every row present in csv is exactly same as parquet using ADF pipelines

Is there any way to achieve this using ADF or any workaround using other services on Azure with out writing code?

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
281 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
3,791 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
8,439 questions
{count} votes

Accepted answer
  1. MarkKromer-MSFT 5,171 Reputation points Microsoft Employee

    Use the ADF data flow technique of creating row fingerprints via hashing:

    1 person found this answer helpful.

1 additional answer

Sort by: Most helpful
  1. Samy Abdul 3,361 Reputation points