Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
6,650 questions
This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
hello,
see screen-shot below:
Question
using the ADF dataflow, how is it possible to get to the result in green from the data in orange colour ?
Thank you
Hey,
below blog might help:
https://eax360.com/find-duplicate-records-with-azure-data-factory-same-source-file/
Hey,
The above blog is just a base case wherein your key would be UOM column.
You need to follow the below steps:
https://1.bp.blogspot.com/-u_i\_PEiq9tY/X3tIUhaFAeI/AAAAAAAALcM/F2h2DZfQTcsSpSDVDfHGqK9vianaZJlWwCLcBGAsYHQ/s1371/2020-10-05%2B12_16_03-Window.png
stackoverflow.com/questions/66424058/how-do-i-add-a-partitioned-row-number-to-azure-data-factory
2) Use filter transformation to filter out rownbr>1
https://learn.microsoft.com/en-us/azure/data-factory/data-flow-filter