Assert Transformation in Mapping data Flows in ADF using Parameter

Mallikarjun appani 6 Reputation points Microsoft Employee
2022-03-01T07:38:52.383+00:00

I am using assert transformation task for duplicate check and using Assert Type as "Expect Unique" .In Expression am using the parameter and passing parameter value through Pipeline Expression. All the Values in the file are showing Duplicates. But when i manually mentioned the Value instead of parameter its working as expected and showing only duplicates as errors.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,956 questions
{count} vote

1 answer

Sort by: Most helpful
  1. ShaikMaheer-MSFT 38,466 Reputation points Microsoft Employee
    2022-03-03T16:24:25.803+00:00

    Hi @Mallikarjun appani ,

    Thank you for posting query in Microsoft Q&A Platform.

    As per my understanding, you are using Assert Transformation to check duplicates and using Assert Types "Except Unique". For this Assert type when you are using column name directly then you see results good then when you pass column name from parameter then you see incorrect results. Please correct me if my understanding is wrong.

    I am able to reproduce your scenario.

    When you used parameter then you need to make sure using byName() function to treat value inside that parameter as column name.

    Please check below screenshots and details for better idea.
    179717-image.png

    Hope this helps. Please let us know if any further queries. Thank you.

    ----------

    Please consider hitting Accept Answer. Accepted answers helps community as well.


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.