how to join in Exists via dynamic keyColumns

arkiboys 9,706 Reputation points
2021-10-11T15:20:56.63+00:00

The data flow is dynamically loading data...
The keyColumn is passed as a variable. In this case it is the DepartmentID
SinkDelta has a KeyColumn
Parquet Source has a KeyColumn
In the exist, how can I join the two sources via their KeyColumn? Is what I am doing in the screenshot wrong?
The valiation gives the error: data flow has error
see screenshots below. Thank you

139514-image.png
139543-image.png
139350-image.png

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
0 comments No comments
{count} votes

Answer accepted by question author
  1. ShaikMaheer-MSFT 38,631 Reputation points Microsoft Employee Moderator
    2021-10-12T06:37:13.767+00:00

    Hi @arkiboys ,

    Thank you for posting query in Microsoft Q&A Platform.

    Since your parameter is going to hold your Key Column Name, You can just pass your parameter as expression Exists Condition.

    Please check simple example where I am storing my Key Column name(hashFullName) in to my parameter called "dfpKeyColumn" and passing that parameter as expression inside Exists Condition.

    Please Note, In my example Key column name in both left and right stream is same. Hence I am having only one single parameter to hold it. If your left and right stream key column names different then consider having two parameters to hold those two key column name.

    Left & right Stream:
    139733-image.png

    Exists Transformation:
    139752-image.png

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.