ADF merge and adding new columns

Prakash14 126 Reputation points
2022-10-02T06:47:17.503+00:00

Using ADF Dataflow to merge two different schema files and then adding new column.

Source1 - column1, column2
source2- column1, column2, column3

Derived column - column4 which is common for source1 and Source2 but will have distinct value for source1 and source2

Source 1 > Derived column > union transformation (source1 and source2) > Sink
Source2 > Derived column >

column4 which is derived after source1 and source2 is getting added in the middle of schema merge. Want to move them to the end (after the schema merge). Cant move after union task.

Note : there is no import schema or projection is enabled as dataflow is common for multiple files with different structures.

Is there option to order them as per need ( move derived column values at the end during merge or before) ?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,623 questions
{count} votes

1 answer

Sort by: Most helpful
  1. HimanshuSinha-msft 19,486 Reputation points Microsoft Employee Moderator
    2022-10-03T19:14:00.41+00:00

    Hello @Prakash14 ,
    Thanks for the question and using MS Q&A platform.
    As we understand the ask here is how to move the columns from the INION activity to different position , please do let us know if its not accurate.
    I think you can use a SELECT activity and that should help to acheive what you are looking for . The below gif should give quick implmenation of what I am trying to achieve .

    247060-select.gif

    Please do let me if you have any queries.
    Thanks
    Himanshu


    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
      • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    1 person found this answer helpful.
    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.