Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,196 questions
Clarification on Adding a New Column ("City") to CSV file Extracted via API in Azure Data Factory
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(153.6, 99%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPS%3C/text%3E%3C/svg%3E)
Piethagor Solutions
0
Reputation points
I am currently working on utilizing an API to extract data in CSV format through Azure Data Factory (ADF). I have encountered a requirement to include an additional column named "City" in the output file, even though this column is not present in the API data.
To address this, I am seeking guidance on two aspects:
Source Setting in Azure Data Factory: I would appreciate clarification on how to configure the source settings in Azure Data Factory to incorporate the new column "City" during the data extraction process. Specifically, I am interested in understanding any parameters or configurations necessary to achieve this seamlessly.
- Mapping the New Column in Data Flow: Once the data is extracted, I need to map the newly added "City" column within the Azure Data Factory . Could you please provide insights on how to appropriately map this new column, ensuring it aligns with the rest of the data structure?
or
could you guide me on how to add a new column(city) to an existing CSV file in the blob storage using ADF
{count} votes
-
Vinodh247 13,801 Reputation points2024-02-11T09:12:08.0833333+00:00 You can use derived column transformation in adf mapping data flows.
- In the Derived Column transformation, you can generate a new column by specifying its name in the Column textbox.
- To build the expression for the derived column, click on the Enter expression textbox. You can either start typing your expression or use the expression builder to construct your logic.
- Click on Add above the column list to add more derived columns. did you try this ?
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(54.400000000000006, 12%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESB%3C/text%3E%3C/svg%3E)
Suba Balaji 11,206 Reputation points2024-02-11T09:30:22.22+00:00 @Piethagor Solutions Hi, what will be the value of the new additional column - city?
-
Piethagor Solutions 0 Reputation points
2024-02-11T10:28:10.24+00:00 i need to add name of the city in the new column
so each file will be having same city name -
Suba Balaji 11,206 Reputation points
2024-02-12T12:12:20.18+00:00 Ok, what I understand is, your source is a REST API, and you want to have additional column called City and want to pass value to this additional column dynamically through Params\variable. You can use copy activity and add additional column under source tab, and pass dynamic content as value. Dynamic value can come from a variable or parameter or system variables and functions. Does this make sense to you? Please revert if my understanding is not completely right. HTH.
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(86.4, 36%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBM%3C/text%3E%3C/svg%3E)
Bhargava-MSFT 29,266 Reputation points Microsoft Employee2024-02-22T20:40:49.99+00:00 Thank you Suba Balaji and Vinodh247 Hello Piethagor Solutions, I am checking to see if you had a chance to look into the above response.
Sign in to comment