This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(316.8, 13%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVS%3C/text%3E%3C/svg%3E)
Hi,
I need to implement an ETL using Azure Data Factory. Can someone help me out here?
Use Case:
I have completed the first 2 steps. Stuck in 3rd part.
Can someone help me out on how to create a CSV file after the transformation? Or I welcome if anyone has a better approach to this.
Thanks in advance.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(118.4, 17%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
ETL is best implemented using dataflow for scale and performance and use pipeline for orchestration.
@Kiran-MSFT I'm new to the Data factory and Data flows. Can you explain me how can I call my web service from inside Data flow for each row of data and then accumulate them back into a CSV file ?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 26%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
@Vigneshwar S B : Since you have already achieved #1 & #2 , I think you can write the response from the WS to a new csv file and then use mapping data flow . In the mapping data flow you can join these two stream . ( assming that you atleast have one column which you can use in a join)
Thanks
Himanshu
@HimanshuSinha-msft Web service call is being from inside a ForEach loop. I don't see any way to write the response from my WS into a CSV file.
I need to write each transformed row(which I get back as a response from WS) into CSV file. How can I do that ?
Hello @Vigneshwar S B ,
Thanks for the patience , unfortunately we are not getting the kind of response from the team here . if you have a support plan you may file a support ticket, else could you please send an email to azcommunity@microsoft.com with the below details, so that we can create a one-time-free support ticket for you to work closely on this matter.
Subscription ID:
Subject : Attn Himanshu
Please let me know once you have done the same.
Thanks
Himanshu
Hello @Vigneshwar S B , ,
We haven’t received any email from you as requested in the last response and was just checking back to see if you have a resolution.In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, please respond back with the more details as requested and we will try to help .
Thanks
Himanshu