This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(284.8, 42%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESN%3C/text%3E%3C/svg%3E)
Hello,
I currently have a pipeline that takes raw csv files from a blob and loads it into an azure sql DB. Since i have multiple different files, i am using a ForEach loop. The issue here is the datatype. The files being loaded from the blob into the DB are coming over a nvarchar(max) for all fields (even for date, int, float etc). Since its a ForEacch lop and a parameter for file (i.e childitems) , I cannot explicitly mention the mapping for each fields. Is there a way to overcome this or do i have to have a sperate flow for each file and mention the datatype for each fields.
Cheers.
An Azure service for ingesting, preparing, and transforming data at scale.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 26%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EH%3C/text%3E%3C/svg%3E)
Hello @sam nick ,
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, will respond back with the more details and we will try to help .
Thanks
Himanshu
@HimanshuSinha - But how to incorporate any specific field logic i.e if a specific field in the source file has a value that needs to be updated.
ex: if a field has 123-344-5567 then, the destination field into the DB should be 1233445567
Hi @sam nick , if you want to do data manipulation, you can go with DataFlow. It's not necessary to create different flows for different kind of files, you can have a single DataFlow with multiple SINK in it. Hope this helps. Thanks.
Hello @sam nick ,
We haven’t heard from you on the last response from @Nasreen Akter and was just checking back to see if you have a resolution yet .In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, will respond back with the more details and we will try to help .
Thanks
Himanshu
Hello @sam nick ,
Thanks for the ask and using the Microsoft Q&A platform .
I think you are using this pipeline to copy different CSV with varied schema ,, if thats the case , I think your approach is correct . Since you are copying the data to SQL , you can add one stored proc activity and copy the data from the current table to a table with correct data type .
Please do let me know how it goes .
Thanks
Himanshu
Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members