Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,196 questions
Executing expressions dynamically using code in transformation outputs
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(38.4, 60%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERS%3C/text%3E%3C/svg%3E)
Robson Soares
1
Reputation point
Hi all.
I am testing a data pipeline using ADF (The databricks version works fine).
The idea is to automate the parsing of multiples text files (fixed length) and different schemas.
Using the attached image as example I have substring expressions for each field and the record inline(column C0). How can I replace the column values with the result of each code (substring)?
That image is an output of a pivot transformation. The substring expressions were dynamically created
best
Robson
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 26%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
HimanshuSinha-msft 19,386 Reputation points Microsoft Employee2021-02-22T18:04:20.467+00:00 Hello @Soares-4956 ,
Thanks for the ask and using the Microsoft Q&A platform .
Mine sincere apoloziges for the delayed response of this . We are working internally on this and will update you once we hear back
Thanks
Himanshu -
HimanshuSinha-msft 19,386 Reputation points Microsoft Employee
2021-03-02T21:29:24.257+00:00 Hello @Soares-4956 ,
My apoloziges for the delayed reply on my side . I did reached out to the internal team to get help on this . Can you please share the data flow script and also elaborate the use case in more detaiils please . If you have any supporting data which can be shared will also help .
Thanks
Himanshu -
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(118.4, 17%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
Kiran-MSFT 691 Reputation points Microsoft Employee2021-03-03T00:08:45.257+00:00 @MarkKromer-8019 - Lookup activity with new expr support to pass pipeline parameters into dataflow should solve this.
Sign in to comment