Executing expressions dynamically using code in transformation outputs

Robson Soares 1 Reputation point
2021-02-17T16:26:13.537+00:00

69182-image.png

Hi all.

I am testing a data pipeline using ADF (The databricks version works fine).

The idea is to automate the parsing of multiples text files (fixed length) and different schemas.

Using the attached image as example I have substring expressions for each field and the record inline(column C0). How can I replace the column values with the result of each code (substring)?
That image is an output of a pivot transformation. The substring expressions were dynamically created

best

Robson

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,863 questions
{count} votes