ADF changes template data

Galih 111 Reputation points
2023-05-17T11:31:16.8266667+00:00

Hi All,

I have the following sample csv data format :
User's image

and want to change the format as following : User's image

is it possible to use adf? any suggest for solution? or we can use data flow to create that format?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,135 questions
{count} votes

1 answer

Sort by: Most helpful
  1. KranthiPakala-MSFT 46,442 Reputation points Microsoft Employee
    2023-06-06T06:10:50.6266667+00:00

    @Galih Thanks for the question.

    This requirement may be very complex to achieve in ADF dataflows, incase even if it is possible, it will be a cumbersome solution. I agree with @Vinodh247 suggestion and would encourage to take different approach using Synapse spark Notebooks or Databricks spark notebooks by writing your own logic.

    If you would like to achieve this in data factory itself, then you may consider using Custom Activity or Azure function activities in which you can execute your own custom logic for transforming your complex data.

    I even had a discussion with internal experts on this requirement and the other recommendations apart from Synaspe/Databricks spark notebooks is to give a try with PowerBI dataflow or Fabric dataflow, as it is not possible in Mapping Dataflow in ADF

    Hope this info helps.

    Thank you


    Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.

    0 comments No comments