Data flow on ADF that takes showed json file and flattens then to showed format

Question

Hi,

Struggling with flattening a json-stat file. I think the data flow on ADF will use several "flatten" steps to do what I need. Since I can not figure it out by my self I hope you can help med.

PLease check the following json-file:

How can I transform this json file to a table in parquet/csv that will look like this:

or in pivot format like this :

thanks for your help.

Answer 1

Hi @Nuno Trigo ,

Thank you for posting query in Microsoft Q&A Platform,

Flatten transformation helps to flatten array items in to multiple rows. So in your case you can try to unroll on arrray type keys.

Please check below video to understand about flatten transformation.
Flatten Transformation in Mapping Data Flow in Azure Data Factory

In your case, from above screenshots I see schema or structure is different it's not identical. In such cases, we may experience unexpected results. Kindly make sure schema is same across all json objects. Also try to unroll array items and see if that helps. Please feel free to share your implementation details if you struck at any place along with screenshots. So that It would be easy to understand where exactly the issue is and help better.

Please let me know how it goes.