Import JSON with inconsistent structure using ADF

Question

Import JSON with inconsistent structure using ADF

Sam Bera 26

Hi,

I am using ADF data flow to convert a source JSON file into a csv format. The issue with the source file format is that not all the tags are populated all the time. There are a few tags which are fixed, but sometimes one of the tags might be missing. For example, in the complex JSON structure,
"first_touch":{"category":
{"description":"Web Asset",
"lookup_type":"clients_touch__category",
"value":100}
}
the value field might be missing for one of the rows in the files. I some cases one row might have the whole category section missing.

I want to stll populate the data with the other fields and populate blanks/null in the columns that dont exist.

Please let me know if anyone has any suggestions. Thanks in advance!

svijay-MSFT 5,256 Reputation points Microsoft Employee Moderator

2022-01-17T16:11:11.46+00:00

Hello @Sam Bera ,

Thanks for the question and using MS Q&A platform.

Are you encountering the issue even when you explicitly mentioning the schema at the source end ?

1 answer

Your answer

svijay-MSFT 5,256 Reputation points Microsoft Employee Moderator

2022-01-17T16:11:11.46+00:00

Hello @Sam Bera ,

Thanks for the question and using MS Q&A platform.

Are you encountering the issue even when you explicitly mentioning the schema at the source end ?

Answer 1

Sam Bera 26

This issue is resolved now. Just had to manually create a json file with all tags and use that for defining schema for first time.

Share via

Import JSON with inconsistent structure using ADF

1 answer

Your answer