Not able to flatten big json file (almost 452 mb size) in adf. The file is having multiple json objects

Amar Agnihotri 921

Hi,
I have created a big json file after combining many json responses from the API. Now the final file is almost 452 mbs in size and it is containing nested arrays. I tried using mapping dataflows but still not able to flatten it. can anyone help me out in this. I want to upload that file here for better understanding but can't upload due to size restriction.

HimanshuSinha-msft 19,476 Reputation points Microsoft Employee

2022-11-16T23:27:51.743+00:00

Hello @Amar Agnihotri ,
Thanks for the question and using MS Q&A platform.
As I understand the ask , are you confident that the size of the JSON file is playing a big role here or its the compleixity . Do think we can have access to the JSON so that we can have a look at the data ?
We will wait to hear from you . .
Thanks
Himanshu
Amar Agnihotri 921 Reputation points

2022-11-22T12:53:57.533+00:00

@HimanshuSinha-msft
thanks for the reply. I have raised the ticket in MS support
HimanshuSinha-msft 19,476 Reputation points Microsoft Employee

2023-01-12T20:58:27.56+00:00

Hello @Amar Agnihotri ,

Can you please share the SR # ?

Thanks
Himanshu

Share via

Not able to flatten big json file (almost 452 mb size) in adf. The file is having multiple json objects

Your answer