ADF Data Flows reads only 1 record from Json file instead of all

Krishnamohan Nadimpalli 406

Hi I have data in following Json format. I am using ADF Data flow to convert this into csv file. User's image

I created JSON dataset to read this file and the following is the projection created User's image

Following are the JSON Settings in Source Options User's image

Now when I preview the dataset , I get only one row instead of multiple rows. Ideally it has more than 10k rows in Json. I tried with Array of Documents in Source options but not working. User's image

Following is the python implementation which is working fine. Json data is available in "data" and able to parse data into "df1" User's image

What changes I need to make to show full data or 1000 rows of data in data preview?

AnnuKumari-MSFT 33,721 Reputation points Microsoft Employee

2023-04-20T16:51:11.52+00:00

Krishnamohan Nadimpalli , Thankyou for using Microsoft Q&A platform and thanks for posting your question here. As I understand your issue, you are able to see only the first json in data preview of source transformation of mapping data flow. Please let me know if the understanding is not correct. Instead of 'Single document' , kindly try 'Array of document' and see if it works. If it doesn't , then kindly share the whole json content as an attachment in .txt format so that I can repro your scenario. Thankyou
AnnuKumari-MSFT 33,721 Reputation points Microsoft Employee

2023-04-24T06:34:50.1366667+00:00

Krishnamohan Nadimpalli , Kindly let us know if the above suggestion was helpful? Is the issue resolved for you following any other approach. If so, kindly share the approach with the community. Thankyou
Anonymous

2023-10-09T18:20:50.1333333+00:00

Did this issue resolve? I am facing the same problem. Thanks in advance!

Share via

ADF Data Flows reads only 1 record from Json file instead of all

Your answer