Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Json file to CSV file in Copy activity
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(291.2, 18%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EB1%3C/text%3E%3C/svg%3E)
Bhaskar-1984
1
Reputation point
Hi,
I am trying to convert json file into csv file(Size of Json file 1GB).The problem here is it is running long time will say more than 40 hours and even it is showing still processing status.Can any one help what would be possible reason.I am able to convert other json files into CSV.One file creating problem in my copy activity.
Thanks,
Bhaskar.Ch
Azure Data Factory
{count} votes
-
AnnuKumari-MSFT 34,566 Reputation points Microsoft Employee Moderator2022-09-13T04:43:43.023+00:00 Hi @BhaskarChirumamilla-4014 ,
Welcome to Microsoft Q&A platform and thanks for posting your question here.
As I understand your issue, you are trying to convert JSON file into .csv file ,however, it is taking very long time and is not getting processed. Could you please help me with more details about Copy data configuration what you have kept and also, if possible, could you please share the .json file as an attachment in order to reproduce your issue. Looking forward to your response. Thanks .
-
Bhaskar-1984 1 Reputation point
2022-09-13T12:03:44.923+00:00 Sure.Thank you for your quick response.I can't attach file because the file size is more than 1 GB.will attach json configuration in source and sink side
-
AnnuKumari-MSFT 34,566 Reputation points Microsoft Employee Moderator
2022-09-16T06:07:18.653+00:00 Hi @Bhaskar-1984 ,
Thankyou for sharing the screenshots , however, it doesn't contain settings tab screenshot. Kindly try increasing DIUs upto 256 and see if it helps. You can also consider using Self hosted IR , instead of Azure IR to improve the performance. Kindly check this document on how to improve Copy activity performanceHope this will help. Please let us know if any further queries.
------------------------------
- Please don't forget to click on
or upvote 
button whenever the information provided helps you.
Original posters help the community find answers faster by identifying the correct answer. Here is how - Want a reminder to come back and check responses? Here is how to subscribe to a notification
- If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
- Please don't forget to click on
-
Bhaskar-1984 1 Reputation point
2022-09-16T15:51:07.623+00:00 Max DIU is available in systems is 32 and i am using max DIU .Here is the setting screen shot for your ref. Still we are facing same issue with the json file and copying data not completing.
-
Bhaskar-1984 1 Reputation point
2022-09-27T16:44:40.473+00:00 I have shared my response but i didn't hear back any thing. Still facing the same issue. Pipeline taking long time to copy the json file into data lake storage account.even pipeline activity is not completing after 12 hours also.
-
AnnuKumari-MSFT 34,566 Reputation points Microsoft Employee Moderator
2022-10-07T08:16:42.893+00:00 Hi @ Bhaskar-1984 ,
Apologies for delay in response. As we can't reproduce your issue since it's not possible for you to share the .json file here. I would request you to create a support ticket with Microsoft so that your issue can be deeply investigated with the help of support engineers . Here is how to create a support ticket with Microsoft. In case if you don't have a support plan, do let us know here so that we can check on other options to unblock you.
Sign in to comment
Sign in to answer