Resolving error StatusCode":"DFExecutorUserError" 1204

Question

I have a dataflow that joins (by unique ID) 2 tables which are big (around 20 million rows each) and then stores them into a new table.
The pipeline just runs the dataflow mentioned and the settings are maxed out (256 cores as it is a lot of data).
But for some reason i get the error mentioned, is there a way to fix this?

Answer 1

Hi @Toni Vukašinović ,

Welcome to Microsoft Q&A Platform. Thank you for posting your query here.

This kind of error will be happen because of capacity issues especially while handling huge data.

You consider below work arounds to avoid this error.

• You can consider splitting your data in to multiple batches and process.
• Increasing cores will also helpful(seems you already tried this).
• Changing your database max size and pricing tiers.

Below are few links where similar issue discussions occurred. Could you please review them once.
https://learn.microsoft.com/en-us/answers/questions/403693/adf-dataflow-failing-with-error-code-dfexecutoruse.html
https://stackoverflow.com/questions/65811303/azure-data-factory-error-dfexecutorusererror-error-code-1204

If you would like to have deeper investigation of your case alone and get the exact root cause, I encourage you to have a support ticket and get deeper level of investigation done. Below link helps you to guide how to create a support ticket.
https://learn.microsoft.com/en-us/azure/azure-portal/supportability/how-to-create-azure-support-request

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators