Resolving error StatusCode":"DFExecutorUserError" 1204

Toni Vukašinović 21 Reputation points
2021-11-19T13:14:36.673+00:00

I have a dataflow that joins (by unique ID) 2 tables which are big (around 20 million rows each) and then stores them into a new table.
The pipeline just runs the dataflow mentioned and the settings are maxed out (256 cores as it is a lot of data).
But for some reason i get the error mentioned, is there a way to fix this?
150997-screenshot-2021-10-28-182803.png

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
6,305 questions
No comments
{count} votes

Accepted answer
  1. ShaikMaheer-MSFT 28,106 Reputation points Microsoft Employee
    2021-11-22T06:53:27.077+00:00

    Hi @Toni Vukašinović ,

    Welcome to Microsoft Q&A Platform. Thank you for posting your query here.

    This kind of error will be happen because of capacity issues especially while handling huge data.

    You consider below work arounds to avoid this error.

    • You can consider splitting your data in to multiple batches and process.
    • Increasing cores will also helpful(seems you already tried this).
    • Changing your database max size and pricing tiers.

    Below are few links where similar issue discussions occurred. Could you please review them once.
    https://learn.microsoft.com/en-us/answers/questions/403693/adf-dataflow-failing-with-error-code-dfexecutoruse.html
    https://stackoverflow.com/questions/65811303/azure-data-factory-error-dfexecutorusererror-error-code-1204

    If you would like to have deeper investigation of your case alone and get the exact root cause, I encourage you to have a support ticket and get deeper level of investigation done. Below link helps you to guide how to create a support ticket.
    https://learn.microsoft.com/en-us/azure/azure-portal/supportability/how-to-create-azure-support-request

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    No comments

0 additional answers

Sort by: Most helpful