ADF - Unexpected failure during execution.

Question

ADF - Unexpected failure during execution.

Hugo Becerra 1

Hi,

I'm receiving very often this error when I'm running a pipeline with several dataflows executions: Unexpected failure during execution. Please try restarting debug session. If problem persists, contact customer support. Error code: 4510.

It's not always in the same pipeline and it's not always happening. It happened with a Debug session active and without it. In the data flow status I only can see that is always in "AquiringCompute".

Thanks!

Saurabh Sharma 23,866 Reputation points Microsoft Employee Moderator

2020-11-25T01:34:57.38+00:00

@Hugo Becerra Thanks for your using Microsoft Q&A. We also need more information to understand the cause of this error and so, could you please help providing more details like in which region your pipelines are so that I can check internally of any issues in those regions if any ? Also, how much data your pipelines are trying to move or transform? Is this still happening for you ?
Saurabh Sharma 23,866 Reputation points Microsoft Employee Moderator

2020-12-01T12:23:27.513+00:00

@Hugo Becerra Checking in if you are still facing issues with your pipelines ? If yes, could please share the details asked earlier. Thanks.
Hugo Becerra 1 Reputation point

2020-12-01T13:35:03.157+00:00

Yes, still I have the same issues. This happened sometimes, not always as I said. My pipelines are deployed in the North Europe region. It's not a lot of data, we are talking of CSV files less than 1 Mb most of the times. It doesn't seem like an issue with the data and it's pretty random. Sometimes the same dataflow is executed in 30 seconds and some other times is throwing this error.
Thanks.
Saurabh Sharma 23,866 Reputation points Microsoft Employee Moderator

2020-12-01T22:24:19.083+00:00

@Hugo Becerra yes, it is weird to have issues with such small files. I suggest you to please open an Azure Support ticket so that an engineer can look into your environment and pipelines. Please let me know if you have any trouble opening a support ticket and I will help you creating a one-time free support ticket.
Hugo Becerra 1 Reputation point

2020-12-02T09:00:26.907+00:00

Is it normal when I'm running a pipeline that everytime that I have an activity with an execution of a data flow is taking a few minutes with "Acquiringcompute" status? I have configured a TTL of 10 minutes in my integration runtime.
Saurabh Sharma 23,866 Reputation points Microsoft Employee Moderator

2020-12-07T19:57:56.793+00:00

@Hugo Becerra Yes, it is normal to have an acquire compute status however it should not be taking more time to start the execution. That's why it requires investigation through a support ticket. Please let me know if you need any help with it.