ADF Data Flow Execution Failed

Sathish Kumar Sermadurai 16

Hi Team,

We are facing issue with Data Flow execution for past 3 hours and not able to run any pipelines. Can you please check the issue?

{ "errorCode": "4501", "message": "Failed to fetch execution state: '', please retry. If the problem persists, please contact Azure Support", "failureType": "UserError", "target": "", "details": [] }

Even Data Flow Debug cluster is not starting up and getting error.

Thanks,
Sathish

Anish Sukhathankar 11 Reputation points

2020-06-04T11:48:29.493+00:00

Same for me, it says "Operation on target failed: Failed to fetch execution state: '', please retry. If the problem persists, please contact Azure Support.
Also its shows "Internal server error executing the request."
Cedersved 16 Reputation points

2020-06-04T13:04:10.163+00:00

I have the same issue, tried to run a pipeline with a couple of mapping data flows 6-7 times over the last 4 hours and it failed with this error every time on different data flows.
Sayadi, Akram 1 Reputation point

2020-06-04T13:13:04.103+00:00

I have the some problem :/
Kasper Nielsen 1 Reputation point

2020-06-04T13:32:00.36+00:00

Hello,

Exactly the same problem here.

4 answers

Ivan Donev 11 Reputation points

2020-06-04T11:44:04.98+00:00

I think it has something to do with the current incident Azure is having with ARM template deployment - https://status.azure.com/en-us/status

"Starting at 08:45 UTC on 04 Jun 2020, some customers may experience issues with resource creation for services that depend on the Azure Resource Manager (ARM) platform. We are aware of this issue and are actively investigating. The next update will be provided in 60 minutes, or as events warrant.
This message was last updated at 11:37 UTC on 04 June 2020"
Please sign in to rate this answer.

2 people found this answer helpful.
S H 1 Reputation point

2020-06-04T14:38:52.41+00:00

Yep, this is correct. Still down as of 14:33 UTC 04 June. Follow that link to see the latest status update.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.
Sayadi, Akram 1 Reputation point

2020-06-04T13:13:35.373+00:00

I have the same problem :/
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.
jmfyda 1 Reputation point

2020-06-04T13:41:22.213+00:00

I have the same issue. It only fails on Data Flows.
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.
KranthiPakala-MSFT 46,502 Reputation points Microsoft Employee

2020-06-04T17:25:09.35+00:00

Hi All,

Apologies for the inconvenience caused. This issue is a result of underlying Outage related to Azure Resource Manager (ARM) as called out by @Anonymous . Thank you so much @Anonymous for pitching in and calling out.

Here is the latest update from status page: (Please follow this page for further updates: https://status.azure.com/en-us/status)

Warning: Azure Resource Manager (ARM) - Active

Starting at 08:45 UTC on 04 Jun 2020, a subset of customers may experience issues with resource creation for services that depend on the Azure Resource Manager (ARM) platform.

We have identified a fix for an underlying networking issue, and have deployed this fix to all impacted regions. Customers may see recovery in most regions as we continue to validate mitigation. The next update will be provided in 60 minutes, or as events warrant.
This message was last updated at 16:11 UTC on 04 June 2020
Please sign in to rate this answer.
KranthiPakala-MSFT 46,502 Reputation points Microsoft Employee

2020-06-04T17:50:59.333+00:00

Update:

Hi @all ,

Just received an update from internal team that the issue is now resolved.

Please let us know if you still notice issues.

KranthiPakala-MSFT 46,502 Reputation points Microsoft Employee

2020-06-06T01:42:49.63+00:00

Hi All,

Following up to see if anyone else is still experiencing this issue. If so, please do let us know.

Thanks.

Osust, Ivan 1 Reputation point

2020-06-06T19:40:27.937+00:00

Hello @KranthiPakala-MSFT ,

I`m still occasionally getting the error when running a pipeline with dataflow.

Cedersved 16 Reputation points

2020-06-08T06:05:36.14+00:00

It's been occasionally happening for months. Last time I asked about it I was sent the link to the COVID-19 capacity issues blog post.

KranthiPakala-MSFT 46,502 Reputation points Microsoft Employee

2020-06-08T21:39:29.96+00:00

Hi @Osust, Ivan , @Cedersved ,

Thanks for your response. In few scenarios this error can be avoided by considering retry settings in data flow activity, but If you still notice this issue more often, I would recommend you to file a support request for deeper investigation. In case if you do not have a support plan, please do let me know here.

----------

Thank you

Dan Faustine 1 Reputation point

2020-06-10T16:50:32.903+00:00

Yes, I'm having this problem. I have a pipeline that I'm trying to run about 25 data flows through serially. I can't get through one run of debugging without running into this error. I've verified the validity and execution of all the data flows individually, and they all run to success individually. There are less than 2000 total data rows in all of the datasets combined so it's not an issue of too much data running through the pipe. -D
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

ADF Data Flow Execution Failed

4 answers

Your answer