Data Factory - Internal Server Error

Question

Data Factory - Internal Server Error

KishoreKumar Kalla 1

Hi ,

We are encountering "Internal Server Error" on Azure data factory jobs frequently when we are running the jobs both with debug and trigger mode.

I have tested with Git and without Git but it is still the same.If we rerun the jobs they are successful.
Any help on the same is highly appreciated.

Regards,
Kishore K

Vaibhav Chaudhari 38,921 Reputation points Volunteer Moderator

2020-08-05T11:43:47.523+00:00

What is the source and target of the copy? How much is the data volume?
HarithaMaddi-MSFT 10,146 Reputation points

2020-08-05T12:08:51.78+00:00

Hi anonymous userKumarKalla-4971,

In order to investigate further, please share Azure region of source and target of copy and couple of Pipeline Run IDs that failed with this issue.
KranthiPakala-MSFT 46,642 Reputation points Microsoft Employee Moderator

2020-08-05T14:34:03.16+00:00
Hi anonymous userKumarKalla-4971,

Sorry for your experience. Could you please confirm if you are still experiencing the issue? If the issue still persists, would you please share below details for deeper investigation.

Data Factory region?

Failed pipeline run ID?

Failed activity run ID?

Please do share above requested details to better assist on this issue.

Thank you.
KishoreKumar Kalla 1 Reputation point

2020-08-06T14:57:05.86+00:00

Hi ,

Thanks for the response,both the source and target are on Azure SQL only and on the same database.

Regards,
KK
KishoreKumar Kalla 1 Reputation point

2020-08-06T16:39:04.617+00:00

Hi ,

Below given are the details :

Data Factory region : UK South

Failed pipeline run ID: d5f1542e-1632-4c97-b414-31de208a269f

Failed activity run ID:7cc781d5-d2f1-4551-b808-ba1cd802e21d

Regards,
KK
KishoreKumar Kalla 1 Reputation point

2020-08-06T16:39:31.387+00:00

Data Factory region : UK South

Failed pipeline run ID: d5f1542e-1632-4c97-b414-31de208a269f

Failed activity run ID:7cc781d5-d2f1-4551-b808-ba1cd802e21d
KishoreKumar Kalla 1 Reputation point

2020-08-06T17:47:49.817+00:00

Below are the latest RUN ID's

Data Factory region : UK South

Failed pipeline run ID: d3ac1502-c431-4f6e-a82e-f7f54a51fced

Failed activity run ID: 67b3c178-7ace-493c-9496-5da3b51ae940
Failed activity run ID: bcf9a358-e5de-4833-b6cc-2fb06c687611
Failed activity run ID: 284d34cc-585c-4cb7-9de6-9d13c855e8d3
Failed activity run ID: e55448a3-260c-4cbe-b310-a142ed3358d7

Regards,
KK
KishoreKumar Kalla 1 Reputation point

2020-08-06T17:48:03.68+00:00

Below are the latest RUN ID's

Data Factory region : UK South

Failed pipeline run ID: d3ac1502-c431-4f6e-a82e-f7f54a51fced

Failed activity run ID: 67b3c178-7ace-493c-9496-5da3b51ae940
Failed activity run ID: bcf9a358-e5de-4833-b6cc-2fb06c687611
Failed activity run ID: 284d34cc-585c-4cb7-9de6-9d13c855e8d3
Failed activity run ID: e55448a3-260c-4cbe-b310-a142ed3358d7

Regards,
KK
KranthiPakala-MSFT 46,642 Reputation points Microsoft Employee Moderator

2020-08-08T00:38:04.767+00:00

Hi anonymous userKumarKalla-4971,

Thank you for your response and additional details. I'm working with internal team to analyse the root cause. Will keep you posted as soon we have an update regarding the same.

Thank you for your patience.
KishoreKumar Kalla 1 Reputation point

2020-08-10T09:33:39.04+00:00

Hi @KranthiPakala-MSFT ,

Thanks for the same,i shall wait for your update.

Regards,
Kishore

1 answer

Your answer

Vaibhav Chaudhari 38,921 Reputation points Volunteer Moderator

2020-08-05T11:43:47.523+00:00

What is the source and target of the copy? How much is the data volume?
HarithaMaddi-MSFT 10,146 Reputation points

2020-08-05T12:08:51.78+00:00

Hi anonymous userKumarKalla-4971,

In order to investigate further, please share Azure region of source and target of copy and couple of Pipeline Run IDs that failed with this issue.
KranthiPakala-MSFT 46,642 Reputation points Microsoft Employee Moderator

2020-08-05T14:34:03.16+00:00

Hi anonymous userKumarKalla-4971,

Sorry for your experience. Could you please confirm if you are still experiencing the issue? If the issue still persists, would you please share below details for deeper investigation.

Data Factory region?

Failed pipeline run ID?

Failed activity run ID?

Please do share above requested details to better assist on this issue.

Thank you.
KishoreKumar Kalla 1 Reputation point

2020-08-06T14:57:05.86+00:00

Hi ,

Thanks for the response,both the source and target are on Azure SQL only and on the same database.

Regards,
KK
KishoreKumar Kalla 1 Reputation point

2020-08-06T16:39:04.617+00:00

Hi ,

Below given are the details :

Data Factory region : UK South

Failed pipeline run ID: d5f1542e-1632-4c97-b414-31de208a269f

Failed activity run ID:7cc781d5-d2f1-4551-b808-ba1cd802e21d

Regards,
KK
KishoreKumar Kalla 1 Reputation point

2020-08-06T16:39:31.387+00:00

Data Factory region : UK South

Failed pipeline run ID: d5f1542e-1632-4c97-b414-31de208a269f

Failed activity run ID:7cc781d5-d2f1-4551-b808-ba1cd802e21d
KishoreKumar Kalla 1 Reputation point

2020-08-06T17:47:49.817+00:00

Below are the latest RUN ID's

Data Factory region : UK South

Failed pipeline run ID: d3ac1502-c431-4f6e-a82e-f7f54a51fced

Failed activity run ID: 67b3c178-7ace-493c-9496-5da3b51ae940
Failed activity run ID: bcf9a358-e5de-4833-b6cc-2fb06c687611
Failed activity run ID: 284d34cc-585c-4cb7-9de6-9d13c855e8d3
Failed activity run ID: e55448a3-260c-4cbe-b310-a142ed3358d7

Regards,
KK
KishoreKumar Kalla 1 Reputation point

2020-08-06T17:48:03.68+00:00

Below are the latest RUN ID's

Data Factory region : UK South

Failed pipeline run ID: d3ac1502-c431-4f6e-a82e-f7f54a51fced

Failed activity run ID: 67b3c178-7ace-493c-9496-5da3b51ae940
Failed activity run ID: bcf9a358-e5de-4833-b6cc-2fb06c687611
Failed activity run ID: 284d34cc-585c-4cb7-9de6-9d13c855e8d3
Failed activity run ID: e55448a3-260c-4cbe-b310-a142ed3358d7

Regards,
KK
KranthiPakala-MSFT 46,642 Reputation points Microsoft Employee Moderator

2020-08-08T00:38:04.767+00:00

Hi anonymous userKumarKalla-4971,

Thank you for your response and additional details. I'm working with internal team to analyse the root cause. Will keep you posted as soon we have an update regarding the same.

Thank you for your patience.
KishoreKumar Kalla 1 Reputation point

2020-08-10T09:33:39.04+00:00

Hi @KranthiPakala-MSFT ,

Thanks for the same,i shall wait for your update.

Regards,
Kishore

Answer 1

Hi anonymous userKumarKalla-4971,

Thanks for your patience. After having conversation with internal team, looks like these sandbox failures happened to be during Azure Databricks (ADF Mapping Data flow dependent service) planned maintenance window (8/6/2020 5PM - 7PM PST - Please see below screenshot) in uk: ukwest: UK West,uk: uksouth: UK South regions.

ADF engineering team is working with dependent service to solve these intermittent issues in the near future. If you have any feedback or suggestion regarding ADF product, I would highly recommend you to please share your inputs/feedback in ADF User voice forum: https://feedback.azure.com/forums/270578-azure-data-factory
Also please do share the feedback suggestion link here once it is created, so that other community members with similar idea can up-vote and/or comment on your suggestion.

In case, if you still experience this error consistently, please do share the latest run ID's from today, so that I can escalate and work with ADF engineering team to further troubleshoot the issue.

Please let me know how it goes.

Note: Azure Databricks - Status Page for Azure : https://status.azuredatabricks.net/ (Please feel free to subscribe for Azure Databricks service future notifications)

Looking forward to your confirmation.

----------

Thank you
Please do consider to click on "Accept Answer" and "Upvote" on the post that helps you, as it can be beneficial to other community members.

KranthiPakala-MSFT 46,642 Reputation points Microsoft Employee Moderator

2020-08-12T21:42:58.45+00:00

Hi anonymous userKumarKalla-4971, Following up to see if you are still experiencing the issue? In case if you still have the issue consistently, please do share the latest pipeline & activity run ID's, so that I can have deeper look into it.

Thank you.
KranthiPakala-MSFT 46,642 Reputation points Microsoft Employee Moderator

2020-08-13T21:52:22.037+00:00

Hi anonymous userKumarKalla-4971, Just checking to see if you are still experiencing the issue?

Thank you

Share via

Data Factory - Internal Server Error

1 answer

Your answer