Pipeline failed with error: InternalServerError executing request

Question

Pipeline failed with error: InternalServerError executing request

Rajesh Bommagani 81

We have debug the pipeline, after few seconds it was failed with error : InternalServerError executing request.

Why it is failed and what is the cause ?

ShaktiSingh-MSFT 7,136 Reputation points Microsoft Employee

2022-11-10T06:44:58.08+00:00

Hi @Rajesh Bommagani ,

Thanks for posting this question in Microsoft Q&A platform and for using Azure Services.

As I understand from the question, you are facing "Internal Server Error executing request" when debugging a pipeline.

Could you please share below details to troubleshoot the issue:

1). Is this error coming for other pipelines too upon debugging?
2). What are the activities/transformations used in the errored pipeline?
3). What is the Source and Target?
4). Could you see Data Preview if having Data Flow activity in the pipeline?

Awaiting your reply.
Rajesh Bommagani 81 Reputation points

2022-11-10T08:06:37.373+00:00

Hello @ShaktiSingh-MSFT ,

Thanks for the response.

1). Is this error coming for other pipelines too upon debugging?
At same time, mutliple pipelines debugged all got same error. And few pipelines cancelled wihtout error.

2). What are the activities/transformations used in the errored pipeline?
Notebooks are used. But no notebook started inside the pipeline.

3). What is the Source and Target?
SQL Database for both source and target.

4). Could you see Data Preview if having Data Flow activity in the pipeline?
Not sure about this option.
ShaktiSingh-MSFT 7,136 Reputation points Microsoft Employee

2022-11-10T08:44:01.507+00:00

Hi @Rajesh Bommagani ,

Thanks for the reply.

So, you are not able to perform debug execution for any of the pipelines.

Could you please try to Publish changes and re-try. And also try to execute it by Trigger if this executes let us know.

Additionally, please share screenshot of the issue so that I can reproduce similar scenario and check.

Thanks for your patience.
ShaktiSingh-MSFT 7,136 Reputation points Microsoft Employee

2022-11-11T09:43:44.817+00:00

Hi @Rajesh Bommagani ,

Could you please check Resource Health of your data factory as shown below to check if it is available:

And as mentioned in my previous comment, could you please try to Publish changes and re-try. And also try to execute it by Trigger if this executes let us know.

Additionally, please share screenshot of the issue so that I can reproduce similar scenario and check.
Rajesh Bommagani 81 Reputation points

2022-11-11T10:16:22.17+00:00

Hello All,

Thanks for the response.

We have checked the health status(Datafactory & Databricks), it is fine.

In Debug, its not mandatory to publish changes. Without publish also we can do directly debug(as of my knowledge).
And we havnt any done in chagnes in mappings as it is prod environment. We have debugged all piplelines at same time and all pipelines having notebooks.

My Question:
Running multiple notebooks in databricks, is it cause the error 'nternalServerError executing request' ??
After Debug the pipelines, No activity started inside the pipeline but pipeline failed with error.

I cannot share any screenshots.

Please provide solution if any one resolved this issue.

Thanks
ShaktiSingh-MSFT 7,136 Reputation points Microsoft Employee

2022-11-11T10:21:27.053+00:00

Hi @Rajesh Bommagani ,

This is strange and not expected. I would recommend you to please file a support ticket for deeper investigation and in case if you don't have a support plan, do let us know here so that we can check on other options to unblock you. Thanks
Rajesh Bommagani 81 Reputation points

2022-11-11T10:32:12.02+00:00

Hello Shakti,

Sorry i dont have support plan.

If you raise a support ticket behalf of me from your side, it helps us lot.

Thanks

ShaktiSingh-MSFT 7,136 Reputation points Microsoft Employee

2022-11-10T06:44:58.08+00:00

Hi @Rajesh Bommagani ,

Thanks for posting this question in Microsoft Q&A platform and for using Azure Services.

As I understand from the question, you are facing "Internal Server Error executing request" when debugging a pipeline.

Could you please share below details to troubleshoot the issue:

1). Is this error coming for other pipelines too upon debugging?
2). What are the activities/transformations used in the errored pipeline?
3). What is the Source and Target?
4). Could you see Data Preview if having Data Flow activity in the pipeline?

Awaiting your reply.
Rajesh Bommagani 81 Reputation points

2022-11-10T08:06:37.373+00:00

Hello @ShaktiSingh-MSFT ,

Thanks for the response.

1). Is this error coming for other pipelines too upon debugging?
At same time, mutliple pipelines debugged all got same error. And few pipelines cancelled wihtout error.

2). What are the activities/transformations used in the errored pipeline?
Notebooks are used. But no notebook started inside the pipeline.

3). What is the Source and Target?
SQL Database for both source and target.

4). Could you see Data Preview if having Data Flow activity in the pipeline?
Not sure about this option.
ShaktiSingh-MSFT 7,136 Reputation points Microsoft Employee

2022-11-10T08:44:01.507+00:00

Hi @Rajesh Bommagani ,

Thanks for the reply.

So, you are not able to perform debug execution for any of the pipelines.

Could you please try to Publish changes and re-try. And also try to execute it by Trigger if this executes let us know.

Additionally, please share screenshot of the issue so that I can reproduce similar scenario and check.

Thanks for your patience.
ShaktiSingh-MSFT 7,136 Reputation points Microsoft Employee

2022-11-11T09:43:44.817+00:00

Hi @Rajesh Bommagani ,

Could you please check Resource Health of your data factory as shown below to check if it is available:

And as mentioned in my previous comment, could you please try to Publish changes and re-try. And also try to execute it by Trigger if this executes let us know.

Additionally, please share screenshot of the issue so that I can reproduce similar scenario and check.
Rajesh Bommagani 81 Reputation points

2022-11-11T10:16:22.17+00:00

Hello All,

Thanks for the response.

We have checked the health status(Datafactory & Databricks), it is fine.

In Debug, its not mandatory to publish changes. Without publish also we can do directly debug(as of my knowledge).
And we havnt any done in chagnes in mappings as it is prod environment. We have debugged all piplelines at same time and all pipelines having notebooks.

My Question:
Running multiple notebooks in databricks, is it cause the error 'nternalServerError executing request' ??
After Debug the pipelines, No activity started inside the pipeline but pipeline failed with error.

I cannot share any screenshots.

Please provide solution if any one resolved this issue.

Thanks
ShaktiSingh-MSFT 7,136 Reputation points Microsoft Employee

2022-11-11T10:21:27.053+00:00

Hi @Rajesh Bommagani ,

This is strange and not expected. I would recommend you to please file a support ticket for deeper investigation and in case if you don't have a support plan, do let us know here so that we can check on other options to unblock you. Thanks
Rajesh Bommagani 81 Reputation points

2022-11-11T10:32:12.02+00:00

Hello Shakti,

Sorry i dont have support plan.

If you raise a support ticket behalf of me from your side, it helps us lot.

Thanks

Answer 1

Hello,

Thanks for the response.

We have checked the health status(Datafactory & Databricks), it is fine.

In Debug, its not mandatory to publish changes. Without publish also we can do directly debug(as of my knowledge).
And we havnt any done in chagnes in mappings as it is prod environment. We have debugged all piplelines at same time and all pipelines having notebooks.

My Question:
Running multiple notebooks in databricks, is it cause the error 'nternalServerError executing request' ??
After Debug the pipelines, No activity started inside the pipeline but pipeline failed with error.

I cannot share any screenshots.

Please provide solution if any one resolved this issue.

Thanks

Pipeline failed with error: InternalServerError executing request

1 answer

Activity