Pipeline failed with error: InternalServerError executing request

Question

We have debug the pipeline, after few seconds it was failed with error : InternalServerError executing request.

Why it is failed and what is the cause ?

Answer 1

Hi @Rajesh Bommagani ,

Could you please check Resource Health of your data factory as shown below to check if it is available:

And as mentioned in my previous comment, could you please try to Publish changes and re-try. And also try to execute it by Trigger if this executes let us know.

Additionally, please share screenshot of the issue so that I can reproduce similar scenario and check.

Answer 2

Hello,

Thanks for the response.

We have checked the health status(Datafactory & Databricks), it is fine.

In Debug, its not mandatory to publish changes. Without publish also we can do directly debug(as of my knowledge).
And we havnt any done in chagnes in mappings as it is prod environment. We have debugged all piplelines at same time and all pipelines having notebooks.

My Question:
Running multiple notebooks in databricks, is it cause the error 'nternalServerError executing request' ??
After Debug the pipelines, No activity started inside the pipeline but pipeline failed with error.

I cannot share any screenshots.

Please provide solution if any one resolved this issue.

Thanks

Answer 3

I also experienced with today (14/02/2025), however, for me it's a published pipeline and I manual triggered it.

I ran it at 12:18 and ran for 51" then failed "InternalServerError executing request" Then 30 minutes later it ran again. My problem is that "Why Microsoft doesn't give reason for this and act like nothing happened". Why re-run it as manual while I didn't do it?

I hope someone can also share similar experiences they have with ADF, and I was not running Databricks.

Thanks in advance