Data flow internal server error

Question

Hello,

I made a pipeline with one copy activity(from Cosmos DB to Blob storage) and one data flow activity(from Blob storage to Azure MySQL).
There's no errors several hours ago.
But when I changed it a little and then re-run it by trigger now, I met Internal server error for data flow activity(no error for copy activity)

So I tried debugging mode on for the data flow, but it also returned "Failed to setup debug session. Session ID: 08409837-4d6c-4059-9ceb-9d6c6d61eb97"
And view details just show like:
Error
Notifications
{"status":"Failed","sessionId":"8b27617d-52ba-4e8f-8f70-ceb96b623136"}

Is there any idea for fixing it?

Thanks in advance.

Answer 1

Hi @Anonymous ,

Welcome to Microsoft Q&A and thanks for reaching out.

As per my understanding your pipeline with Copy and DataFow activity were running without issues until you made some changes and since then you are seeing this error message.

Looking at the error message it could be transient issue due to some service call failure on Databricks side. Could you please confirm if you are still facing the issue with this pipeline consistently? If yes, then could you please try cloning the pipeline and revert back the changes to make sure the pipeline code works as expected. This is to make sure if it is something wrong with Dataflow service or if it is related to some configuration from your end.

Looking forward to your confirmation.

Thank you