All ADF dataflow stages disappear after publish

Question

Hello,
I made a source for my Dataflow and added several stages to the existing one. I published and Dataflow showed an error with a new source. I tried to delete it, but could not delete it. I published again and all my stages disappeared.

It is not possible to publish data flow like a this, because I will get an error because there is no connected sink. In any case, it should have been publish with all steps.

How to get them back, why did they disappear and what happened?

And so it was before that.

Answer 1

Try to check the Publish history :

• Go to the "Manage" tab in ADF.
• Select "Source Control" and then "Publish History."
• Review the recent publishes to see if there are any indications of errors or missing components.
• If you find a previous successful publish, you might be able to revert to that version.

Meanwhile, check the activity logs in Azure to identify any errors or warnings that were logged during your publish attempts. This might give you insight into what went wrong.

You can try inspecting the Dataflow JSON:

• Go to the "Author" tab.
• Open the JSON view of your dataflow to see if the stages are still present but not rendered correctly in the UI.
• Sometimes manual edits in the JSON can recover or reveal issues that are not visible in the graphical interface.

If none of the above steps work, you should contact Microsoft Support. Provide them with as much detail as possible, including the error messages you received and the steps you took before the issue occurred.