Azure Synapse live workspace is messed up - git overwrite is not working and spark notebooks are not visible in pipeline run

Question

Azure Synapse live workspace is messed up - git overwrite is not working and spark notebooks are not visible in pipeline run

Stephane Massat 81

Hello,

I am experiencing a severe issue with my synapse workspace starting yesterday. Can you please help me ?

We are using GIT for version control, and everything works well in the "Git" branches.
But we were having issues when publishing, so we have been running "GIT overwrite" to force updating the content of the live workspace. The publish succeed, but the workspace is not updated. (the overwrite detect all objects of the workspace as "new" each time i run it, and i get the "publish succeed" message, but the workspace is still not updated.
I tried the following :

disconnect git
removed manually all objects from the workspace (notebooks, pipelines, linked services)
reconnect git and run "git overwrite"

--> it recreates all my objects in the workspace, and i can see the objects in synapse studio, but i still get the same issue :

running "git overwrite" one more time detect all objects of the workspace as "new"
in the pipelines, in the "notebook" activities, the Notebook selection of the Settings tab is empty. I should see all the notebooks, but it is left empty.

Is there any way to fix that mess ?

Stephane Massat 81 Reputation points

2022-12-08T12:19:47.217+00:00

I just saw 2 other Q&A reporting similare issue today with the notebooks cannot be selected in the pipeline notebook activity. This is probably a global bug of the synapse platform !
Bhargava-MSFT 31,351 Reputation points Microsoft Employee Moderator

2022-12-08T21:39:14.1+00:00

Hello @Stephane Massat ,
Welcome to the MS Q&A platform.
Sorry for the inconvenience. We have noticed this issue and reported it to the product team. I will get back to you once we hear from them.
Bhargava-MSFT 31,351 Reputation points Microsoft Employee Moderator

2022-12-09T17:23:03.163+00:00

Hello @Stephane Massat ,
The issue has been resolved. Could you please check and confirm from your end?
Stephane Massat 81 Reputation points

2022-12-12T07:34:24.643+00:00

Hello, I confirm the problem that we cannot select the notebook from the pipeline has been fixed.

Meanwhile, i still get this issue when using the "overwrite live mode" from the git configuration : it is always detecting all my objects as new. the funny thing is that the publish succeed anyway. Was that a different issue ?

1 answer

Your answer

Stephane Massat 81 Reputation points

2022-12-08T12:19:47.217+00:00

I just saw 2 other Q&A reporting similare issue today with the notebooks cannot be selected in the pipeline notebook activity. This is probably a global bug of the synapse platform !
Bhargava-MSFT 31,351 Reputation points Microsoft Employee Moderator

2022-12-08T21:39:14.1+00:00

Hello @Stephane Massat ,
Welcome to the MS Q&A platform.
Sorry for the inconvenience. We have noticed this issue and reported it to the product team. I will get back to you once we hear from them.
Bhargava-MSFT 31,351 Reputation points Microsoft Employee Moderator

2022-12-09T17:23:03.163+00:00

Hello @Stephane Massat ,
The issue has been resolved. Could you please check and confirm from your end?
Stephane Massat 81 Reputation points

2022-12-12T07:34:24.643+00:00

Hello, I confirm the problem that we cannot select the notebook from the pipeline has been fixed.

Meanwhile, i still get this issue when using the "overwrite live mode" from the git configuration : it is always detecting all my objects as new. the funny thing is that the publish succeed anyway. Was that a different issue ?

Answer 1

Bhargava-MSFT 31,351 Microsoft Employee Moderator

Hello @Stephane Massat ,
Thanks for the confirmation.

Regarding your other issue. It seems like this is expected behavior. When I tried to "overwrite live mode" it always detected as (New) objects.

With this "overwrite live mode" option, we can directly overwrite Azure Synapse Analytics or Azure Data Factory Live mode code with the current Branch from Azure Dev Ops.

It will use the Publish option to overwrite everything into Azure Synapse Analytics/Azure Data Factory. So I believe this is why it shows as (New) every time.

I hope this helps. Please let me know if you have any further questions.

Bhargava-MSFT 31,351 Reputation points Microsoft Employee Moderator

2022-12-14T22:14:45.037+00:00

Hello @Stephane Massat ,
I am checking to see if you have any further questions here.
Stephane Massat 81 Reputation points

2022-12-16T14:18:52.917+00:00

Hello, thank you for your help. in my memory, even that publish overwrite was comparing, so i am a bit confused, but if you confirm this is the right behavior, then this is perfect. thank you !
Bhargava-MSFT 31,351 Reputation points Microsoft Employee Moderator

2022-12-17T01:50:24.473+00:00

Thank you, @Stephane Massat

Share via

Azure Synapse live workspace is messed up - git overwrite is not working and spark notebooks are not visible in pipeline run

1 answer

Your answer