Synapse overwrite live mode fails

Question

Synapse overwrite live mode fails

Johan á Rogvi-Hansen 106

Hi,

When I to overwrite Synapse live mode, I can an error saying that a database already exists. How am I to circumvent this if I have other artifacts I want to publish to live mode?

Accepted answer

1 additional answer

Your answer

Answer 1

Bhargava-MSFT 31,261 Microsoft Employee Moderator

Hello @Johan á Rogvi-Hansen ,

Welcome to the MS Q&A platform.

As per the error message, it seems like the Database has already been published to live mode, and when you try to overwrite the live mode, it throws the error message.

To resolve the issue:

Method 1)

Disconnect the Git repository (Connect to the live mode), and delete the existing Database. Once you connect back to Git, you can overwrite the live mode with your publish branch.
Note: when you connect to the Git repository, you can't publish the changes directly from the live mode.

Method 2) (if this is your test DB that can be deleted)
From the collaboration branch(main) delete the DB and then commit(committed changes will reflect on the main branch) and publish(published to workspace_publish branch, which is live mode)

Then you can able to overwrite the live mode(Here, the DB will be deleted)

But if your requirement is to publish the artifacts to the live mode, you do not need to overwrite the live mode every time.

Once you add any artifacts in your Collaboration branch, click on "Publish", all changes will be published to the Live mode.

I hope this helps. Please let me know if you have any further questions.

------------------------------

Please don't forget to click on and upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
Want a reminder to come back and check responses? Here is how to subscribe to a notification
If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

Johan á Rogvi-Hansen 106 Reputation points

2022-10-11T05:13:32.143+00:00
Hi @Bhargava-MSFT ,

It does indeed answer my questions, thank you. One last question: if I have understood it correctly, Synapse live mode is to be understood as the 'production' mode of Synapse in the sense that, for example, any artifacts used by other resources, like a Logic App, will be from the live mode. So, the question is:

will changes, deletion included, to artifacts be reflected too, or will I in this case have to overwrite live mode?
Bhargava-MSFT 31,261 Reputation points Microsoft Employee Moderator

2022-10-11T19:10:11.533+00:00

Hello @Johan á Rogvi-Hansen ,
Thank you for the reply.
'Overwrite live mode' is like a disaster recovery from any publish mode(ex: If we messed up something and wanted to restore the live mode with the collaboration branch).
In general, we don't use the overwrite live mode unless there is a need.

For your question:
Yes, all changes, including the deletion of artifacts, will be reflected using the publishing option. You do not need to use the overwrite live mode.

Ex:
In the below screenshot, I have deleted my lake database from the collaboration branch, and when I click on "publishing," you can see the Crossmark on the DB (going to be deleted from the live mode, which got published to live mode earlier)

I hope this helps. Please let me know if you have any further questions.

------------------------------

If this answers your question, please consider accepting the answer by hitting the Accept answer button, as it helps the community.
Bhargava-MSFT 31,261 Reputation points Microsoft Employee Moderator

2022-10-12T22:34:06.317+00:00

Hello @Johan á Rogvi-Hansen ,
I am checking to see if you have any further questions.

------------------------------

If this answers your question, please consider accepting the answer by hitting the Accept answer button, as it helps the community.
Johan á Rogvi-Hansen 106 Reputation points

2022-10-13T05:33:03.68+00:00

Thank you @Bhargava-MSFT
Bhargava-MSFT 31,261 Reputation points Microsoft Employee Moderator

2022-10-13T16:20:14.257+00:00

Thank you, @Johan á Rogvi-Hansen

Answer 2

While I agree with everything in this thread, there is a very important detail that should be known and it is this Best Practice (aka Limitation)

Edit artifacts in Studio. Synapse studio is the only place you can enable workspace source control and sync changes to git automatically. Any change via SDK, PowerShell, will not be synced to git. We recommend you always edit artifact in Studio when git is enabled.
https://learn.microsoft.com/en-us/azure/synapse-analytics/cicd/source-control#best-practices-for-git-integration

We are having 1000 pipelines activities, we won't be doing that manually in Synapse Studio
So, if you are using Synapse Studio to create/Modify all the artifacts it is fine. But, If you are using per example a DataWarehouse Automation tool to generate all the ETL pipelines, Linked Services, Triggers, ..., and use GIT to push to the Collaboration Branch, everything will be good in your branch, but when you'll push the PUBLISH button it might not work as expected.
And even if in this case, the Collaboration branch is always the truth, Overwriting the Live Mode won't work easily. I'm currently trying to overwrite for 12 hours.
I've discussed (and still discussing) about that problem with the Support.

So, just be aware of this : "always edit artifact in Studio when git is enabled."

Bhargava-MSFT 31,261 Reputation points Microsoft Employee Moderator

2022-10-20T04:42:54.32+00:00

Hi @Steve Toutant ,
Good to know, and thank you so much for sharing with us
Jason Hamje 0 Reputation points

2023-05-24T03:47:32.1733333+00:00

Hi there -- Just wanted to follow up, did you ever find a fix for this?

Share via

Synapse overwrite live mode fails

1 additional answer

Your answer