ARM templates

Question

We have a-lot of pipelines in synapse.
How is it possible to regenerate these pipelines using ARM templates?
Is it just a matter of saving each pipeline's jason ARM templates individually in notepad and re-run them one at a time if required (i.e. if something goes wrong with development pipeline)?

Thank you

Answer 1

Hello @arkiboys and welcome back.

That could work, I think, however you would have to be careful about the things the pipeline depends upon. This will not work for linked services whose secrets are saved into Data Factory, not Key Vault. If there is a change in dataset, or which dataset the pipeline references, that must be resolved before regenerating the pipeline.

Triggers could also get messed up.

If you have that many pipelines, re-saving them one at a time sounds like a pain. On a one-off, and for edge cases, it works.

Umm, I just realized, I might be totally misunderstanding your ask. Are you talking about undoing a change in a single environment? Or are you talking about promoting dev -> prod like CI/CD?

For both cases, integrating a repository can help.