Synapse with git integration - publish issues with spark job

Janusz Ciesielski 6

I'm having issues with git integration in Synapse. They concern spark job definition in pipelines.
When creating new job, the execution policy is saved, commited to git. It is present on collaborative branch after completing pull request.

Unfortunately, later upon publishing it is not published to publish branch

As you can see, this is the same object - lastPublishTime is the same, but execution policy is reset to defaults.
Another related bug is that, despite the code state in repository, after opening pipeline in workspace it also has default execution policy parameters.

So the question here is how do I set policy of spark job to be properly published in Synapse, using git integration?

HarithaMaddi-MSFT 10,136 Reputation points

2020-12-16T13:00:11.763+00:00

Hi @Janusz Ciesielski ,

Welcome to Microsoft Q&A Platform. Thanks for posting the issue.

I have reproduced this issue in Live mode as well and this is happening only with spark job pipelines. I will reach out to Synapse product team and will get back to you as soon as I hear back from them.

Stay tuned!
Janusz Ciesielski 6 Reputation points

2020-12-17T08:59:25.643+00:00

Hi Haritha,

Thank you very much for pushing the issue to appropriate team.

I've also managed to get it reported using Azure support request. Ticket id is: 120121725000607

Take care!
HarithaMaddi-MSFT 10,136 Reputation points

2020-12-17T12:44:07.353+00:00

Hi @Janusz Ciesielski ,

Thanks for your valuable feedback. Product team acknowledged it as a bug and started working on it.

I will keep you updated as soon as it is fixed.

Share via

Synapse with git integration - publish issues with spark job

Your answer