Can we execute Synapse Spark Notebook on synapse workspace from azure DevOps pipeline ?

Siddharth Joshi 231

Hi,

I want to know Can I execute Synapse Spark Notebook on synapse workspace from the Azure DevOps pipeline ?

Answer accepted by question author

Sedat SALMAN 14,280 Reputation points MVP Volunteer Moderator

2024-01-09T11:15:20.53+00:00

I offer you to follow this training module

https://learn.microsoft.com/en-us/training/modules/use-spark-notebooks-azure-synapse-pipeline/#:~:text=,parameters%20with%20a%20notebook%20activity

and the following document

https://learn.microsoft.com/en-us/azure/synapse-analytics/cicd/continuous-integration-delivery#:~:text=Use%20the%20%E3%80%9018%E2%80%A0Synapse%20workspace%20deployment%E2%80%A0marketplace,and%20other%20artifacts%20in%20workspace

https://techcommunity.microsoft.com/t5/azure-synapse-analytics-blog/azure-synapse-studio-cicd-using-yaml-pipelines/ba-p/3045553
Please sign in to rate this answer.
Jaya Ojha 70 Reputation points

2024-01-10T13:59:45.1533333+00:00

Hi @Sedat SALMAN

Thanks for you response, we have gone through all the links you mentioned.

Actually, we are using the same "Synapse workspace deployment@2" task mentioned in the documentations but this task only moves notebooks from one environment to another what we want to do is move them to higher environment but also execute them on higher environment.

Is there a way to execute these notebooks on Apache spark pool.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

0 additional answers

Your answer