Invoke synapse notebook as soon as spark pool starts

Suraj Tripathi 77 Reputation points
2022-09-22T09:09:27+00:00

Hi,

I have read access on synapse workspace, and I want synapse notebook to trigger automatically without any manual intervention.
Let's say the environment is production, how will the synapse notebook will run on it's own?

The notebook has event streaming code so once the notebook run it will be running indefinitely, I want to know how to run it for the first time.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,389 questions
{count} votes

Accepted answer
  1. AnnuKumari-MSFT 34,561 Reputation points Microsoft Employee Moderator
    2022-09-23T08:52:45.357+00:00

    Hi @Suraj Tripathi ,

    Thankyou for using Microsoft Q&A platform and thanks for posting your question here.

    As per your query, it seems you want the Synapse notebook to run automatically without the need to manually trigger it. Please let me know if that is not the ask.

    You can call the notebook activity within the Synapse pipeline and create a scheduled trigger for it to trigger automatically.

    Note: Spark pool gets activated as soon as we run the notebook, not the other way around.

    For more details, kindly check : Transform data by running a Synapse notebook

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you.
      Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.