Invoke synapse notebook as soon as spark pool starts

Suraj Tripathi 72 Reputation points Microsoft Employee
2022-09-22T09:09:27+00:00

Hi,

I have read access on synapse workspace, and I want synapse notebook to trigger automatically without any manual intervention.
Let's say the environment is production, how will the synapse notebook will run on it's own?

The notebook has event streaming code so once the notebook run it will be running indefinitely, I want to know how to run it for the first time.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,458 questions
{count} votes

Accepted answer
  1. AnnuKumari-MSFT 31,716 Reputation points Microsoft Employee
    2022-09-23T08:52:45.357+00:00

    Hi @Suraj Tripathi ,

    Thankyou for using Microsoft Q&A platform and thanks for posting your question here.

    As per your query, it seems you want the Synapse notebook to run automatically without the need to manually trigger it. Please let me know if that is not the ask.

    You can call the notebook activity within the Synapse pipeline and create a scheduled trigger for it to trigger automatically.

    Note: Spark pool gets activated as soon as we run the notebook, not the other way around.

    For more details, kindly check : Transform data by running a Synapse notebook

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you.
      Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful