Synapse : how to run pipeline ( Call Notebook) without publishing code

MARBOUH Soufiane (CANDRIAM) 1 Reputation point
2022-10-14T16:30:24.907+00:00

Hello,

I want to set up a branch management policy on synapse allowing to have a development branch to validate the developments before moving on to Mater, unfortunately we cannot call notebooks from the pipelines without publishing the code.

do you have a solution to call notebooks in pipeline without publish?

Error:
{
"errorCode": "6002",
"message": "MagicUsageError: Cannot read notebook /Test/NTBK1. The possible reason is that the notebook doesn't exist. More details please visit https://go.microsoft.com/fwlink/?linkid=2173018\n--> PartnerException: Exception of type 'Microsoft.Analytics.SynapseNotebookService.Infrastructure.Exceptions.ClientExceptions.PartnerException' was thrown.",
"failureType": "UserError",
"target": "Notebook1",
"details": []
}

250595-image.png

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,378 questions
{count} votes

3 answers

Sort by: Most helpful
  1. AnnuKumari-MSFT 34,556 Reputation points Microsoft Employee Moderator
    2022-10-17T07:28:06.463+00:00

    Hi @MARBOUH Soufiane (CANDRIAM) ,

    Welcome to Microsoft Q&A platform and thanks for posting your question here.

    As per my understanding, your query is regarding running the unpublished Synapse notebook. Kindly let me know if my understanding is incorrect.

    You can enable unpublished notebook reference from Properties panel of the calling notebook.

    250937-image.png

    Please have a look at the below video for reference:

    251002-refunpublishednotebook.gif

    For more details, kindly check the following article: Reference unplublished notebook

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button and take the satisfaction survey whenever the information provided helps you.
      Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

  2. soufiane marbouh 1 Reputation point
    2022-11-03T09:41:08.91+00:00

    Hi AnnuKumari-MSFT,

    Thank you for your reply.
    I know that I can call the Notebook from another without publishing. On the other hand, you cannot call a notebook from a pipeline, you must publish the code

    would you please let me know if you can run a pipeline that calls a Notebook without posting your code?
    Best regards

    Soufiane MARBOUH
    Data Architecte


  3. FERGUS ESSO KETCHA ASSAM 125 Reputation points Student Ambassador
    2023-05-09T11:58:02.9133333+00:00

    @MARBOUH Soufiane (CANDRIAM)

    Go to the Notebook Properties and click on the checkbox (Enable unpublished notebook reference).

    Hope that helps
    upnbf

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.