How to run another Synapse Notebook from one Synapse Notebook

Question

I try to run another Synapse notebook in one Synapse notebook. And I found the documents for using %run or mssparkutils.notebook.run, but both of them failed. when I use %run, I got the error below, but as you can see that the notebook is there.

When I use mssparkutils.notebook.run, in the error log it also mentioned the notebook cannot be found. Is there anything I have in the code run? How to specify the path to find the notebook?

Answer 1

Shao Peng Sun - Thanks for the question and using MS Q&A platform.

You will experience this issue, in case if you are not published the notebook which you are calling from another notebook.

As per the repro, I had created a named notebook10 and tried to run from another notebook named notebook11 without publishing the notebooks which returned same error message as shown:

Then, I tried to publish all the notebooks in my workspace.

When I tried to call notebook10 from notebook11 which worked as excepted.

Hope this helps. Do let us know if you any further queries.

Answer 2

Hi Thanks for reaching out to Microsoft Q&A. By importing libraries like below...

from notebookutils import mssparkutils mssparkutils.notebook.run('folder/notebook_name')

For detailed step by step instructions and other available options, go through the below git link. https://dustinvannoy.com/2022/01/20/azure-synapse-spark-external-python-packages/ Please Upvote and Accept as answer if the reply was helpful, this will be helpful to other community members.

Answer 3

The error you are encountering suggests that the notebook you are trying to run cannot be found. This could be because the notebook path you are specifying is incorrect, or because the notebook is not in the same workspace as the notebook you are running the %run or mssparkutils.notebook.run command from. To specify the correct path to the notebook you want to run, you can use the absolute path to the notebook or a relative path. For example, if the notebook you want to run is located in the same folder as the notebook you are running the %run or mssparkutils.notebook.run command from, you can use a relative path like this:

shellCopy code
%run ./my_other_notebook

If the notebook you want to run is located in a different folder, you can use a relative or absolute path to specify the notebook location. For example, if the notebook you want to run is located in a subfolder called subfolder within the same folder as the notebook you are running the %run or mssparkutils.notebook.run command from, you can use a relative path like this:

shellCopy code
%run ./subfolder/my_other_notebook

Alternatively, you can use an absolute path to specify the notebook location, like this:

shellCopy code
%run /path/to/my_other_notebook

Make sure that the path you are specifying is correct and that the notebook exists in the specified location. Also, check that you have the necessary permissions to access the notebook. If you continue to encounter errors, you can try using the dbutils.notebook.run command instead of mssparkutils.notebook.run. The syntax for using dbutils.notebook.run is similar to mssparkutils.notebook.run, but it might work better for your specific use case.