pass a variable in synapse notebook 1 to synapse notebook 2 which are part of synapse pipelines

Suraj Tripathi 72 Microsoft Employee

Hi, I have a notebook where I am defining a variable "error_message", I want to read that in the next notebook. Both the notebooks are part of the synapse pipeline.

PRADEEPCHEEKATLA-MSFT 85,746 Reputation points Microsoft Employee

2023-04-18T07:31:48.59+00:00

@Suraj Tripathi - Just checking in to see if the below answer helped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

1 answer

AnnuKumari-MSFT 32,161 Reputation points Microsoft Employee

2023-04-06T05:17:39.9133333+00:00
@Suraj Tripathi Thankyou for using Microsoft Q&A platform and thanks for posting your query here. You can read the value of the variable in the next notebook by using the %run magic command in the second notebook.

You can use %run <notebook path> magic command or mssparkutils.notebook.run() to reference another notebook within current notebook's context. All the variables defined in the reference notebook are available in the current notebook.

Example1: %run /<path>/Notebook1 { "parameterInt": 1, "parameterFloat": 2.5, "parameterBool": true, "parameterString": "abc" }. Example2: mssparkutils.notebook.run("folder/Sample1", 90, {"input": 20 }) For additional details, kindly check :

Notebook reference

Reference a notebook

%run command to reference another notebook with in current notebook in Azure Synapse Analytics

run() function of notebook module in MSSparkUtils package in Azure Synapse

Hope it helps. Kindly accept the answer if it helps. Thankyou.
Please sign in to rate this answer.
Suraj Tripathi 72 Reputation points Microsoft Employee

2023-04-06T08:33:18.6+00:00

@AnnuKumari-MSFT The first notebook have exceptions which we are trying to catch. And that error is stored in the variables. After catching that exception we are generating exception. And on failure, the next notebook is starting where we need that variable. If I run the notebook using %run, the second notebook will fail at that cell since the first notebook will generate exception. Hence we can't do that. Current I am storing that variable in a text file in the primary adls. And reading it in the second notebook. Can you please tell me a better way ?

AnnuKumari-MSFT 32,161 Reputation points Microsoft Employee

2023-04-06T08:40:19.0733333+00:00

Suraj Tripathi , Did you try mssparkutils.notebook.run method to run the first notebook from the second notebook? It should be able to return the exit value of the notebook. This way, you don't need to store the variable in a text file in the ADLS and read it in the second notebook. Please let me know how it goes. In case, it works, kindly accept the answer

AnnuKumari-MSFT 32,161 Reputation points Microsoft Employee

2023-04-13T07:28:11.9866667+00:00

Suraj Tripathi , Just checking back to get updates on the ask. Did the above suggested response helped? If yes, kindly accept the answer.
Sign in to comment

Share via

pass a variable in synapse notebook 1 to synapse notebook 2 which are part of synapse pipelines

1 answer