Transfer / pass a parameter outside databricks workflow

Boris Perchinkov 0

Hello,

in a synapse pipeline, through a web activity i call / execute a databricks workflow job.
The job has couple of notebooks that execute depending on some logic inside the job itself.
When the notebooks finish, i want to output some parameters outside those notebooks back to the synapse pipeline's next activity.
is this possible / is there a way to do it ?

I tried using

dbutils.notebook.exit

but the message / value i output is not shown in the web activity output.

any suggestion is welcome,
Thanks

Vinodh247 23,581 Reputation points MVP

2024-08-03T10:28:41.0333333+00:00
Make sure that the value you are returning with dbutils.notebook.exit is correctly formatted. The output should be a string, typically in JSON format, which can be easily parsed later.

import json # Your processing logic here result = {"status": "success", "value": "some_value"} dbutils.notebook.exit(json.dumps(result))
PRADEEPCHEEKATLA 90,231 Reputation points

2024-08-06T05:45:50.96+00:00

@Boris Perchinkov - We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Boris Perchinkov 0 Reputation points

2024-08-13T13:28:52.53+00:00
thank you for the answers
i tried outputing from the notebook within the job like this

result = {"status": status, "value": message} dbutils.notebook.exit(json.dumps(result))

but i still cant see this form of result from the workflow job output when pipeline runs :(

Share via

Transfer / pass a parameter outside databricks workflow

Your answer