question

abhishek6555 avatar image
0 Votes"
abhishek6555 asked SaurabhSharma-msft answered

Pass different parameter to same notebook databricks

I have a notebook in python which provides profiling output results for the table .
I want to schedule this notebook.
For example the notebook name is Profiling notebook and i have table A,B,C,D....
When i schedule this notebook do i have to create multiple jobs and pass parameter A,B,C,D to them.
Or is it possible to pass parameter A,B,C,D in loop to the same job.

azure-databricks
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

SaurabhSharma-msft avatar image
1 Vote"
SaurabhSharma-msft answered

Hi @abhishek6555,

Thanks for using Microsoft Q&A !!
You need to create multiple job schedules and pass different parameters to them. If you want to pass multiple parameters to the same job, then you try calling the notebook from Azure Data Factory with different values ( you can store the values either in table/blob and loop through it). Schedule the trigger instead of scheduling the job in notebook if this works for you.

You can also provide your feedback at Azure Databricks Uservoice for community to upvote and products team to review and include in future releases.

Thanks
Saurabh


5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.