Pass different parameter to same notebook databricks

Abhishek Gaikwad 191 Reputation points
2021-04-15T11:11:13.613+00:00

I have a notebook in python which provides profiling output results for the table .
I want to schedule this notebook.
For example the notebook name is Profiling notebook and i have table A,B,C,D....
When i schedule this notebook do i have to create multiple jobs and pass parameter A,B,C,D to them.
Or is it possible to pass parameter A,B,C,D in loop to the same job.

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,947 questions
0 comments No comments
{count} votes

Accepted answer
  1. Saurabh Sharma 23,751 Reputation points Microsoft Employee
    2021-04-15T21:14:36.803+00:00

    Hi @Abhishek Gaikwad ,

    Thanks for using Microsoft Q&A !!
    You need to create multiple job schedules and pass different parameters to them. If you want to pass multiple parameters to the same job, then you try calling the notebook from Azure Data Factory with different values ( you can store the values either in table/blob and loop through it). Schedule the trigger instead of scheduling the job in notebook if this works for you.

    You can also provide your feedback at Azure Databricks Uservoice for community to upvote and products team to review and include in future releases.

    Thanks
    Saurabh

    1 person found this answer helpful.
    0 comments No comments

0 additional answers

Sort by: Most helpful