Calling databricks Python notebook in Azure function.

Question

Hello,

I have a python databricks notebook(pyspark) which does an aggregation based on the inputs provided to the notebook via parameters.

1. Is it possible to run this notebook from the Azure function app.
2. Can we pass the parameters to the notebook from the Azure function. If so, kindly let me know the approach.

Thank you.

Answer 1

Just wanted to summarize,

Databricks has an API which can perform many actions within the data bricks, saying that you can use the same API to trigger a job. You can create a job which executes the notebook, and then you can invoke the job via databricks API from Azure functions and also pass required parameters to it. Refer to the documentation https://learn.microsoft.com/en-us/azure/databricks/dev-tools/api/latest/jobs for more details about using the job API.

Mark this as an answer if it helps you.

Answer 2

Hi @Sanju ,this has been answered in the stack overflow below:

https://stackoverflow.com/questions/72664052/calling-databricks-python-notebook-in-azure-function Thanks