Creating a Linked Sercvice between Azure Function and Databricks

Question

I have a ADF pipeline which has two activities

1. Azure Function
2. Databricks

Question1:
Function app will tell me the path of Input data and this path needs to passed as input to a Databricks Notebook. I tired linking them using the parameters in the settings tab but the pipeline fails.
Also I didn't find any document for reference on this.
Question2:
Post the Databricks activity how connect it to a service bus on the Job status.

Answer 1

Hi @Rajamannar A K ,

Thank you for posting your Query in Microsoft Q&A Platform.

Once you get path from FunctionApp try to store it One variable using Set Variable activity. and Pass that variable as value to Databricks note book using Databricks notebook activity.

How to pass values to Notebook parameters from ADF Pipeline discussed in below video. Kindly check it once.
https://www.youtube.com/watch?v=quPsLwDjTds

Below is high level blue print of pipeline design.

Azure data factory doesn't has service bus connector. However there are several options available to you. Kindly check below link where similar discussion happened.
https://learn.microsoft.com/en-us/answers/questions/111361/how-to-connect-service-bus-queue-to-azure-data-fac.html

Hope this helps. Please let us know if any further queries. Thank you.

----------------------

Please consider hitting Accept Answer button. Accepted answers helps community as well.