How can we connect Azure Data Factory with Azure Databricks SQL Endpoint instead of interactive cluster?

Question

How can we connect Azure Data Factory with Azure Databricks SQL Endpoint instead of interactive cluster?

AMIT KULKARNI 21

Is it possible to connect Azure Data Factory with Azure Databricks SQL Endpoint (Delta tables and views
) instead of interactive cluster. I tried with Azure Delta Lake connector but it has options only for cluster and not endpoint

PRADEEPCHEEKATLA 90,651 Reputation points Moderator

2021-12-24T10:25:03.01+00:00
Hello @AMIT KULKARNI ,

Following up to see if the below suggestion was helpful. And, if you have any further query do let us know.

------------------------------

Please don't forget to click on or upvote button whenever the information provided helps you.

Accepted answer

0 additional answers

Your answer

PRADEEPCHEEKATLA 90,651 Reputation points Moderator

2021-12-24T10:25:03.01+00:00

Hello @AMIT KULKARNI ,

Following up to see if the below suggestion was helpful. And, if you have any further query do let us know.

------------------------------

Please don't forget to click on or upvote button whenever the information provided helps you.

Answer 1

Hello @AMIT KULKARNI ,

Welcome to the Microsoft Q&A platform.

Unfortunately, you cannot connect Azure Databricks SQL endpoints with Azure Databricks using ADF.

Note: With compute option - you can connect Azure Databricks workspace with the below cluster options:

New Job cluster
Existing interactive cluster
Existing instance pool

Note: With Datastore option - Azure Databricks Delta Lake option you can connect only existing interactive clusters:

Appreciate if you could share the feedback on our feedback channel. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

Hope this will help. Please let us know if any further queries.

------------------------------

Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
Want a reminder to come back and check responses? Here is how to subscribe to a notification
If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

PRADEEPCHEEKATLA 90,651 Reputation points Moderator

2021-12-22T12:12:46.097+00:00

Hello @AMIT KULKARNI ,

Just checking in to see if the above answer helped. If this answers your query, do click Accept Answer and Up-Vote for the same. And, if you have any further query do let us know.

Share via

How can we connect Azure Data Factory with Azure Databricks SQL Endpoint instead of interactive cluster?

0 additional answers

Your answer