Share via

can we connect ADF with Databricks hosted on AWS?

sayantika sur 0 Reputation points
2024-12-11T04:45:42.4033333+00:00

can we connect ADF with Databricks hosted on AWS? Or it is required to use Azure Databricks to connect to ADF.

By using Access Token trying to connect ADF with Databricks(hosted on AWS) to execute the Notebooks, but getting "Loading Failed" under "Cluster Version"

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,624 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Gowtham CP 6,020 Reputation points Volunteer Moderator
    2024-12-11T05:43:18.5333333+00:00

    Hi sayantika sur ,

    Thank you for reaching out on the Microsoft Q&A

    No, ADF doesn’t directly integrate with AWS Databricks. You can use workarounds like a self-hosted Integration Runtime with ODBC or HTTP connectors or third-party tools like CData Software, but these require extra setup. The "Loading Failed" error likely occurs because ADF expects Azure-specific cluster details. For smoother integration, Azure Databricks is a better option.  

    I hope this helps! If you have any further questions, feel free to ask.

    If the information is useful, please accept the answer and upvote it to assist other community members.

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.