Consuming Databricks Endpoints in a Microsoft-hosted build pipeline agent

Question

How do I consume Databricks API endpoints in my Microsoft-hosted build pipeline agent without the need for an Azure VPN connection?

Answer 1

Hello Jonathan Slaven,

You have 2 options to connect internally with a private connection to Azure Databricks APIs . Both require enabling Databricks Private endpoint databricks_ui_api (https://learn.microsoft.com/en-us/azure/databricks/security/network/classic/private-link#step-3-create-subnet-and-private-endpoints):

• Create the communication path to your vnet with the Private endpoint , this is the best way if you already have an express route circuite or an VPN connection from your Azure Devops hosted Agent network.
• Locate a Azure devops hosted agent on your vnet, This could be an azure virtual machine or another service with network integration. (https://learn.microsoft.com/en-us/azure/devops/pipelines/agents/agents?view=azure-devops&tabs=yaml%2Cbrowser)

Let me know if this help you.

Luis,

---

If the information helped address your question, please Accept the answer.