Does data transfer between Azure databricks control and data plane takes over private endpoint or public internet?

saurabh 356 Reputation points
2023-08-11T03:25:12.3133333+00:00

Does data transfer between Azure databricks control(Databricks cloud tenant) and data plane(customer cloud tenant) takes over private endpoint or public internet?

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,223 questions
0 comments No comments
{count} votes

Accepted answer
  1. PRADEEPCHEEKATLA 90,236 Reputation points
    2023-08-11T06:33:36.6033333+00:00

    @saurabh - Thanks for the question and using MS Q&A platfrom.

    Azure Databricks supports both public and private endpoints for data transfer between the control plane and data plane.

    If you use a public endpoint, data transfer occurs over the public internet. If you use a private endpoint, data transfer occurs over a private peering link.

    To use a private endpoint, you need to configure a private link service in your Azure virtual network and then create a private endpoint for Azure Databricks. Once the private endpoint is created, you can use it to access Azure Databricks workspaces and clusters securely over the private peering link.

    Although architectures can vary depending on custom configurations (such as when you’ve deployed an Azure Databricks workspace to your own virtual network, also known as VNet injection), the following architecture diagram represents the most common structure and flow of data for Azure Databricks.

    Diagram: Databricks architecture on Azure

    By default, every Azure Databricks deployment creates a locked virtual network (VNet) in your Azure subscription. All clusters are created in that virtual network.

    Azure Databricks network architecture

    You can find more information about Azure Databricks architecture overview and Enable Azure Private Link.

    Hope this helps. Do let us know if you any further queries.


    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.