Share via

What is the impact of Databricks IP allow/denylists on orchestration using ADF/Synapse

wout 1 Reputation point
2022-07-28T09:17:09.643+00:00

Databricks jobs are often scheduled using Azure Data Factory and/or Synapse.
What is the impact of Databricks IP access lists on this orchestration? Can we add service tags to the whitelist to allow ADF?

Thanks for elaborating.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,471 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,970 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,750 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. KranthiPakala-MSFT 46,427 Reputation points Microsoft Employee
    2022-07-29T18:04:14.413+00:00

    Hello @wout ,

    Thanks for the question and using MS Q&A platform.

    As per my understanding, you would like to utilize IP access list feature in Databricks and would like to understand what its impact will be when you try to execute Databricks jobs using ADF/Synapse pipelines. Please correct me if I am not accurate.

    Ip access list feature only support public IP address and does not support VNet, service tag and etc. For ADF/Synapse if you are using self-hosted IR, then you are able to have a fixed public IP and hence allow that IP in the IP access list.

    Hope this info helps. Do let us know if you have further query.

    0 comments