Access Azure Container Registry (ACR) with KubernetesPodOperator in Managed Airflow

Mark 26 Reputation points
2023-05-11T10:09:46.7566667+00:00

Airflow docs says that to have KubernetesPodOperator pull from a private registry, you must create a Kubernetes Secret that represents the credentials for accessing images from the private registry: https://airflow.apache.org/docs/apache-airflow-providers-cncf-kubernetes/stable/operators.html#how-to-use-private-images-container-registry

They give an example using kubectl. How can this be accomplished ADF Managed Airflow where you don't have direct access to this?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,866 questions
{count} votes

Accepted answer
  1. Jorge Avelar-Lopez 80 Reputation points Microsoft Employee
    2023-05-17T16:56:36.5866667+00:00

    Hey Mark, to pull from a private registry in ADF Managed Airflow, do the following using the ADF Airflow UI:

    1. Add the feature flag to url: “feature.airflowSecrets=true” 
    2. While creating/editing Airflow IR, click “New” under the “Kubernetes secrets” section 
    3. Choose “Private registry auth” for “secret type” 
    4. Fill out the rest of the fields with private registry information 

    That will create a Kubernetes Secret with the credentials to access images from private registries

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful