Is it possible to upgrade the Airflow version of a Workflow Orchestration Manager while it is running?

aeteq 0 Reputation points
2024-07-03T10:40:56.18+00:00

Currently, only 2.6.3 is available to choose, but when newer versions become available, what is the upgrade path for existing instances? Is it always required to create a completely new instance when upgrading? How would you preserve the Meta-DB with the execution history while upgrading?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,701 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Bhargava-MSFT 31,021 Reputation points Microsoft Employee
    2024-07-03T17:28:28.32+00:00

    Hello aeteq,

    from the Microsoft official document,

    Azure Data Factory Managed Airflow periodically provide new versions of Apache Airflow. The ADF Managed Airflow team will auto-update and patch the minor versions.

    This means that you do not need to worry about upgrading to the latest version while running the airflow, as the ADF team will take care of version upgrades.

    However if there is a need for manual upgrades, ADF team will publish documentation for the same.

    https://techcommunity.microsoft.com/t5/azure-data-factory-blog/introducing-workflow-orchestration-manager-powered-by-apache/ba-p/3730151

    I hope this answers your question. Please let me know if you have any further questions.

    1 person found this answer helpful.

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.