How to perform Azure Data Factory Disaster Recovery (BCDR) / (ADF)

Question

I wanted to know the right method to create a Disaster Recovery for my ADF

 

My case is :

 

I have a ADF1 whish is using SHIR in VM1 , I have enabled Git Integration in the ADF.

 

Then , I create ADF2 in other region and replicated the VM1 in second region as well. Linked ADF2 to same Azure DevOps and got the pipelines. Replication got me the same SHIR in VM2 as well.

 

 

 

So incase of a region failure  if my ADF1 is unreachable or gets deleted  (which is linked with SHIR in VM1 ) , then  will  i be able  to connect to the SHIR with ADF2 ?

 

If ADF1 and VM1 both gets deleted or unreachable , will i able to perform tasks with ADF2 and VM2.

 

 

 

 

Will this solution works  in case of region failure ?

 

If not, then what should I do ?

Answer 1

Hello , Welcome to MS Q&A

To create a Disaster Recovery (DR) setup for your Azure Data Factory (ADF) with Self-hosted Integration Runtime (SHIR), you need to ensure that the SHIR is properly configured to work with both ADF instances. Here are the steps to achieve this:

Enable Git Integration: Ensure that both ADF1 and ADF2 are linked to the same Azure DevOps repository. This allows you to synchronize the pipelines and other configurations between the two ADF instances.

Replicate SHIR: You have already replicated the VM1 to the second region, creating VM2 with the same SHIR configuration. This is a crucial step to ensure that the SHIR is available in both regions.

Register SHIR with ADF2: To ensure that ADF2 can connect to the SHIR in VM2, you need to register the SHIR with ADF2. Follow these steps:

• Open the Azure Data Factory (ADF2) in the Azure portal.
  • Go to the "Manage" section and select "Integration Runtimes."
    • Click on "New" and choose "Self-hosted" as the type.
      • Follow the instructions to download and install the SHIR on VM2.
        • During the installation, provide the authentication key from ADF2 to register the SHIR with ADF2.
        Test the DR Setup: To ensure that the DR setup works as expected, you can simulate a failure of ADF1 and verify that ADF2 can still connect to the SHIR in VM2 and execute the pipelines.

By following these steps, you can create a robust Disaster Recovery setup for your Azure Data Factory with Self-hosted Integration Runtime, ensuring continuity in case ADF1 becomes unreachable or gets deleted.

References:

• Azure Data Factory data redundancy
• Using source control in Azure Data Factory
• Customer enabled disaster recovery
• Configure Azure-SSIS integration runtime for business continuity and disaster recovery (BCDR)

Please let me know if any questions

Kindly accept if it works

Thanks

Deepanshu