Replication between two storage accounts in different regions, must be read/writeable and zone redundant

Richard Duane Wolford Jr 201 Reputation points
2021-08-31T17:39:54.163+00:00

We are setting up an active/active configuration using either front door or traffic manager as our front end. Our services are located in both Central and East US 2 paired regions. There is an AKS cluster in each region. The AKS clusters will write data to a storage account located in their region. However, the files in the storage accounts must be the same in each region. The storage accounts must be zone redundant and read/writeable in each region at all times, thus none of the Microsoft replication strategies work. This replication must be automatic, we can't have any manual process to do the copy. I looked at Data Factory but it seems to be regional, so I don't think that would work, but it's a possibility....maybe. Does anyone have any suggestions on the best way to accomplish this task?

Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
2,687 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,544 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. HimanshuSinha-msft 19,376 Reputation points Microsoft Employee
    2021-09-01T18:30:28.43+00:00

    Hello @richardwolford-7948 ,
    Thanks for the ask and using the Microsoft Q&A platform .
    Since you mentioned that the you have an active-active setup , so

    • the files needs to copied from cluster 1-> cluster 2 and also cluster 2 ->cluster 1.
    • Since its a active-active setup the latency between the clusters should be minmum .

    I see few challenges using ADF . In ADF to copy the files you will have to initiate a pipeline , the pipeline can be intitiated using triggers . Since we want to have the latency low , I think event trigger is the way to go . Please do read out about the event trigger here . Please do focus on the pt#6 .

    I have never implemented anything like that , but I have a strong feeling that ADF is not the right tool for the solution .

    @Sumarigo-MSFT : Do you think there is some other thing which @richardwolford-7948 can use .

    Thanks
    Himanshu
    Please do consider clicking on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members