I want to migrate my data from Google Big Query into Azure - what would be the best service to use for this?

Question

We have a bunch of tables in GBQ - that are being read through a django backend using defined SQL statements in GBQ and displayed on a react front end.

I want to move our database into azure and unfortunately it doesn't look like Azure Cosmos DB is a good option and Synapse lacks the speed and Azure SQL is a little too expensive in comparison. I don't want to lose our work in developing the SQL statements.

What would you suggest we do, leave it in GBQ, or is there a good way to do this migration.

Answer 1

Hello @Anonymous

One way to migrate data from Google BigQuery to Azure is by using Azure Data Factory. Azure Data Factory is a cloud-based data integration service that allows you to create, schedule, and orchestrate data pipelines. You can use the Copy Activity in a Data Factory pipeline to copy data from Google BigQuery to any supported sink data store in Azure.

Another option is to use Azure Synapse Analytics, which is an analytics service that brings together big data and data warehousing. You can use the PolyBase feature in Azure Synapse to load data from Google Cloud Storage into Azure Synapse.

i hope this info helps you further