Impossible to LOAD a Bigquery SQL RAW Table via ADF copy task

Question

Impossible to LOAD a Bigquery SQL RAW Table via ADF copy task

HERVOUET Christophe (External) 126

topic : Impossible to LOAD a Bigquery SQL RAW Table via ADF copy task

HI

I discovered with "horror" that we cannot use ADF to load Bigquery tables

Apparently , we cannot make a SINK dataset that points to our Biquery linked service
We can make a BQ source dataset but not a sink (destination) one
What a pity

Do you know please , when it will be possible to load BQ ?
Is it planned or never , we can forget this idea ;>) ?

Thanks a lot for any response & best regards

Christophe

1 answer

Your answer

Answer 1

ShaikMaheer-MSFT 38,546 Microsoft Employee Moderator

Hi @HERVOUET Christophe (External) ,

Thank you for posting query in Microsoft Q&A Platform.

Yes, you are right. Currently Google BigQuery connector in Azure data factory supports as source only. As sink its not supported yet. Click here to know more about Google BigQuery connector

I encourage you to submit and up-vote feedback Item for this capability to enable in below portal. Product team closely monitors feedbacks and consider them for future implementations. Once, you submit feedback item feel free to share link here. So that other community members also can up-vote on it. Thank you.
https://feedback.azure.com/d365community/forum/1219ec2d-6c26-ec11-b6e6-000d3a4f032c

Please Note, I taken this feedback offline to Internal team from my end too.

Hope this helps.

------------

Please consider hitting Accept Answer button. Accepted answers help community as well.

Christophe Hervouet 1 Reputation point

2022-09-15T12:37:15.693+00:00

This is the IDEA

Don't hesitate to vote , please :

https://feedback.azure.com/d365community/idea/6d2e765e-e334-ed11-a81b-000d3a7b5d8c
ShaikMaheer-MSFT 38,546 Reputation points Microsoft Employee Moderator

2022-09-15T14:09:42.537+00:00

Hi @HERVOUET Christophe (External) , Thank you for submitting and sharing feedback link here. I up-voted same. Please Note, I have also taken this feedback to internal team from my end too.
Since there is no out of box option is available for Bigquery as sink. I would encourage you to consider writing your own custom code and for your use case and make use of custom activity in ADF.

To move data to/from a data store that the service does not support, or to transform/process data in a way that isn't supported by the service, you can create a Custom activity with your own data movement or transformation logic and use the activity in a pipeline. The custom activity runs your customized code logic on an Azure Batch pool of virtual machines.

Hope this helps. Please consider hitting Accept Answer button. Accepted answers help community as well.

Share via

Impossible to LOAD a Bigquery SQL RAW Table via ADF copy task

1 answer

Your answer