Build real-time pipeline from azure bus service to google big query table

Question

I would like to design the pipeline which gets data from the Azure Bus service to Google Big query table.

I have the Connection string of the Azure bus service and other details required for building the pipeline.

Is there any way to design the pipeline for real-time streaming from the Azure bus service to the Google Big Query table?

Answer 1

Hello @HEMANATH GOUD KANDULA ,
Thanks for the question and using MS Q&A platform.

As we understand the ask here is how to stream data from ASB to Google big query table, please do let us know if its not accurate.
Since You have tagged ADF , let me start with the fact that ADF is not the correct tool for real time streaming . I suggest , you can explore Azure databricks for the same . The other product whcih you can try is Azure stream anaytics , but it does not have support for big query as sink , you can write to blob and then read it .
Please do let me if you have any queries.
Thanks
Himanshu

---

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators