Azure Event Hubs
An Azure real-time data ingestion service.
719 questions
Realtime time data from on premise databases
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(80, 44%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKC%3C/text%3E%3C/svg%3E)
Kuldeep Chitrakar
1
Reputation point
Hi
Suppose I have 8 databases on premise and if i want to implement the lambda architecture then How can i ETL the data from these on-premise databases into cloud databases/storage in realtime.
- Can i use the Event hub for this?
- Is there any better approach to do this
- do i need to write producer app too for event hub to stream realtime on-premise relational data to cloud
Azure Event Hubs
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 70%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
MartinJaffer-MSFT 26,236 Reputation points2020-09-22T22:32:50.873+00:00 Hello @Kuldeep Chitrakar and welcome to Microsoft Q&A.
Before I can give you a good answer, I need to know more about your situation and goals.
ETL stands for Extranct Transform Load. What transformations are you looking to do, or do you just want to move/copy the data to cloud? Also, what sort of sink are you planning to use?While Event hub is one approach,The approach depends upon the details of your needs.
If your source databases are SQL, there are two features you should look into. "Data sync" and "Transactional replication".
-
MartinJaffer-MSFT 26,236 Reputation points
2020-09-24T19:40:49.637+00:00 @Kuldeep Chitrakar did you get a chance to review my suggestion or get more details on your requirements?
-
MartinJaffer-MSFT 26,236 Reputation points
2020-09-25T19:14:42.01+00:00 I haven't heard back from you, @Kuldeep Chitrakar . Are you still in need of assistance?
If you found your own solution, could you please share it here to benefit the community?Thank you.
Sign in to comment
Sign in to answer