Stuctured streaming databricks pipeline

Question

For Batch we can use ADF and Databricks Activity and create CICD pipeline. How can I create a structured streaming pipeline using Azure event hub and Azure databricks with CICD

Answer 1

Hello @Abhijeet Singh ,

Apologies for the delay in response.

That should be possible, have you considered using Process streaming data with Delta Live Tables and Workflow orchestration via ADF: Run a Delta Live Tables pipeline in a workflow

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is jhow you can be part of Q&A Volunteer Moderators