Suggest solution for reading data from Azure Service Bus with Azure Data Factory

Mohsen Akhavan 811 Reputation points
2021-06-07T08:26:09.99+00:00

Hi,

I need a suggestion about the below scenario.
I receive data every second on Azure Service Bus. Now, I want Azure Data Factory to fetch this data and run the ML model on data.
As I checked there isn't a link between Azure Service Bus and Azure Data Factory.
What is the solution for this scenario?

Azure Service Bus
Azure Service Bus
An Azure service that provides cloud messaging as a service and hybrid integration.
684 questions
Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,243 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,447 questions
{count} votes

1 answer

Sort by: Most helpful
  1. MayankBargali-MSFT 70,896 Reputation points
    2021-06-08T01:51:24.013+00:00

    @Mohsen Akhavan Sharing previous Q&A discussion on the same.

    <SNIP>

    Data Factory does not have a connector for Service bus. However there are several options available to you.

    • You can create a consumer for Data Factory to call upon.
    • You can raise a feature request in the feedback forum.
    • You could re-route your messages to be written to blob, and then leverage the Blob Event Trigger.
    • Use ADF Web Activity to retrieve a message.

    By "create a consumer for Data Factory to call upon," I mean either create a Function App which batch-reads the messages, and returns them, utilizing ADF Azure Function, or , create some code to do the same with the ADF Batch Service Custom Activity. There are more variations as well.

    Which one to use, depends upon your volume and cadence (frequency).

    Please let me know if you desire more information.

    </SNIP>

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.