Spark Structured Streaming Azure Service Bus

Question

Spark Structured Streaming Azure Service Bus

Yennam, ShowryPremsagar 41

Could someone clarify me ,whether Azure Service Bus queues cab be accessed using this API or not? Please Suggest the relevant doc

Yennam, ShowryPremsagar 41 Reputation points

2020-10-05T10:39:31.55+00:00

Note , I would like to connect to Azure Servicee Bus Queues not EEventhub with a topic
Pramod Valavala 20,656 Reputation points Microsoft Employee Moderator

2020-10-05T14:04:33.047+00:00

Just to make sure I understand correctly, you are trying to read from Event Hubs using the Spark Streaming API and write to a Service Bus Topic?
Yennam, ShowryPremsagar 41 Reputation points

2020-10-05T14:05:48.247+00:00

No . I just want to read events from Azure Service Bus using structured streaming

Accepted answer

0 additional answers

Your answer

Yennam, ShowryPremsagar 41 Reputation points

2020-10-05T10:39:31.55+00:00

Note , I would like to connect to Azure Servicee Bus Queues not EEventhub with a topic
Pramod Valavala 20,656 Reputation points Microsoft Employee Moderator

2020-10-05T14:04:33.047+00:00

Just to make sure I understand correctly, you are trying to read from Event Hubs using the Spark Streaming API and write to a Service Bus Topic?
Yennam, ShowryPremsagar 41 Reputation points

2020-10-05T14:05:48.247+00:00

No . I just want to read events from Azure Service Bus using structured streaming

Answer 1

Pramod Valavala 20,656 Microsoft Employee Moderator

Looks like there is no readily available connector likely since Service Bus is not designed with this in mind, unlike Event Hubs. But it should be possible to write your own receiver (like this one).

Another alternative would be to immediately forward messages from Service Bus to a compatible source like Event Hubs using something simple like Azure Functions.

Sonam Jain 1 Reputation point Microsoft Employee

2021-04-28T15:25:57.377+00:00

Is it possible to write structured streaming output to Azure Service Bus. If yes, please let me know how to achieve this. Thanks!
Pramod Valavala 20,656 Reputation points Microsoft Employee Moderator

2021-04-29T07:44:23.687+00:00

anonymous user Like my answer mentions, it should be possible but has to be implemented and a connector is not readily available to just use.

Share via

Spark Structured Streaming Azure Service Bus

0 additional answers

Your answer