ASB topic shared subscription for multi instance

Sivaranjani N 0

What is the difference between subscription and shared subscription in topic ?

I have a scenario where my application scale-out automatically which is subscribed to topic A .

Expectation is to receive topic message in all instances(As per application design). but currently only one instance getting message. how to create dynamic subscription ?

using camel-jms , camel-amqp

MayankBargali-MSFT 70,016 Reputation points

2023-03-15T11:14:50.8833333+00:00

@Sivaranjani N Thanks for reaching out. Can you share more details about how you are consuming message from subscription and which language you are using. In azure service bus there are JMS subscription which are shared/unshared durable/non-durable subscription as document here. If you are not using the JSM client and using any other services, then it would be azure topic subscription model as documented here.

Sivaranjani N 0

@MayankBargali-MSFT I am using camel-jms.

is there any way to receive same message in multiple instances ? without creating multiple subscription upfront ?

Send (msg-1) to Topic-A 
   sub-A is created under Topic A 
	 ---- app1-- listening to sub A- (msg-1)
	 ---- app2 - listening to sub A- (msg-1)
	 -----app3 - listening to sub A- (msg-1)
	 -----app4 - listening to sub A- (msg-1)

irrespective of language, above scenario supported ?

if not , is there any way to create subscription dynamically without creating upfront in azure portal ?

<route id="Cons_ReloadCache">
<from uri="asb:topic:vpe1.cachereload?concurrentConsumers=1&amp;durableSubscriptionName=&amp; clientId=<clientID>&ampsubscriptionShared=true"/>
<to uri="file:..//outputs//topiccontent"/>
 </route>

        <property name="remoteURI" ref="asb_remoteURI"/> 
        <property name="username" ref="asb_username"/>
        <property name="password" ref="asb_password"/>
        <property name="receiveLocalOnly" value="true" />
		<property name="clientID" ref="asb_clientID" />
    </bean>		
	<bean id="asb-connection-factory" class="org.springframework.jms.connection.CachingConnectionFactory">
		<property name="targetConnectionFactory" ref="asb-connection-factory-prime" />
	</bean>	
	<bean id="asb-configuration" class="org.apache.camel.component.jms.JmsConfiguration" >
		<property name="connectionFactory" ref="asb-connection-factory" />
		<property name="cacheLevelName" value="CACHE_AUTO" />
	</bean>	
	<bean id="asb" class="org.apache.camel.component.amqp.AMQPComponent">
		<property name="configuration" ref="asb-configuration" />
	</bean>

1 answer

MayankBargali-MSFT 70,016 Reputation points

2023-03-20T04:59:49.5766667+00:00
@Sivaranjani N For service bus only one application can consume the same message from the same entity.

if not , is there any way to create subscription dynamically without creating upfront in azure portal ?

You can create the subscription on the fly using the REST API, or the SDK

As per your below scenario if you want multiple applications to read the same message/event from the same entity, then you should leverage the event hub rather than service bus.

Send (msg-1) to Topic-A sub-A is created under Topic A ---- app1-- listening to sub A- (msg-1) ---- app2 - listening to sub A- (msg-1) -----app3 - listening to sub A- (msg-1) -----app4 - listening to sub A- (msg-1)

Any number of applications can read the same event and use checkpointg feature where readers mark or commit their position within a partition event sequence.
Please sign in to rate this answer.
Sivaranjani N 0 Reputation points

2023-03-20T12:16:25.9166667+00:00

@MayankBargali-MSFT
camel-azure-servicebus does this camel component supports creating dynamic subscription for a topic in ASB ?

Azure-servicebus-jms As mentioned in this URL, using ServiceBusJmsConnectionFactory will create dynamic subscription ?

Same feature(sending same message to all instances) we are able to achieve in AcitveMQ using CachingConnectionFactory in spring-jms with camel-jms ?

we cannot use event hub for our scenario.

Sivaranjani N 0 Reputation points

2023-03-21T12:54:25.0966667+00:00

@MayankBargali-MSFT
camel-azure-servicebus does this camel component supports creating dynamic subscription for a topic in ASB ?

Azure-servicebus-jms As mentioned in this URL, using ServiceBusJmsConnectionFactory will create dynamic subscription ?

Same feature(sending same message to all instances) we are able to achieve in AcitveMQ using CachingConnectionFactory in spring-jms with camel-jms ?

we cannot use event hub for our scenario.

MayankBargali-MSFT 70,016 Reputation points

2023-03-23T12:38:54.1633333+00:00

@Sivaranjani N Apology for the delay. As per the camle JMS document I don't see any documentation from their end I don't see any method. Azure Service Bus JMS library does support it as it is supported by Microsoft end. I don't see any support on the camel SDK that is documented here at their end. I will reach out to my team to confirm if anyone has any insights, but camel SDK support team should confirm if they support dynamic subscription creation from their SDK end.

Sivaranjani N 0 Reputation points

2023-03-23T14:23:07.9933333+00:00

thanks @MayankBargali-MSFT . our application integration layer is based on camel. i wanted to understand whether this is possible with camel-azure service bus https://camel.apache.org/components/3.20.x/azure-servicebus-component.html

MayankBargali-MSFT 70,016 Reputation points

2023-03-27T08:01:30.2666667+00:00

@Sivaranjani N I have reached out to my team if someone can share insights on this but looking into the document https://camel.apache.org/components/3.20.x/azure-servicebus-component.html from apache end I don't see any configuration that this is supported at their end.
Sign in to comment

Share via

ASB topic shared subscription for multi instance

1 answer