question

81428277 avatar image
0 Votes"
81428277 asked 81428277 commented

Azure Service Fabric Balance your traffic

Hi,

We have a problem statement i.e. We are using Azure Service Fabric for our production. We have service fabric with Silver Tier. Our issue is when a single instance gets Spike i.e. due to High CPU utilization and Memory. Load balancer is unable to transfer request to other nodes. Single node get 90 percent utilization and we are even unable to RDP that node during that time.

I have seen articles from Microsoft about adding placement constraints. Still that didn't work either. We are unable to apply rules to load balancer as we have integrated APIM with Service Fabric.

I know we have issue in one of our services we are already working on it but we need SF to handle this scenario as well.

Secondly

               I found another article regarding Balancing Your Service Fabric 

Link


https://docs.microsoft.com/en-us/azure/service-fabric/service-fabric-cluster-resource-manager-balancing

In this article i found Balancing Thresholds i need understanding how to calculate value to be defined in Metrics. So that cluster automatically perform balancing.

azure-service-fabric
· 3
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@AhmadHassan-5478
Apologies for delayed response on this.

For your queries:
In this article I found Balancing Thresholds, I need understanding how to calculate value to be defined in Metrics. So that cluster automatically perform balancing.
Please check this document that can help here.

Load balancer is unable to transfer request to other nodes.
Looks like you are trying to setup traffic balancing across the set of available services, for which Azure Load Balancer component should be used. Service Fabric Cluster Resource Manager component doesn’t balance traffic across services, but it can be configured to balance services across nodes in the SF cluster.



0 Votes 0 ·

@AhmadHassan-5478

Can you please add more context on your issue to assist you better. Please provide details for below questions:

  • Are you trying to rebalance services across other nodes or redirect traffic that is coming in through a load balancer to different endpoints that have less load or.. both?

  • Adding placement constraints didn’t give you the result you were expecting or did something else fail here? Can you elaborate? Are you referring to SF placement load balancer in this context or something else?

0 Votes 0 ·

Hi @vipullag-MSFT
Let me elaborate my problem statement. We have a service fabric Cluster setup for our production instance. We have regular spikes on a single node the spike on a node goes to 90 percent. and when we monitor other nodes they are all at very low CPU usage. I need to setup a load balancer in such a way that when ever a spike occurs on a node based on CPU usage it should transfer the traffic to other nodes. which have low CPU usage.

Below Methods i tried so far

  1. Applying rules to load balancer based on my backend services it didn't work because our calls goes through APIM.

  2. Setting up secondary nodes.


  3. Applying Balancing Thresholds this i am unable to do because i didn't get any mechanism how can i setup metrics for CPU usage, i did
    follow the this article already but didn't get much information.


Currently I am stuck as i cannot get any solution working for me.










0 Votes 0 ·

0 Answers