Nodes Details in Azure Hbase

Question

Which node is better to process 1.5 millions records daily where total size of storage is 10tb.

Its there any way to auto-scale Hbase cluster as there will be only 1 to 2 transaction a day but data size will be large.

Answer 1

Hello @Sarvesh Pandey ,

This article discusses how to select the right VM size for the various nodes in your HDInsight cluster.

Azure HDInsight's free Autoscale feature can automatically increase or decrease the number of worker nodes in your cluster based on previously set criteria. The Autoscale feature works by scaling the number of nodes within preset limits based on either performance metrics or a schedule of scale-up and scale-down operations.

The Autoscale feature uses two types of conditions to trigger scaling events:

Thresholds for various cluster performance metrics (called load-based scaling):

Load-based scaling changes the number of nodes in your cluster, within a range that you set, to ensure optimal CPU usage and minimize running cost.

Time-based triggers (called schedule-based scaling):

Schedule-based scaling changes the number of nodes in your cluster based on a schedule of scale-up and scale-down operations.

The following table describes the cluster types and versions that are compatible with the Autoscale feature.

Note: HBase clusters can only be configured for schedule-based scaling, not load-based.

Reference: Automatically scale Azure HDInsight clusters

Hope this helps. Do let us know if you any further queries.

------------

• Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
• Want a reminder to come back and check responses? Here is how to subscribe to a notification.