Manage cluster pools

Cluster pools are a logical grouping of clusters and maintain a set of clusters in the same pool. It helps in building robust interoperability across multiple cluster types and allow enterprises to have the clusters in the same virtual network. One cluster pool corresponds to one cluster in AKS infrastructure.

This article describes how to manage a cluster pool.

Note

You are required to have an operational cluster pool, Learn how to create a cluster pool.

Get started

  1. Sign in to Azure portal.

  2. In the Azure portal search bar, type "HDInsight on AKS cluster pool" and select "Azure HDInsight on AKS cluster pools" from the drop-down list.

    Screenshot showing search option for getting started with HDInsight on AKS Cluster pool.

  3. Select your cluster pool name from the list page.

    Screenshot showing cluster pools in a list view.

Create new cluster

In a cluster pool, you can add multiple clusters of different types. For example, you can have a Trino cluster and an Apache Flink cluster inside the same pool.

To create a new cluster, click on the +New cluster on the Azure portal and continue to use the Azure portal to create a Trino, Apache Flink, and Apache Spark cluster.

Learn more on how to create a cluster.

Screenshot showing create new cluster option.

View the list of existing clusters

You can view the list of clusters in the cluster pool on the Overview tab.

Screenshot showing list of existing clusters.

Manage access to the cluster pool

HDInsight on AKS supports both Azure built-in roles and certain roles specific to HDInsight on AKS. In the Azure portal, you can use Access control (IAM) blade in your pool to manage the access for cluster pool’s control plane.

For more information, see manage access.

Enable integration with Azure services

In the Azure portal, use Monitor settings blade in your cluster pool to configure the supported Azure services. Currently, we support Log Analytics and Azure managed Prometheus and Grafana, which has to be configured at cluster pool before you can enable at cluster level.

Delete cluster pool

Deleting the cluster pool deletes the following resources:

  • All the clusters that are part of the cluster pool.
  • Managed resource groups created during cluster pool creation to hold the ancillary resources.

However, it doesn't delete the external resources associated with the cluster pool or cluster. For example, Key Vault, Storage account, Monitoring workspace etc.

Each cluster pool version is associated with an AKS version. When an AKS version is deprecated, you'll be notified. In this case, you need to delete the cluster pool and recreate to move to the supported AKS version

Note

You can't recover the deleted cluster pool. Be careful while deleting the cluster pool.

  1. To delete the cluster pool, click on "Delete" at the top left in the "Overview" blade in the Azure portal.

    Screenshot showing how to delete cluster pool.

  2. Enter the pool name to be deleted and click on delete.

    Screenshot showing how to delete cluster pool, and updating your cluster pool name once you click delete.

Once the deletion is successful, you can check the status by clicking Notifications icon Screenshot showing the Notifications icon in the Azure portal. in the Azure portal.

Screenshot showing a notification alert of a cluster pool deletion successful.