Hybrid HPC in Azure with HPC Pack

Virtual Machines
Windows Server

Solution ideas

This article is a solution idea. If you'd like us to expand the content with more information, such as potential use cases, alternative services, implementation considerations, or pricing guidance, let us know by providing GitHub feedback.

Microsoft HPC Pack is a free high-performance computing (HPC) solution built on Microsoft Azure and Windows Server technologies. HPC Pack combines a comprehensive set of deployment, administration, job scheduling, and monitoring tools for your Windows and Linux HPC cluster environment, providing a flexible platform for developing and running HPC applications on premises and in Azure.

Potential use cases

This solution shows the process for using HPC Pack to create a hybrid (on-premises and Azure) HPC environment.

The links below provide documentation on deploying and managing the Azure products that are included in this solution idea:

Architecture

Architecture Diagram Download an SVG of this architecture.

Dataflow

  1. Log in to an on-premises head node.
  2. Add Azure compute nodes to the cluster.
  3. Start the compute nodes.
  4. Submit jobs to the cluster.
  5. HPC Pack sends jobs to on-premises and Azure nodes, based upon the node group selected.
  6. Monitor the job progress.
  7. Stop the compute nodes or configure autoscaling.

Components

  • Virtual Machines: Create Linux and Windows virtual machines in seconds.
  • Microsoft HPC Pack: Free high-performance computing (HPC) solution built on Microsoft Azure and Windows Server technologies.

Next steps