Azure HDInsight versions

HDInsight bundles open-source components and HDInsight platform into a package that is deployed on a cluster. For more information, see how HDInsight versioning works.

Supported HDInsight versions

This table lists the versions of HDInsight that are available in the Azure portal and other deployment methods like PowerShell, CLI and the .NET SDK.

HDInsight version VM OS Release date Support type Support expiration date Retirement date High availability
HDInsight 5.0 Ubuntu 18.0.4 LTS July 01, 2022 Standard See HDInsight 5.0 for date details. See HDInsight 5.0 for date details. Yes
HDInsight 4.0 Ubuntu 18.0.4 LTS September 24, 2018 Standard See HDInsight 4.0 for date details. See HDInsight 4.0 for date details. Yes

Support expiration means that Microsoft no longer provides support for the specific HDInsight version. You may not be able to create clusters from the Azure portal.

Retirement means that existing clusters of an HDInsight version continue to run as is. New clusters of this version can't be created through any means, which includes the CLI and SDKs. Other control plane features, such as manual scaling and autoscaling, aren't guaranteed to work after retirement date. Support isn't available for retired versions.

Support options for HDInsight versions

Support is defined as a time period that an HDInsight version is supported by Microsoft Customer Service and Support. HDInsight offers two types of support:

  • Standard support
  • Basic support

Standard support

Standard support provides updates and support on HDInsight clusters. Microsoft recommends building solutions using the most recent fully supported version.

Standard support includes

  • Ability to create support requests on HDInsight 4.0 clusters.
  • Support for troubleshooting solutions built on 4.0 clusters.
  • Requests to restart services or nodes.
  • Root cause analysis investigations on support requests.
  • Root cause analysis or fixes to improve job or query performance.
  • Root cause analysis or fixes to improve customer-initiated changes, for example, changing service configurations or issues due to custom script actions.
  • Product updates for critical security fixes until version retirement.
  • Scoped product updates to the HDInsight Resource provider.
  • Selective fixes or changes to HDInsight 4.0 images or open-source software (OSS) component versions.

Basic support

Basic support provides limited servicing to the HDInsight Resource provider. HDInsight images and open-source software (OSS) components won't be serviced. Only critical security fixes will be patched on HDInsight clusters.

Basic support includes

  • Continued use of existing HDInsight 3.6 clusters.
  • Ability for existing HDInsight 3.6 customers to create new 3.6 clusters.
  • Ability to scale HDInsight 3.6 clusters up and down via autoscale or manual scale.
  • Scoped product updates to the HDInsight Resource provider.
  • Product updates for critical security fixes until version retirement.
  • Ability to create support requests on HDInsight 3.6 clusters.
  • Requests to restart services or nodes.

Basic support doesn't include

  • Fixes or changes to HDInsight 3.6 images or open-source software (OSS) component versions.
  • Support for troubleshooting solutions built on 3.6 clusters.
  • Adding new features or functionality.
  • Support for advice or ad-hoc queries.
  • Root cause analysis investigations on support requests.
  • Root cause analysis or fixes to improve job or query performance.
  • Root cause analysis or fixes to improve customer-initiated changes, for example, changing service configurations or issues due to custom script actions.

Microsoft doesn't encourage creating analytics pipelines or solutions on clusters in basic support. We recommend migrating existing clusters to the most recent fully supported version.

HDInsight 3.6 to 4.0 Migration Guides

Release notes

For extra release notes on the latest versions of HDInsight, see HDInsight release notes.

Versioning considerations

  • Once a cluster is deployed with an image, that cluster isn't automatically upgraded to newer image version. When you create new clusters, most recent image version will be deployed.
  • Customers should test and validate that applications run properly when using new HDInsight version.
  • HDInsight reserves the right to change the default version without prior notice. If you have a version dependency, specify the HDInsight version when you create your clusters.
  • HDInsight may retire an OSS component version before retiring the HDInsight version.

Next steps