HDInsight 5.x component versions
In this article, you learn about the open-source components and their versions in Azure HDInsight 5.x.
Open-source components available with HDInsight 5.x
The following table lists the versions of open-source components that are associated with HDInsight 5.x.
| Component | HDInsight 5.1 | HDInsight 5.0 |
|---|---|---|
| Apache Spark | 3.3.1 | 3.1.3 |
| Apache Hive | 3.1.2 | 3.1.2 |
| Apache Kafka | 3.2.0 | 2.4.1 |
| Apache Hadoop | 3.3.4 | 3.1.1 |
| Apache Tez | 0.9.1 | 0.9.1 |
| Apache Ranger | 2.3.0 | 1.1.0 |
| Apache HBase | 2.4.11 | 2.1.6 |
| Apache Oozie | 5.2.1 | 4.3.1 |
| Apache ZooKeeper | 3.6.3 | 3.4.6 |
| Apache Livy | 0.5. | 0.5 |
| Apache Ambari | 2.7.3 | 2.7.3 |
| Apache Zeppelin | 0.10.1 | 0.8.0 |
| Apache Phoenix | 5.1.2 | - |
Note
We have discontinued Sqoop and Pig add-ons from HDInsight 5.1 version.
Guide for migrating from Apache Spark 2.4 to Spark 3.x
To learn how to migrate from Spark 2.4 to Spark 3.x, see the migration guide on the Spark website.
Next steps
Feedback
Coming soon: Throughout 2024 we will be phasing out GitHub Issues as the feedback mechanism for content and replacing it with a new feedback system. For more information see: https://aka.ms/ContentUserFeedback.
Submit and view feedback for