HDinsight 4.0 to 5.0

PANUWAT KLAHAN 0

Differences between HDinsight Componant functionality of 4.0 and 5.0

major change , minor change

Does the Ambari page affect usability?

1 answer

ShaikMaheer-MSFT 38,456 Reputation points Microsoft Employee

2023-08-19T06:43:41.18+00:00
Hi PANUWAT KLAHAN,

Thank you for posting query in Microsoft Q&A Platform.

HDInsight is a cloud-based big data platform that provides managed clusters for Hadoop, Spark, Hive, HBase, and other big data technologies. The major difference between HDInsight 4.0 and 5.0 is the version of the Hadoop ecosystem components that are included in each release.

HDInsight 4.0 includes the following major components:

Hadoop 3.1.1

Hive 3.1.0

Spark 2.4.0

HBase 2.0.0

Phoenix 5.0.0

HDInsight 5.0 includes the following major components:

Hadoop 3.3.1

Hive 3.1.0

Spark 3.0.1

HBase 2.2.6

Phoenix 5.2.0

The major changes between these two versions are the upgrades to Hadoop, Spark, and HBase. These upgrades bring new features, performance improvements, and bug fixes to the platform.

In terms of minor changes, there are many smaller updates and bug fixes that are included in each release. These changes are typically related to security, stability, and usability.

The Ambari page is a web-based management interface for HDInsight clusters. It provides a graphical user interface for managing the cluster, including monitoring, configuration, and troubleshooting. The Ambari page can affect the usability of the platform, as it provides an easy-to-use interface for managing the cluster. However, it is not the only way to manage the cluster, and many tasks can be performed using command-line tools or APIs.

Hope this helps. Please let me know if any further queires.

Please consider hitting Accept Answer button. Accepted answers help community as well.
Please sign in to rate this answer.
ShaikMaheer-MSFT 38,456 Reputation points Microsoft Employee

2023-08-21T05:53:05.1533333+00:00

Hi PANUWAT KLAHAN, Just checking if above answer helps. If yes, please consider hitting Accept Answer button. Accepted answers help community as well. Please let me know if any further queries. Thank you.

PANUWAT KLAHAN 0 Reputation points

2023-08-22T02:42:30.5433333+00:00

Thank you for your response. I'm interested in obtaining more comprehensive information. Could you provide greater specificity regarding the major components of the new function and elaborate on the potential effects of migrating from 4.0 to 5.0?

ShaikMaheer-MSFT 38,456 Reputation points Microsoft Employee

2023-08-22T06:52:16.4266667+00:00

Sure, here are some more details on the major components of HDInsight 5.0 and the potential effects of migrating from 4.0 to 5.0:

Hadoop version: HDInsight 5.0 is based on Hadoop 3.2, which includes several new features and improvements over the previous version. Some of the key improvements in Hadoop 3.2 include:

Erasure coding: Hadoop 3.2 includes support for erasure coding, which provides more efficient data storage and reduces the amount of storage required for data replication.

GPU acceleration: Hadoop 3.2 includes support for GPU acceleration, which can significantly improve the performance of machine learning and other compute-intensive workloads.

Improved scalability: Hadoop 3.2 includes several improvements to scalability, including support for larger clusters and improved performance for large-scale data processing.

Migrating from HDInsight 4.0 to 5.0 can provide access to these new features and improvements, which can help to improve the performance and scalability of your big data workloads.

Kerberos: HDInsight 5.0 includes support for Kerberos authentication by default, which provides enhanced security for your big data workloads. Kerberos is a network authentication protocol that provides strong authentication for client/server applications by using secret-key cryptography. Migrating to HDInsight 5.0 can help to improve the security of your big data workloads.

Azure Data Lake Storage Gen2: HDInsight 5.0 includes support for Azure Data Lake Storage Gen2, which provides improved performance and scalability for big data workloads. Azure Data Lake Storage Gen2 is a highly scalable and cost-effective data lake solution that provides support for both object storage and file storage. Migrating to HDInsight 5.0 can help to improve the performance and scalability of your big data workloads.

Ambari: HDInsight 5.0 includes a new version of the Ambari management UI, which provides improved usability and performance over the previous version. Ambari is a web-based tool that provides a graphical user interface for managing Hadoop clusters. The new version of Ambari included in HDInsight 5.0 provides improved usability and performance over the previous version, which can make it easier to manage your big data workloads

PANUWAT KLAHAN 0 Reputation points

2023-08-24T13:44:30.9966667+00:00

HDInsight 5.0 New Ambari Management UI Can you take a screenshot of Ambari for me to see what has changed?

ShaikMaheer-MSFT 38,456 Reputation points Microsoft Employee

2023-08-28T15:58:45.3866667+00:00

The Ambari management UI in HDInsight 5.0 does not have a built-in capability to take screenshots. However, you can find screenshots and videos of the new Ambari UI online to get an idea of what has changed.

Microsoft provides documentation and tutorials on the new Ambari UI in HDInsight 5.0, which includes screenshots and videos that demonstrate the new features and improvements. You can find this documentation on the Microsoft website or by searching online for "HDInsight 5.0 Ambari UI".

Additionally, you can find screenshots and videos of the new Ambari UI on various blogs and forums related to Hadoop and big data. These resources can provide a more detailed look at the new features and improvements in the Ambari UI.

Overall, while the Ambari UI in HDInsight 5.0 does not have a built-in capability to take screenshots, there are many resources available online that can provide a detailed look at the new UI.

Hope this helps.

Please consider hitting Accept Answer button. Accepted answers help community as well.

ShaikMaheer-MSFT 38,456 Reputation points Microsoft Employee

2023-08-30T10:53:36.19+00:00

Hi PANUWAT KLAHAN, Just checking if above helps. If yes, please consider hitting Accept Answer button. Accepted answers help community as well. Please let me know if any further queries. Thank you.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

HDinsight 4.0 to 5.0

1 answer

Your answer