Open Source Big Data applications that work with Azure Data Lake Storage Gen1
Note
Azure Data Lake Storage Gen1 is now retired. See the retirement announcement here.Data Lake Storage Gen1 resources are no longer accessible.
This article lists the open source big data applications that work with Azure Data Lake Storage Gen1. For the applications in the table below, only the versions available with the listed distribution are supported. For information on what versions of these applications are available with HDInsight, see HDInsight component versioning.
| Open Source Software | Distribution |
|---|---|
| Apache Sqoop | HDInsight 3.2, 3.4, 3.5, and 3.6 |
| MapReduce | HDInsight 3.2, 3.4, 3.5, and 3.6 |
| Apache Storm | HDInsight 3.2, 3.4, 3.5, and 3.6 |
| Apache Hive | HDInsight 3.2, 3.4, 3.5, and 3.6 |
| HCatalog | HDInsight 3.2, 3.4, 3.5, and 3.6 |
| Apache Mahout | HDInsight 3.2, 3.4, 3.5, and 3.6 |
| Apache Pig/Pig Latin | HDInsight 3.2, 3.4, 3.5, and 3.6 |
| Apache Oozie | HDInsight 3.2, 3.4, 3.5, and 3.6 |
| Apache Zookeeper | HDInsight 3.2, 3.4, 3.5, and 3.6 |
| Apache Tez | HDInsight 3.2, 3.4, 3.5, and 3.6 |
| Apache Spark | HDInsight 3.4, 3.5, and 3.6 |