Azure HDInsight on AKS documentation

HDInsight on AKS, a new HDInsight version, provides enterprise-ready managed cluster service with emerging open-source analytics.

About HDInsight on AKS

Overview

• What is HDInsight on AKS?
• Version management
• Security
• Azure Monitor integration
• Release notes

Get started

Quickstart

• Resource prerequisites
• Get started with one click deployment
• Create a cluster pool
• Create a cluster

Manage

How-To Guide

• Create cluster pools and clusters
• Manage cluster pools
• Manage clusters
• Manual scale
• Auto scale
• Service configuration
• Service health
• Azure Monitor integration
• Use cluster storage

Trino

Overview

• What is Trino?

Quickstart

• Create a Trino cluster

Tutorial

• Connect to a Hive metastore
• Add catalogs
• Custom plugins
• Query logging

How-To Guide

• Configuration
• CLI
• Trino UI
• JDBC Driver
• Delta Lake Tables in Synapse or external locations
• Configure caching

Reference

• Trademarks

Apache Flink®

Overview

• What is Apache Flink?

Quickstart

• Create an Apache Flink cluster

Tutorial

• Configuration management
• Flink job management
• Hive dialect in Flink
• Table API and SQL

How-To Guide

• ADLS Gen2 - Write with Flink DataStream API
• Delta Lake Tables with Apache Flink
• Hive Catalog and FlinkSQL
• Kafka table on FlinkSQL

Reference

• Trademarks

Apache Spark™

Overview

• What is Spark?

Quickstart

• Create a Spark cluster

How-To Guide

• Submit and manage jobs
• Library management
• Use ML notebook on Spark
• Use Hive metastore

Reference

• Trademarks

Resources

Reference

• FAQ
• Troubleshooting