Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
This guide helps you migrate your Azure Databricks workloads to the latest version of Databricks Runtime 14.x. To do so, Databricks recommends that you migrate your workloads in the following order:
- If your workloads are currently running on Databricks Runtime 13.3 LTS or above, you can migrate directly to the latest version of Databricks Runtime 14.x, as described later on this page.
- If your workloads are currently running on Databricks Runtime 13.3 LTS or below, do the following:
- Migrate to Databricks Runtime 13.3 LTS first. See the Databricks Runtime 13.x migration guide.
- Follow the guidance on this page to migrate from Databricks Runtime 13.3 LTS to the latest version of Databricks Runtime 14.x.
Note
LTS means this version is under long-term support. See Databricks Runtime support lifecycles.
Apache Spark migration guidance
Use the following table to find the Apache Spark version for your Databricks Runtime version. Each link opens the Apache Spark migration guide for that release on archive.apache.org (Spark-specific changes between versions).
| Databricks Runtime version | Apache Spark version |
|---|---|
| 14.0 | 3.5.0 |
| 14.1 | 3.5.0 |
| 14.2 | 3.5.0 |
| 14.3 LTS | 3.5.0 |
Databricks Runtime behavior changes
The following notable behavior changes were introduced into each of the following Databricks Runtime 14.x releases.
Databricks Runtime system environment properties, features, and libraries
For information about system environment properties as well as new, changed, and deprecated features and libraries in Databricks Runtime releases from Databricks Runtime 13.3 LTS to the latest version of Databricks Runtime 14.x, see the following:
- Databricks Runtime 14.3 LTS for Machine Learning
- Databricks Runtime 14.3 LTS
- Databricks Runtime 14.2 for Machine Learning (EoS)
- Databricks Runtime 14.2 (EoS)
- Databricks Runtime 14.1 for Machine Learning (EoS)
- Databricks Runtime 14.1 (EoS)
- Databricks Runtime 14.0 for Machine Learning (EoS)
- Databricks Runtime 14.0 (EoS)
- Databricks Runtime 13.3 LTS for Machine Learning
- Databricks Runtime 13.3 LTS
Post-release maintenance updates are listed in Databricks Runtime maintenance updates.