What’s coming?

Learn about upcoming Azure Databricks releases.

Queueing enabled by default for jobs created in the Azure Databricks Jobs UI starting April 15

Starting on April 15th, 2024, queueing will be automatically enabled when jobs are created in the Azure Databricks Jobs UI. When queueing is enabled, and a concurrency limit is reached, the job is placed in a queue until capacity is available to run the job. See What if my job cannot run because of concurrency limits?.

New control plane IP addresses on May 30

Starting on May 30th 2024, Azure Databricks will begin using new control plane service components. This affects the egress and ingress IP addresses that the Azure Databricks control plane uses. If you use a firewall or proxy appliance to restrict user access to Azure Databricks or for controlling outbound access to your resources, you must update your access rules to include the new IP addresses. For the new IP addresses, see Azure Databricks control plane addresses.

For more information, see Azure Databricks is updating the public IP range for its control plane services.

DigiCert is updating its root CA certificate on May 15

After May 15th, 2024, if you do not use a browser that is supported by Azure Databricks or another client that trusts DigiCert’s new root and intermediate CA certificates, you must establish trust with the new DigiCert root and intermediate CA certificates. See DigiCert root, and intermediate CA certificate updates 2023.

For more information on how to test if your client trusts the root CA, see DigiCert is updating its root CA certificate.

Legacy Git integration is EOL on January 31

After January 31st, 2024, Databricks will remove legacy notebook Git integrations. This feature has been in legacy status for more than two years, and a deprecation notice has been displayed in the product UI since November 2023.

For details on migrating to Databricks Git folders (formerly Repos) from legacy Git integration, see Switching to Databricks Repos from Legacy Git integration. If this removal impacts you and you need an extension, contact your Databricks account team.

Changes to query, dashboard, and alert listing pages

Databricks plans to remove the Admin view tab from listing pages for queries, dashboards, and alerts. Workspace admins automatically have CAN MANAGE permissions on workspace objects, so all queries, dashboards, and alerts can be accessed from the All tab on each listing page.

JDK8 and JDK11 will be unsupported

Azure Databricks plans to remove JDK 8 support with the next major Databricks Runtime version, when Spark 4.0 releases. Azure Databricks plans to remove JDK 11 support with the next LTS version of Databricks Runtime 14.x.

Automatic enablement of Unity Catalog for new workspaces

Databricks will soon start to enable Unity Catalog automatically for new workspaces. This removes the need for account admins to configure Unity Catalog after a workspace is created. Rollout will proceed gradually across accounts.

New charts and chart improvements

Azure Databricks plans to add new charts to the SQL editor, SQL dashboards, and notebooks. This change will bring faster chart rendering performance, improved colors, and faster interactivity. See New chart visualizations in Databricks

Favorites functionality

Azure Databricks plans to enable favorites functionality in the workspace. You’ll be able to save content such as notebooks, dashboards, experiments, and queries to a list of favorites, and then access your favorites from the homepage.

sqlite-jdbc upgrade

Databricks Runtime plans to upgrade the sqlite-jdbc version from 3.8.11.2 to 3.42.0.0 in all Databricks Runtime maintenance releases. The APIs of version 3.42.0.0 are not fully compatible with 3.8.11.2. Confirm your methods and return type use version 3.42.0.0.

If you are using sqlite-jdbc in your code, check the sqlite-jdbc compatibility report.