March 2020

  • Article

These features and Azure Databricks platform improvements were released in March 2020.

Note

Releases are staged. Your Azure Databricks account may not be updated until up to a week after the initial release date.

Managed MLflow Model Registry collaborative hub available (Public Preview)

March 26-31, 2020: Version 3.16

MLflow Model Registry is a collaborative hub where teams can share machine learning models, work together from experimentation to staging and production, integrate models with approval and governance workflows, and track model deployments. The managed MLflow Model Registry is now available for Public Preview to all Azure Databricks customers.

Workspace, pool, and cluster tags propagate to DBU usage details and Azure VMs for better cost management reporting

March 26, 2020

Starting March 26, we will roll out tag propagation to Azure Databricks usage details and Azure VMs. The new tag propagation feature combines Azure Databricks workspace tags (that is, resource group tags), pool tags, and cluster tags and propagates them to the Databricks DBU usage details and Azure VMs as resource tags. You will be able to see the combined tag information in the Azure Cost Management portal and in usage detail exports, giving you better visibility into Azure Databricks usage and accurate attribution to business units and teams. See Monitor usage using tags.

Databricks Runtime 7.0 (Beta) previews Apache Spark 3.0

March 22, 2020

Databricks Runtime 7.0 (Beta) provides a preview of Apache Spark 3.0, with Scala 2.12. Please try it out using non-production workloads and give us your feedback.

For more information, see the complete Databricks Runtime 7.0 (unsupported) release notes.

Databricks Runtime 6.5 ML (Beta)

March 20, 2020

Databricks Runtime 6.5 ML (Beta) brings the following library upgrade:

  • MLflow upgraded from 1.5.0 to 1.7.0

For more information, see the complete Databricks Runtime 6.5 for ML (unsupported) release notes.

Databricks Runtime 6.5 (Beta)

March 20, 2020

Databricks Runtime 6.5 (Beta) brings many library upgrades and new features, including:

  • Operation metrics for all writes, updates, and deletes on a Delta table now appear in table history
  • You can rate-limit the data processed in Delta Lake streaming micro-batches
  • Snowflake connector is updated to 2.5.9

For more information, see the complete Databricks Runtime 6.5 (unsupported) release notes.

Azure Databricks feedback now goes directly to Azure Databricks feedback portal

March 10-17, 2020: Version 3.15

The link under the ? > Feedback menu now points to the Azure Databricks feedback portal.

Develop and test Shiny applications inside RStudio Server

March 10-17, 2020: Version 3.15

You can now develop and test Shiny applications inside RStudio Server hosted in Azure Databricks. See Shiny on Azure Databricks.

Change the default language of a notebook

March 10-17, 2020: Version 3.15

You can now change the default language of a notebook.

Databricks Connect now supports Databricks Runtime 6.4

March 6, 2020

Databricks Connect now supports Databricks Runtime 6.4.

Databricks Connect now supports Databricks Runtime 6.3

March 3, 2020

Databricks Connect now supports Databricks Runtime 6.3.