Delta Live Tables release 2023.16

  • Article

April 24 - 28, 2023

These features and improvements were released with the 2023.16 release of Delta Live Tables.

Databricks Runtime versions used by this release

Channel:

  • CURRENT (default): Databricks Runtime 11.3.10
  • PREVIEW: Databricks Runtime 12.2.3

New features and improvements in this release

  • Delta Live Tables support for Unity Catalog is in Public Preview. You can use Unity Catalog with your Delta Live Tables pipelines to:

    • Define a catalog in Unity Catalog where your pipeline will persist tables.
    • Read data from Unity Catalog tables.

    See Use Unity Catalog with your Delta Live Tables pipelines.

  • By default, streaming tables require append-only sources. This release introduces the skipChangeCommits flag that can be set on a target streaming table to ignore changes in a source streaming table when the source table requires updates or deletes. See Configure a streaming table to ignore changes in a source streaming table.

  • With this release, the limit for concurrent updates in a workspace is increased to 100. The previous concurrent updates limit was 20.

  • Delta Live Tables is now supported in Azure China regions.

  • When you run a Delta Live Tables pipeline from a pipeline notebook, you can now view the event log in the notebook sidebar. See Open or run a Delta Live Tables pipeline from a notebook.

Bug fixes in this release

  • This release fixes a bug causing the pipelines list page to crash when the “%” character was entered in the search box.