DLT release 2023.13

April 3 - 7, 2023

These features and improvements were released with the 2023.13 release of DLT.

Databricks Runtime versions used by this release

Channel:

• CURRENT (default): Databricks Runtime 11.3.8
• PREVIEW: Databricks Runtime 12.1.4

New features and improvements in this release

• The number of allowed notebooks per pipeline is increased to 100. The previous limit was 25 notebooks.

• This release allows use of additional commands in a spark.sql(<command>) function, including DESC,DESCRIBE, SHOW TBLPROPERTIES, SHOW TABLES, SHOW NAMESPACES, SHOW COLUMNS IN, SHOW FUNCTIONS, SHOW CATALOGS, SHOW SCHEMAS, SHOW DATABASES, and SHOW CREATE TABLE.

Bug fixes in this release

• This release fixes a bug that in some cases caused an error after entering invalid JSON in the pipeline settings. This error would instruct the user to reload the page instead of providing guidance on the cause of the error. With this release, a descriptive error message is displayed in the JSON editor.