Events
Mar 31, 11 PM - Apr 2, 11 PM
The ultimate Microsoft Fabric, Power BI, SQL, and AI community-led event. March 31 to April 2, 2025.
Register todayThis browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
This article contains details on releases of major new and upcoming Databricks Asset Bundles features and changes. Bundle features are released with the Databricks CLI. For a complete list of updates, see the Databricks CLI GitHub repository release notes.
The following Databricks Asset Bundles behavioral changes were released in a Databricks CLI release.
October 23, 2024
This change was released with Databricks CLI 0.231.0.
A warning now occurs when a bundle is deployed to the /Workspace/Shared
folder, which is accessible by all users, but the top-level permissions
defined for the bundle conflicts with this. Either modify the permissions defined for the bundle or move the bundle out of the /Workspace/Shared
folder.
To modify the permissions for a bundle, see permissions.
To move the bundle out of the /Workspace/Shared
folder, change the workspace.root_path
in the bundle configuration to point to a new location, then re-deploy the bundle. Remove the old bundle folder using the UI or by running databricks fs rm
.
October 9, 2024
This change was released with Databricks CLI 0.230.0.
Workspace paths are now automatically prefixed with /Workspace
. In addition, all usage of path strings such as /Workspace/${workspace.root_path}/...
in bundle configuration are automatically replaced with ${workspace.root_path}/...
and will generate a warning as part of bundle validate
.
If you have specified a custom workspace.root_path
, workspace.artifact_path
, or workspace.file_path
, Databricks Asset Bundles will automatically prefix it with /Workspace
, but if you use any of these as variables (for example, my_config_path: /Workspace/${workspace.file_path}/config
), you will need to update those entries to remove the /Workspace
prefix to avoid the warning.
If you pass one of these as variables and prefix them in your code, you’ll need to update your code to not do this.
This change is required because originally when the workspace file system was rooted at /
and home directories were under /Users
, to access workspace paths through the Databricks REST API you would use these paths directly. To access workspace paths from your code, you could use the /Workspace
file path and home directories were also available under /Workspace/Users
. To avoid this duality of workspace paths, as well as the ambiguity between workspace paths and Unity Catalog /Volumes
paths, all workspace paths are prefixed with /Workspace
.
The following Databricks Asset Bundles features and updates were released in a Databricks CLI release.
December 5, 2024
This feature was released with Databricks CLI 0.236.0.
You can now create Unity Catalog volumes using Databricks Asset Bundles by defining a volume resource in your bundle configuration. See volume (Unity Catalog).
December 5, 2024
This feature was released with Databricks CLI 0.236.0.
Variable lookups now support notification destinations. See Retrieve an object’s ID value.
October 30, 2024
This feature was released with Databricks CLI 0.232.0.
AI/BI dashboards can now be managed in bundle configuration using the new dashboard resource type. You can generate dashboard configuration using bundle generate dashboard
and keep your local and remote version of a dashboard in sync with the --force
and --watch
options. See dashboard and Generate a bundle configuration file.
For information about AI/BI dashboards, see Dashboards.
October 23, 2024
This feature was released with Databricks CLI 0.231.0.
A new bundle summary
command has been added. This command outputs a summary of a bundle’s identity and resources, including deep links for resources so that you can easily navigate to the resource in the Databricks workspace. See Output a bundle summary.
October 1, 2024
This feature was released with Databricks CLI 0.229.0.
You can now create all-purpose clusters in your bundle configuration using the new cluster resource type. See cluster.
September 5, 2024
This feature was released with Databricks CLI 0.228.0.
A prompt will now occur if there are bundle configuration changes that would lead to a recreation of a Delta Live Tables pipeline. You can skip the prompt by specifying the --auto-approve
flag.
July 31, 2024
This feature was released with Databricks CLI 0.225.0.
Unity Catalog schemas can now be defined in your bundle configuration. See schema (Unity Catalog).
July 4, 2024
This feature was released with Databricks CLI 0.223.0.
You can now interact with bundles using the Databricks CLI from the web terminal. For information about using the web terminal, see Run shell commands in Azure Databricks web terminal.
June 26, 2024
This feature was released with Databricks CLI v0.222.0.
Databricks Asset Bundles now support complex variables. See Define a complex variable.
April 23, 2024
With the Databricks CLI 0.218.0 release, Databricks Asset Bundles are now generally available.
Events
Mar 31, 11 PM - Apr 2, 11 PM
The ultimate Microsoft Fabric, Power BI, SQL, and AI community-led event. March 31 to April 2, 2025.
Register today