Basic usage for the Databricks CLI

Note

This information applies to Databricks CLI versions 0.205 and above. The Databricks CLI is in Public Preview.

Databricks CLI use is subject to the Databricks License and Databricks Privacy Notice, including any Usage Data provisions.

This article shows you how to list Databricks CLI command groups and commands, display Databricks CLI help, and work with Databricks CLI output. See What is the Databricks CLI?.

This article assumes that you have already installed the Databricks CLI and set up the CLI for authentication. See Install or update the Databricks CLI and Authentication for the Databricks CLI.

List CLI command groups

You list the command groups by using the --help or -h option. For example:

databricks -h

List CLI commands

You list the commands for any command group by using the --help or -h option. For example, to list the clusters commands:

databricks clusters -h

Display CLI command help

You display the help for a command by using the --help or -h option. For example, to display the help for the clusters list command:

databricks clusters list -h

Run a command

Complete usage information and syntax for individual commands can be found in the command-line help, but Databricks CLI commands generally conform to the following syntax:

databricks <command-group> <command-name> <subcommand-name> [command-argument-value1] [--<flag1-name> <flag1-value>]

Not every command has additional subcommands. Global flags are available, and some commands have additional flags. For example, the following command outputs available clusters, using a command-specific flag:

databricks clusters list --can-use-client JOBS

Tip

You can run Databricks CLI commands from within a Databricks workspace using the web terminal. Web terminal can be used by many users on one compute and does not require setting up keys. See Run shell commands in Azure Databricks web terminal.

Use jq to filter JSON output

Some Databricks CLI commands output JSON, which means you can use jq to filter the output. For example, to list just the display name of an Azure Databricks cluster with the specified cluster ID:

databricks clusters get 1234-567890-abcde123 | jq -r .cluster_name

My-11.3-LTS-Cluster

You can install jq on macOS using Homebrew with brew install jq or on Windows using Chocolatey with choco install jq. For more information on jq, see the jq Manual.

JSON string parameters

The format of string parameters is handled differently in JSON depending on your operating system:

Linux or macOS

You must enclose JSON string parameters in double quotes, and you must enclose the entire JSON payload in single quotes. Some examples:

'{"cluster_id": "1234-567890-abcde123"}'

'["20230323", "Amsterdam"]'

Windows

You must enclose JSON string parameters and the entire JSON payload in double quotes, and the double-quote characters inside the JSON payload must be preceded by \. Some examples:

"{\"cluster_id\": \"1234-567890-abcde123\"}"

"[\"20230323\", \"Amsterdam\"]"

Proxy server configuration

To route Databricks CLI requests and responses through a proxy server, set the HTTPS_PROXY environment variable on the machine where the Databricks CLI is installed to the proxy server’s URL.

To set environment variables, see your operating system’s documentation.