Request and access data products in Databricks Marketplace

  • Article

This article describes how to purchase or get access to free data products in Databricks Marketplace.

Overview

Databricks Marketplace gives you, as a data consumer, a secure platform for discovering data products that your organization needs to be successful. Databricks Marketplace uses Delta Sharing to provide security and control over shared data. Consumers can access public data, free sample data, and commercialized data offerings. In addition to datasets, consumers can also leverage additional analytical assets such as Databricks notebooks to help kick-start the data exploration process.

Before you begin

To browse data product listings on Databricks Marketplace, you can use either of the following:

To consume data products, you must have:

Browse Databricks Marketplace listings

To find a data product you want, simply browse or search the data product listings in Databricks Marketplace.

  1. Go to marketplace.databricks.com or log into your Azure Databricks workspace and click Marketplace icon Marketplace.

  2. Browse or search for the data product that you want.

    You can filter listings by provider name, category, cost (free or paid), or keyword search.

    If you are logged into a Azure Databricks workspace, you can also choose to view only the private listings available to you as part of a private exchange. See Participate in private exchanges.

Request access to data products in the Marketplace

To request access to data products, you must be logged into a Azure Databricks workspace. Some data products are available immediately, and others require provider approval and transaction completion using provider interfaces.

Requirements

See Before you begin. To access data products in the Marketplace, you must have at least the USE MARKETPLACE ASSETS privilege on the Unity Catalog metastore that is attached to the workspace that you are using.

Get access to data products that are instantly available

Some data products are available instantly, requiring only that you request them and agree to terms. These are listed under the Free and instantly available heading on the Marketplace landing page, are identified on the listing tile as Free, and are identified as Instantly available on the listing detail page.

  1. When you’ve found a listing you’re interested in on the Marketplace landing page, click the listing to open the listing detail page.

  2. Click the Get instant access button and accept the Databricks terms and conditions.

  3. Click the Open button to view the data product, which appears as a read-only catalog in Catalog Explorer.

    For information about managing access to catalogs in Azure Databricks, see Access the shared data.

  4. If sample notebooks are available, they appear in the Sample notebooks pane in the listing.

    You can view a notebook by selecting it and clicking the Preview button. To import a notebook into your Azure Databricks workspace so that you can run it, click Open notebook in new tab and then click Import Notebook. See Introduction to Databricks notebooks.

Request data products that require provider approval

Some data products require provider approval, typically because a commercial transaction is involved, or the provider might prefer to customize data products for you. These listings are identified on the listing detail page as By request and include a Request access button.

  1. When you’ve found a listing you’re interested in on the Marketplace landing page, click the listing to open the listing detail page.

  2. Click the Request access button.

  3. Enter your name, company, and a brief description of your intended use for the data product.

  4. Accept the Databricks terms and conditions and click Request access.

  5. You will be notified by email when the provider has completed their review of your request.

    You can also monitor the progress of your request on the My Requests page in Marketplace. See Manage Databricks Marketplace data products that are shared with you. However, any transactions that follow will use provider communications and payment platforms. No commercial transactions are handled directly on Databricks Marketplace.

  6. When your transaction is complete, the data provider will make the data product available to you as a read-only catalog in your workspace.

    For information about managing access to catalogs in Azure Databricks, see Access the shared data.

Access the shared data

Each Marketplace dataset is shared with you in a read-only catalog in Azure Databricks. Catalogs are the top-level container for data managed by Unity Catalog. For more information about the data object hierarchy in Unity Catalog, see The Unity Catalog object model.

Once the provider has shared the data with you, you have a few ways of accessing the catalog.

From the Marketplace

To access shared data from the Marketplace:

  1. In the sidebar, click Marketplace icon Marketplace.

  2. On the Marketplace landing page, click My requests in the upper right-hand corner.

  3. On the Installed data products tab, find the data product, click the Kebab menu kebab menu (also known as the three-dot menu) at the end of the data product row, and select View data.

    You can also click the data product name to open the data product details page, where you can click the Open button to view the data.

    Catalog Explorer opens to the catalog that contains the data set, where you can access the data or manage access for other team members. See Grant access to other team members.

    To learn more about accessing shared data in Azure Databricks, see Read data shared using Databricks-to-Databricks Delta Sharing.

From Catalog Explorer

To access shared data directly from Catalog Explorer:

  1. In the sidebar, click Catalog icon Catalog.
  2. If you know the name of the catalog that holds the shared data, search for it and select it.

If you don’t know the catalog name but you do know the provider name, you can find the catalog in Catalog Explorer by doing the following:

  1. In the sidebar, click Catalog icon Catalog.
  2. In the left pane of Catalog Explorer, click Delta Sharing and then Shared with me.
  3. On the Providers tab, click the provider name.
  4. On the Shares tab, find the catalog name and click it to open it.

Using the Databricks CLI or SQL statements

You can also find and access the catalog that contains the shared data using the Databricks CLI or SQL statements in an Azure Databricks notebook or Databricks SQL editor query. For details, see Access data in a shared table. You can skip the sections that describe how to create a catalog, since Databricks Marketplace does this for you.

Grant access to other team members

If you are the user who requested the shared data, you are the owner of the catalog that contains that data in your workspace. As such, you can grant your team members access to the catalog and refine access at the schema, table, view, row, and column level, just as you do any data in Unity Catalog. See Manage privileges in Unity Catalog. That said, table and view data under a shared catalog is read-only, which means that you can only grant your team read operations like DESCRIBE, SHOW, and SELECT.

You can also transfer ownership of the catalog or the objects inside it.

View sample notebooks

Some listings include sample notebooks on the listing details page. To access these notebooks for instantly available listings that are shared with you:

  1. In the sidebar, click Marketplace icon Marketplace.

  2. On the Marketplace landing page, click My requests in the upper right-hand corner.

  3. On the Installed data products tab, find the data product, click the Kebab menu kebab menu (also known as the three-dot menu) at the end of the data product row, and select View data to open the listing details page.

    If there are shared notebooks, they appear in the Sample notebooks pane, where you can view them by clicking the Preview button. To import a sample notebook into your Azure Databricks workspace, click Open notebook in new tab and then click Import Notebook. See Introduction to Databricks notebooks.

    Note

    The Sample notebooks display and preview in the listings UI does not work in Chrome Incognito mode.

Participate in private exchanges

Some data providers might want to share certain data with a limited set of consumers who are invited to be part of a private exchange. You can find private exchange listings by selecting the Private exchange checkbox on the Marketplace home page. Just as you can with public listings, you can access free listings instantly or request access to those that are marked By request.

To join a private exchange, a data provider needs to invite your organization. When they do, they will request a shared identifier for your Unity Catalog metastore. To learn how to get your metastore’s sharing identifier, see step 1 in Get access in the Databricks-to-Databricks model.

To learn more about private exchanges, see Create and manage private exchanges in Databricks Marketplace.

Disable Marketplace access

By default, all users in any Unity Catalog-enabled workspace have the ability to request data products in Databricks Marketplace. In other words, the account users group has the USE MARKETPLACE ASSETS privilege on all Unity Catalog metastores unless a metastore admin revokes that privilege.

This privilege does not grant the ability to participate in financial transactions with data providers. All financial transactions take place outside Azure Databricks. This privilege does grant the ability to access data products that are labelled Free and instantly available and data products that have already been purchased. Accessing such data products creates new read-only catalogs in Azure Databricks that are owned by the requestor, who can grant read-only access to other users.

A metastore admin can disable all users’ ability to request data products in Databricks Marketplace by revoking the USE MARKETPLACE ASSETS privilege from the account users group on the Unity Catalog metastore. If you do revoke this privilege, users can continue to browse the Databricks Marketplace in their workspace but cannot request data products.

Permission required: Metastore admin

Data explorer

To revoke the USE MARKETPLACE ASSETS privilege for the account users group:

  1. In your Azure Databricks workspace, click Catalog icon Catalog.
  2. Click the link icon next to the metastore name at the top left.
  3. Find the row that grants account users the USE MARKETPLACE ASSETS privilege.
  4. Click the checkbox next to the row and click the Revoke button.
  5. Confirm the revoke action.
  6. Grant the privilege to any specific users and groups you like by clicking the Grant button.

Sql

To revoke the USE MARKETPLACE ASSETS privilege for the account users group, run the following command in a notebook or the Databricks SQL query editor.

REVOKE USE MARKETPLACE ASSETS ON METASTORE FROM `account users`;

To grant the USE MARKETPLACE ASSETS privilege to a specific user or group, run the following command in a notebook or the Databricks SQL query editor.

GRANT USE MARKETPLACE ASSETS ON METASTORE TO `<user-or-group>`;

If you don’t want your users to be able to view the Marketplace home page at all, contact your Databricks representative.

Known issues

If a request for access is rejected by the data provider, you cannot request the same data product again. If you encounter this issue, contact your provider or Azure Databricks representative.

Share your feedback

We’d love to hear what you think about Databricks Marketplace.

  • Have feedback? Go to Learn > Provide feedback on the Marketplace home page.
  • Want to see additional datasets in the marketplace? Click Suggest a product on the Marketplace home page banner.

Next steps