Κοινή χρήση μέσω

Access data products in Databricks Marketplace (Unity Catalog-enabled workspaces)

  • Άρθρο

This article describes how to access data products in Databricks Marketplace if you have an Azure Databricks workspace that is enabled for Unity Catalog.

Note

If you don’t have an Azure Databricks workspace that is enabled for Unity Catalog, you can access shared Marketplace data products using Delta Sharing open sharing connectors. See Access data products in Databricks Marketplace using external platforms.

Overview

Databricks Marketplace gives you, as a data consumer, a secure platform for discovering data products that your organization needs to be successful. Databricks Marketplace uses Delta Sharing to provide security and control over shared data. Consumers can access public data, free sample data, and commercialized data offerings. Consumers who use a Unity Catalog-enabled Azure Databricks workspace are not limited to accessing tabular data, but can also access volumes (non-tabular data), AI models, Databricks notebooks, and Databricks Solution Accelerators.

When you consume Marketplace data products using an Azure Databricks workspace that is enabled for Unity Catalog, you can take advantage of the deep integration between Delta Sharing and Unity Catalog, along with Unity Catalog governance, auditing, and convenient interfaces.

Before you begin

To browse data product listings on Databricks Marketplace, you can use either of the following:

To consume data products using a Databricks workspace that is enabled for Unity Catalog, you must have the following:

Browse Databricks Marketplace listings

To find a data product you want, simply browse or search the data product listings in Databricks Marketplace.

Note

As an alternative to the instructions that follow, you can search for Marketplace listings using the global search bar at the top of your Azure Databricks workspace. See Search for workspace objects. You can also view and request free sample data on the Add data page. In the workspace sidebar, click Data ingestion and scroll down to Free sample data from Databricks Marketplace.

  1. Go to marketplace.databricks.com or log into your Azure Databricks workspace and click Marketplace icon Marketplace.

  2. Browse or search for the data product that you want.

    You can filter listings by product type (dataset, solution accelerator, or ML model), provider name, category, cost (free or paid), or keyword search.

    If you are logged into an Azure Databricks workspace, you can also choose to view only the private listings available to you as part of a private exchange. See Participate in private exchanges.

Request access to data products in the Marketplace

To request access to data products, you must be logged into an Azure Databricks workspace. Some data products are available immediately, and others require provider approval and transaction completion using provider interfaces.

Requirements

See Before you begin. To access data products in the Marketplace, you must have at least the USE MARKETPLACE ASSETS privilege on the Unity Catalog metastore that is attached to the workspace that you are using.

Get access to data products that are instantly available

Some data products are available instantly, requiring only that you request them and agree to terms. These are listed under the Free and instantly available heading on the Marketplace landing page, are identified on the listing tile as Free, and are identified as Instantly available on the listing detail page.

  1. When you’ve found a listing you’re interested in on the Marketplace landing page, click the listing to open the listing detail page.

  2. Click the Get instant access button and accept the Databricks terms and conditions.

    Accessing Databricks Solution Accelerators works a little differently. See Get access to Databricks Solution Accelerators.

  3. (Optional) Under More options, modify the suggested catalog name.

    The catalog name is displayed in Catalog Explorer in your Azure Databricks workspace, and it is used in the three-part namespace (catalog.schema.table|volume|view) in queries. You can change the default name.

  4. Click the Get instant access button.

  5. Click the Open button to view the data product, which appears as a read-only catalog in Catalog Explorer.

    For information about managing access to catalogs in Azure Databricks, see Access the shared data using Unity Catalog.

If sample notebooks are available, they appear under the Sample notebook heading in the listing.

To view a notebook, click the Preview notebook button. To import a notebook into your Azure Databricks workspace so that you can run it, click Preview notebook and then click Import Notebook. See Introduction to Databricks notebooks.

Request data products that require provider approval

Some data products require provider approval, typically because a commercial transaction is involved, or the provider might prefer to customize data products for you. These listings are identified on the listing detail page as By request and include a Request access button.

  1. When you’ve found a listing you’re interested in on the Marketplace landing page, click the listing to open the listing detail page.

  2. Click the Request access button.

  3. Enter your name, company, and a brief description of your intended use for the data product.

  4. Accept the Databricks terms and conditions and click Request access.

  5. You will be notified by email when the provider has completed their review of your request.

    You can also monitor the progress of your request on the My Requests page in Marketplace. See Manage shared Databricks Marketplace data products. However, any transactions that follow will use provider communications and payment platforms. No commercial transactions are handled directly on Databricks Marketplace.

  6. When your transaction is complete, the data provider will make the data product available to you as a read-only catalog in your workspace.

    For information about managing access to catalogs in Azure Databricks, see Access the shared data using Unity Catalog.

Get access to Databricks Solution Accelerators

Unlike other data assets, Databricks Solution Accelerators are shared by cloning Git repositories and making them available in Databricks Git folders. To access a Solution Accelerator:

  1. In Marketplace, click the Solution Accelerator listing to open the listing detail page.
  2. Click the Get instant access button.
  3. On the Add Git folder dialog, enter a name for the repository. This name will appear in Databricks Git folders UIs.
  4. Accept the Databricks terms and conditions and click Create Git folder.
  5. Click the Open button and select Git folder to view the repo in the workspace file browser.

Access the shared data using Unity Catalog

Access to the data in your Azure Databricks workspace depends on the data product type:

  • Marketplace datasets and models are shared with you in a read-only catalog in Azure Databricks. Catalogs are the top-level container for data assets that are managed by Unity Catalog. For more information about the data object hierarchy in Unity Catalog, see Database objects in Azure Databricks.

    Once the provider has shared the data with you, you have a few ways of accessing the catalog. The sections that follow describe some of these access options.

  • Notebooks are shared directly in the Marketplace listing, and you can import them from the listing into your workspace.

  • Solution Accelerators are shared as Databricks Git folders. See Get access to Databricks Solution Accelerators.

Access shared datasets in the Marketplace

To access shared data from the Marketplace:

  1. In the sidebar, click Marketplace icon Marketplace.

  2. On the Marketplace landing page, click My requests in the upper right-hand corner.

  3. On the Installed data products tab, find the data product, click the Kebab menu kebab menu at the end of the data product row, and select View data.

    You can also click the data product name to open the data product details page, where you can click the Open button to view the data.

    Catalog Explorer opens to the catalog that contains the data set, where you can access the data or manage access for other team members. See Grant access to other team members.

    To learn more about accessing shared data in Azure Databricks, see Read data shared using Databricks-to-Databricks Delta Sharing (for recipients).

Access shared datasets in Catalog Explorer

To access shared data directly from Catalog Explorer:

  1. In the sidebar, click Catalog icon Catalog.
  2. If you know the name of the catalog that holds the shared data, search for it and select it.

If you don’t know the catalog name but you do know the provider name, you can find the catalog in Catalog Explorer by doing the following:

  1. In the sidebar, click Catalog icon Catalog.
  2. In the left pane of Catalog Explorer, click Delta Sharing and then Shared with me.
  3. On the Providers tab, click the provider name.
  4. On the Shares tab, find the catalog name and click it to open it.

Access shared datasets using the Databricks CLI or SQL statements

You can also find and access the catalog that contains the shared data using the Databricks CLI or SQL statements in an Azure Databricks notebook or Databricks SQL editor query. For details, see Access data in a shared table or volume. You can skip the sections that describe how to create a catalog, since Databricks Marketplace does this for you.

Grant access to other team members

If you are the user who requested the shared data, you are the owner of the catalog that contains that data in your workspace. As such, you can grant your team members access to the catalog and refine access at the schema, table, view, row, and column level, just as you do any data in Unity Catalog. See Manage privileges in Unity Catalog. That said, table and view data under a shared catalog is read-only, which means that you can only grant your team read operations like DESCRIBE, SHOW, and SELECT.

You can also transfer ownership of the catalog or the objects inside it.

View sample notebooks

Some listings include sample notebooks on the listing details page. To access these notebooks for instantly available listings that have been shared with you:

  1. In the sidebar, click Marketplace icon Marketplace.
  2. On the Marketplace landing page, click My requests in the upper right-hand corner.
  3. On the Installed data products tab, find the data product and click the data product name to open the listing details page. If there is a sample notebook, it appears under the Sample notebook heading in the listing.
  4. Click Preview notebook to view the notebook, and click Import notebook to import it to your Azure Databricks workspace.

Note

The Sample notebooks display and preview in the listings UI does not work in Chrome Incognito mode.

Participate in private exchanges

Some data providers might want to share certain data with a limited set of consumers who are invited to be part of a private exchange. You can find private exchange listings by selecting the Private exchange checkbox on the Marketplace home page. Just as you can with public listings, you can access free listings instantly or request access to those that are marked By request.

To join a private exchange, a data provider needs to invite your organization. When they do, they will request a shared identifier for your Unity Catalog metastore. To learn how to get your metastore’s sharing identifier, see step 1 in Get access in the Databricks-to-Databricks model.

To learn more about private exchanges, see Create and manage private exchanges in Databricks Marketplace.

Disable Marketplace access

By default, all users in any Unity Catalog-enabled workspace have the ability to request data products in Databricks Marketplace. In other words, the account users group has the USE MARKETPLACE ASSETS privilege on all Unity Catalog metastores unless a metastore admin revokes that privilege.

This privilege does not grant the ability to participate in financial transactions with data providers. All financial transactions take place outside Azure Databricks. This privilege does grant the ability to access data products that are labelled Free and instantly available and data products that have already been purchased. Accessing such data products creates new read-only catalogs in Azure Databricks that are owned by the requestor, who can grant read-only access to other users.

A metastore admin can disable all users’ ability to request data products in Databricks Marketplace by revoking the USE MARKETPLACE ASSETS privilege from the account users group on the Unity Catalog metastore. If you do revoke this privilege, users can continue to browse the Databricks Marketplace in their workspace but cannot request data products.

Permission required: Metastore admin

Note

If your workspace was enabled for Unity Catalog automatically, you might not have a metastore admin. For more information, see Automatic enablement of Unity Catalog.

Catalog Explorer

To revoke the USE MARKETPLACE ASSETS privilege for the account users group:

  1. In your Azure Databricks workspace, click Catalog icon Catalog.
  2. Click the link icon next to the metastore name at the top left.
  3. Find the row that grants account users the USE MARKETPLACE ASSETS privilege.
  4. Click the checkbox next to the row and click the Revoke button.
  5. Confirm the revoke action.
  6. Grant the privilege to any specific users and groups you like by clicking the Grant button.

SQL

To revoke the USE MARKETPLACE ASSETS privilege for the account users group, run the following command in a notebook or the Databricks SQL query editor.

REVOKE USE MARKETPLACE ASSETS ON METASTORE FROM `account users`;

To grant the USE MARKETPLACE ASSETS privilege to a specific user or group, run the following command in a notebook or the Databricks SQL query editor.

GRANT USE MARKETPLACE ASSETS ON METASTORE TO `<user-or-group>`;

If you don’t want your users to be able to view the Marketplace home page at all, contact your Azure Databricks account team.

Known issues

If a request for access is rejected by the data provider, you cannot request the same data product again. If you encounter this issue, contact your provider or Azure Databricks account team.

Share your feedback

We’d love to hear what you think about Databricks Marketplace.

  • Have feedback? Go to Learn > Provide feedback on the Marketplace home page.
  • Want to see additional datasets in the marketplace? Click Suggest a product on the Marketplace home page banner.

Next steps