Create a Google Drive connection

Create a Google Drive connection in Catalog Explorer to store authentication credentials for Lakeflow Connect ingestion. Any user with the USE CONNECTION privilege on the connection can then create Google Drive ingestion pipelines without needing direct access to the credentials.

Alternatively, users with the required privileges can create a connection and a pipeline at the same time in the data ingestion UI. See Create an ingestion pipeline.

For privilege requirements, see Connect to managed ingestion sources.

The following authentication methods are supported:

Create a connection

Databricks-managed

No Google Cloud project or app registration is required. If OAuth U2M: Databricks-managed isn't listed, use OAuth U2M: Custom-managed.

Warning

Sharing a personal account connection grants other users access to your personal account's data.

  1. In the Azure Databricks workspace, click Data icon. Catalog > Create > Create a connection.
  2. On the Connection basics page of the Set up connection wizard, specify a unique Connection name.
  3. In the Connection type drop-down menu, select Google Drive.
  4. In the Auth type drop-down menu, select OAuth U2M: Databricks-managed.
  5. (Optional) Add a comment.
  6. Click Next.
  7. Click Sign in with Google and complete authentication in the pop-up window.
  8. Click Create connection.

Custom-managed

Warning

Sharing a personal account connection grants other users access to your personal account's data.

  1. Complete the Custom-managed U2M source setup. Use the authentication details that you obtain to create the connection.

  2. In the Azure Databricks workspace, click Data icon. Catalog > Create > Create a connection.

  3. On the Connection basics page of the Set up connection wizard, specify a unique Connection name.

  4. In the Connection type drop-down menu, select Google Drive.

  5. In the Auth type drop-down menu, select OAuth U2M: Custom-managed.

  6. (Optional) Add a comment.

  7. Click Next.

  8. On the Authentication page, enter the following credentials:

    • Client ID: The client ID from the source setup.
    • Client secret: The client secret from the source setup.
  9. Click Sign in with Google.

    You're redirected to the Google authorization page.

  10. Sign in with a Google account that can use the app and authorize the requested scopes.

    You're redirected to the Azure Databricks workspace.

  11. Click Create connection.

Service account

  1. Complete the service account source setup. Use the authentication details that you obtain to create the connection.
  2. In the Azure Databricks workspace, click Data icon. Catalog > Create > Create a connection.
  3. On the Connection basics page of the Set up connection wizard, specify a unique Connection name.
  4. In the Connection type drop-down menu, select Google Drive.
  5. In the Auth type drop-down menu, select OAuth Service Account.
  6. (Optional) Add a comment.
  7. Click Next.
  8. On the Authentication page, enter the following credentials:
    • Service account JSON: The contents of the service account key file from the source setup.
  9. Click Create connection.

Next steps

Create an ingestion pipeline.