Create a Cribl connection

Important

This feature is in Beta. To use it, a workspace admin must turn on Lakeflow Connect for Cribl from the Previews page. See Manage Azure Databricks previews.

Create a Cribl connection in Catalog Explorer to store authentication credentials for Lakeflow Connect ingestion. Any user with the USE CONNECTION privilege on the connection can then create Cribl ingestion pipelines without needing direct access to the credentials.

Alternatively, admin users can create a connection and a pipeline at the same time in the data ingestion UI. See Ingest data from Cribl.Cloud.

For privilege requirements, see Connect to managed ingestion sources.

Prerequisites

Complete the source setup. Use the credentials retrieved there to create the connection.

Create a connection

1. In the Azure Databricks workspace, click Catalog > Create > Create a connection.
2. On the Connection basics page of the Set up connection wizard, specify a Connection name.
3. In the Connection type drop-down menu, select Cribl.
4. (Optional) Add a comment.
5. Click Next.
6. On the Authentication page, enter the following credentials from Configure authentication to Cribl.Cloud:
   • Client ID: Client ID from your Cribl Cloud API Credential.
   • Client Secret: Client Secret from your Cribl Cloud API Credential.
   • Workspace ID: Your Cribl Cloud Workspace ID. This value is part of your Workspace URL.
   • Organization ID: Your Cribl Cloud Organization ID.
7. Click Create connection.

Next steps

Create an ingestion pipeline.