Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
Important
This feature is in Beta. Workspace admins can control access to this feature from the Previews page. See Manage Azure Databricks previews.
The managed Anthropic connector in Lakeflow Connect allows you to ingest compliance and Claude usage data from Anthropic into Azure Databricks.
Feature availability
| Feature | Availability |
|---|---|
| UI-based pipeline authoring |  Supported |
| API-based pipeline authoring | Supported |
| Declarative Automation Bundles | Supported |
| Incremental ingestion | Supported Supported for the audit_log_activities, chats, and messages tables. The directory tables (organizations, users, roles, groups, and settings) are refreshed with a full snapshot on each pipeline update. |
| Unity Catalog governance | Supported |
| Orchestration using Databricks Workflows | Supported |
| SCD type 2 |  Not supportedSeveral tables contain VARIANT columns, which SCD type 2 doesn't support. |
| API-based column selection and deselection | Supported |
| API-based row filtering | Not supported |
| Automated schema evolution: New and deleted columns | Supported |
| Automated schema evolution: Data type changes | Not supported |
| Automated schema evolution: Column renames | Not supported Requires a full refresh. |
| Automated schema evolution: New tables | Supported If you ingest the entire schema. |
Authentication methods
| Authentication method | Availability |
|---|---|
| OAuth U2M | Not supported |
| OAuth M2M | Not supported |
| Basic authentication (username/password) | Not supported |
| Basic authentication (API key) | Supported Anthropic Compliance Access Key. |
Ingest from Anthropic in 3 steps
Note
Before starting, review the Azure Databricks user persona, supported interfaces, ingestion frequency, and common patterns.
Start ingesting from Anthropic
- Configure Anthropic for ingestion (Admins) — Set up Anthropic to authenticate with Azure Databricks.
- Create a Unity Catalog connection (Admins) — Create a connection in Catalog Explorer so non-admins can create pipelines.
- Create an ingestion pipeline (Admins or non-admins) — Select any supported interface and create a pipeline from an existing connection.