Managed file source connectors

Databricks Lakeflow Connect provides fully-managed connectors for ingesting unstructured files from enterprise file storage services. Each connector handles source-specific authentication, incremental reads, and automated retries.

Supported connectors

Connector Description
Microsoft SharePoint Ingest files and list data from Microsoft SharePoint sites.

Connector components

A file source connector has the following components:

Component Description
Connection A Unity Catalog securable object that stores authentication details for the file storage service.
Ingestion pipeline A pipeline that copies files from the source into the destination tables. The ingestion pipeline runs on serverless compute.
Destination tables The tables where the ingestion pipeline writes the data. These are streaming tables, which are Delta tables with extra support for incremental data processing.