NetSuite connector

The managed NetSuite connector in Lakeflow Connect allows you to ingest data from NetSuite into Azure Databricks.

Feature availability

Feature	Availability
UI-based pipeline authoring	Yes
API-based pipeline authoring	Yes
Declarative Automation Bundles	Yes
Incremental ingestion	Yes
Unity Catalog governance	Yes
Orchestration using Databricks Workflows	Yes
SCD type 2	Yes
API-based column selection and deselection	Yes
API-based row filtering	No
Automated schema evolution: New and deleted columns	Yes
Automated schema evolution: Data type changes	No
Automated schema evolution: Column renames	Yes - Treated as a new column (new name) and deleted column (old name).
Automated schema evolution: New tables	Yes - If you ingest the entire schema. See the limitations on the number of tables per pipeline.
Maximum number of tables per pipeline	200

Authentication methods

Authentication method	Availability
OAuth U2M	Not supported
OAuth M2M	Not supported
OAuth (manual refresh token)	Not supported
Basic authentication (username/password)	Not supported
Basic authentication (API key)	Not supported
Basic authentication (service account JSON key)	Supported

What to know before you start

Topic	Why it matters
Azure Databricks user persona	The workflow depends on your Azure Databricks user persona: Single-user: An admin user creates a Unity Catalog connection and an ingestion pipeline. Multi-user: An admin user creates a connection for non-admin users to create pipelines with.
Authentication method	The steps to create a connection depend on the authentication method you choose.
Interface	The steps to create a pipeline depend on the interface.
Ingestion frequency	The pipeline schedule depends on your latency and cost requirements.
Common patterns	Depending on your ingestion needs, the pipeline might use configurations like history tracking, column selection, and row filtering. Supported configurations vary by connector. See Feature availability.

Start ingesting from NetSuite

The following table provides an overview of the end-to-end NetSuite ingestion flow, based on user type:

User	Steps
Admin	Configure NetSuite to enable authentication from Azure Databricks. See Configure NetSuite for ingestion into Azure Databricks. Either: Use Catalog Explorer to create a connection to NetSuite so that non-admins can create pipelines. See Create a NetSuite connection. Use the data ingestion UI to create a connection and a pipeline at the same time. See Ingest data from NetSuite.
Non-admin	Use any supported interface to create a pipeline from an existing connection. See Ingest data from NetSuite.