Pipeline SQL language reference

This section has details for the Lakeflow Spark Declarative Pipelines SQL programming interface.

• For conceptual information and an overview of using Lakeflow Spark Declarative Pipelines SQL, see Develop Lakeflow Spark Declarative Pipelines code with SQL.
• For information on the Python API, see the Lakeflow Spark Declarative Pipelines Python language reference.
• For more information about SQL in Databricks, see SQL language reference.

You can use Python user-defined functions (UDFs) in your SQL queries, but you must define these UDFs in Python files before calling them in SQL source files. See User-defined scalar functions - Python.

SQL statements

Use these statements to work with pipelines in SQL.

• AUTO CDC INTO
• CREATE FLOW
• CREATE MATERIALIZED VIEW
• CREATE STREAMING TABLE
• CREATE TEMPORARY VIEW
• CREATE VIEW