Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
The Lakeflow Spark Declarative Pipelines SQL programming interface defines pipelines with CREATE statements, CREATE FLOW, and AUTO CDC INTO.
- For conceptual information and an overview of using Lakeflow Spark Declarative Pipelines SQL, see Develop Lakeflow Spark Declarative Pipelines code with SQL.
- For information on the Python API, see the Lakeflow Spark Declarative Pipelines Python language reference.
- For more information about SQL in Databricks, see SQL language reference.
You can use Python user-defined functions (UDFs) in your SQL queries, but you must define these UDFs in Python files before calling them in SQL source files. See User-defined scalar functions - Python.
SQL statements
Use these statements to work with pipelines in SQL.
- AUTO CDC INTO
- CREATE FLOW
- CREATE MATERIALIZED VIEW
- CREATE STREAMING TABLE
- CREATE TEMPORARY VIEW
- CREATE VIEW
You can also use the following statements to work with pipelines, but they must be run from Databricks SQL, not from within a pipeline. See Get started with data warehousing using Databricks SQL, and Use ALTER statements with pipeline datasets.