Lakeflow Designer

Important

This feature is in Public Preview.

Lakeflow Designer is a visual, no-code, AI-native experience for data preparation and analytics. Built directly in Azure Databricks, it lets users prepare and explore data through a drag-and-drop canvas and natural language. Designer workflows are backed by production-ready code and fully governed by Unity Catalog. This enables workflows to move smoothly from prototype to production, with no need to reverse-engineer or rebuild.

Task Description
What is Lakeflow Designer? Learn the concepts of Lakeflow Designer.
How to create a visual data prep in Lakeflow Designer Learn how to create a Visual data prep in Lakeflow Designer.
Ingest data into Lakeflow Designer Learn how to ingest data into a Visual data prep.
Built-in operators in Lakeflow Designer Learn about the built-in operators available in a Visual data prep.
User-defined operators in Lakeflow Designer Learn how to create your own user-defined operators for use in Lakeflow Designer.

User-defined operators

You can create your own user-defined operators for use in Lakeflow Designer.

Task Description
User-defined operators in Lakeflow Designer Overview of creating user-defined operators.
User-defined operator YAML reference A complete reference to the YAML schema for user-defined operators.
Tutorial: Compound interest calculator operator Build a user-defined operator that calculates compound interest, using Python in a Unity Catalog user-defined function (UDF).
Tutorial: K-means clustering Build a user-defined operator that uses K-means clustering, using Python in a Unity Catalog user-defined table function (UDTF).
Tutorial: Send Slack message Build a user-defined operator that sends a Slack message, using SQL in a Unity Catalog (UDF).
Tutorial: All UI widgets demo Build a user-defined operator that uses all available UI widgets, using Python in a Unity Catalog (UDF).
Tutorial: Gmail email sender operator Build a user-defined operator that sends Gmail, using Python in a standalone python-run-function.