October 2026

Azure Databricks released these features and improvements in October 2026.

Note

Releases are staged. Your Azure Databricks account might not be updated until a week or more after the initial release date.

Track Unity Gateway skill usage with audit logs and the usage dashboard

October 30, 2026

You can now track usage of Unity Gateway Skills, which are in Beta. Audit logs record skill list, load, and file fetch events under the aiGatewaySkills service. The Skills tab of the usage dashboard shows downloads, loads, and activity by user.

Microsoft Graph Logs connector is available in Beta

October 30, 2026

The managed Microsoft Graph Logs connector is now available in Beta in Databricks Lakeflow Connect.

Use the connector to ingest security alerts from Microsoft Defender XDR, Microsoft Sentinel, and other Microsoft security products into Azure Databricks. The connector uses OAuth machine-to-machine authentication with a Microsoft Entra ID application and supports incremental ingestion.

Relationships between metric views (Beta)

October 30, 2026

Relationships between Unity Catalog metric views are in Beta. Use ALTER VIEW ... ADD CONSTRAINT ... RELATIONSHIP to record how a source metric view joins to a target metric view, including the cardinality and the join condition, so that AI assistants and BI tools choose the right join path. Relationships require Databricks Runtime 19 and above, or a SQL warehouse. See Relationships between metric views.

Monitor data freshness in Lakeflow Connect database connector pipelines (Public Preview)

October 30, 2026

You can now see how current each destination table is in Lakeflow Connect database connector pipelines, in Public Preview. The new Data freshness column in the pipeline's tables list shows the time since the latest source commit that the pipeline ingested for each change data capture (CDC) table. Data freshness is available for SQL Server, PostgreSQL, MySQL, and Oracle sources.

You can also query data freshness and end-to-end lag from the ingestion pipeline's event log, and create alerts on them. See Monitor data freshness for change data capture (CDC) tables.

Moonshot AI Kimi K2.7 is retired

October 30, 2026

Moonshot AI Kimi K2.7 was retired on October 30, 2026. Kimi K3 is the recommended replacement. See Deprecated and retired models for migration guidance.

Thinking Machine Labs Inkling is retired

October 30, 2026

Thinking Machine Labs Inkling was retired on October 30, 2026. GLM 5.3 or Kimi K3 is the recommended replacement. See Deprecated and retired models for migration guidance.

Claude Code auto mode for Anthropic and non-Anthropic models

October 30, 2026

Claude Code auto mode is now supported for both Anthropic and non-Anthropic models hosted by Azure Databricks. Auto mode reviews tool calls to reduce routine permission prompts. See Auto mode.

Azure West US 2, South Central US, and Australia Southeast now have dedicated regional control planes

October 30, 2026

Azure West US 2, South Central US, and Australia Southeast now each have a dedicated regional control plane. Before this release, West US 2 and South Central US workspaces used the West US-based control plane, and Australia Southeast workspaces used the Australia East-based control plane. New workspaces created in these regions use the regional control plane and require firewall allowlist entries for the new secure cluster connectivity (SCC) relay tunnel, Control Plane NAT IPs, Metastore, and Event Hubs endpoint. Australia Southeast adds a new Log Blob storage value. South Central US also adds an East US Artifact Blob storage secondary alongside the existing North Central US value. All South Central US workspaces should allowlist both. Existing workspaces continue to use their current control plane unless they migrate to the regional control plane. See IP addresses and domains for Azure Databricks services and assets.

Xero connector is available in Beta

October 29, 2026

The managed Xero connector is now available in Beta in Databricks Lakeflow Connect. Workspace admins can enable it from the Previews page.

Use the connector to ingest accounting data such as invoices, payments, and contacts from Xero into Azure Databricks. The connector uses OAuth user authorization, ingests transaction tables such as invoices and payments incrementally, and removes deleted records for supported tables.

Simba JDBC Driver (Legacy) 2.8.6 is available

October 29, 2026

Simba JDBC Driver (Legacy) 2.8.6 prevents pending Cloud Fetch downloads from delaying the last connection from closing. It also updates lz4-java, Jackson, and libthrift. Download it from the JDBC drivers archive under All JDBC Driver Versions (Simba).

Choose a billing workspace for private endpoint charges (Public Preview)

October 29, 2026

You can now choose which workspace is billed for the hourly charges of Private Link endpoints and private network gateways in a network connectivity configuration (NCC). See Choose a billing workspace for private endpoint charges.

Native XML file format support is now generally available

October 29, 2026

Native XML file format support is now generally available. You can ingest, query, and parse XML files in batch or streaming workloads with Auto Loader, read_files, and COPY INTO, and use the from_xml and schema_of_xml SQL functions. See Read and write XML files.

Real-time mode in Lakeflow pipelines is now generally available

October 29, 2026

Real-time mode in Lakeflow pipelines is now generally available on classic compute and serverless compute. Use it for operational workloads that need end-to-end latency as low as five milliseconds, such as fraud detection. See Use real-time mode in Lakeflow pipelines.

Data quality monitoring anomaly detection is now generally available

October 29, 2026

Anomaly detection for data quality monitoring is now generally available. Enable it at the schema level to monitor the freshness and completeness of every table in the schema, based on historical data patterns. Results for all monitored tables are stored in the system.data_quality_monitoring.table_results system table, which is also now generally available. See Anomaly detection.

View personal and shared spend limits with the ug CLI

October 28, 2026

ug usage now shows up to five personal and shared spend limits, starting with the highest percentage used. Run ug usage --all to see all applicable limits. See Check your usage.

Serverless log delivery to Unity Catalog volumes (Beta)

October 28, 2026

Workspace admins can now deliver serverless job application logs to a Unity Catalog volume for retention and analysis. See Deliver serverless logs to Unity Catalog volumes.

Multiple real-time flows per serverless pipeline and source stage adaptive repartitioning are in Beta

October 28, 2026

On serverless pipelines that use the preview channel, you can run multiple real-time mode flows in one pipeline without the flows competing for task slots. Source stage adaptive repartitioning automatically adjusts the number of tasks that read from each Kafka or Kinesis source to match its traffic, so you don't need to set maxPartitions or shardsPerTask. Both capabilities are in Beta. See Serverless pipelines on the preview channel.

Request for access is now generally available

October 28, 2026

Request for access is now generally available. Users can request privileges on Unity Catalog objects from anywhere in Azure Databricks and track request status in Catalog Explorer. See Access requests.

User-aware workspace instructions for Genie One

October 28, 2026

Workspace admins can now tailor Genie One chat behavior by group. Add the recommended instruction to load a user's group memberships, then define behavior for relevant groups. See Add workspace instructions for chat.

Serverless GPU for clean room notebooks is now generally available

October 28, 2026

You can now run clean room notebooks on serverless GPU compute for model inference and training over shared data. GPU notebooks run on AI Runtime and use the same approval flow, data access, and output tables as other clean room notebooks. See Run a notebook on serverless GPU.

Editing files in Unity Catalog volumes is now generally available

October 27, 2026

You can now edit files in Unity Catalog volumes directly in the workspace file editor, without downloading and uploading them again. Open a file from Catalog Explorer or from the schema browser in a notebook or the SQL editor. See Edit files in a volume.

Unity Gateway Usage Dashboard v1.0

October 27, 2026

The Unity Gateway Usage Dashboard v1.0 is now available. Explore coding-agent adoption, harness usage, and estimated session spend. The dashboard offers expanded model and user spend analysis and tag-based spend attribution.

See Usage dashboard.

Lakeflow Designer October release

October 27, 2026

The Lakeflow Designer October release adds new AI Function and Prepare capabilities, an HTML operator, shareable full-screen previews, and tools for organizing large flows. The following updates are now available:

• Find operators by category: The Operators pane groups operators into input and output, clean, combine, transform, code, report, and canvas tools. See Built-in operators in Lakeflow Designer.
• Use ai_decide in the AI Function operator (Beta): Answer questions about text or parsed documents with probabilities, choices, or scores. See ai_decide function.
• Publish a custom operator to your workspace: In the operator panel, open a custom operator's actions menu and select Publish. The file switches to the published copy so you can reuse the operator in other visual data prep files. See Custom operators in Lakeflow Designer. _Note: user-defined operators are now called custom operators. See _Custom operators.
• Auto layout a group: Use Auto layout group in the group toolbar to arrange only the operators inside that group and leave the rest of the canvas unchanged. See Group.
• Parameter usage in the Parameters panel: The Parameters side panel now shows which operators use each parameter. Select an operator name to focus it on the canvas. See Parameters.
• Favorite operators: Right-click an operator or click in the table of contents to add it to your favorites. To show only favorites, select Filter by > Status > Favorited in the table of contents. See Use the table of contents in Lakeflow Designer.
• HTML operator: Render a custom HTML page, including embedded CSS and JavaScript, in the output pane. Connect upstream operators to display their data as charts, tables, or other views. See HTML.
• Share full-screen previews: Open a Visualization or HTML output in full screen and share the page URL. Users who open the link land on the canvas with that operator's output in full screen. See Use the output pane.
• Install custom operator dependencies: When you add a custom operator with missing dependencies, select Add dependencies, then Apply in the Environment pane to install them. See Custom operators in Lakeflow Designer.
• Sort operators by modification time: Select Modified in the table of contents Sort by menu to order operators by when they were last changed. See Sort and filter the list.
• Control runs from the file menu: Click in the file header and select Run to access Run all, Interrupt execution, clearing actions, and Go to last run operator.
• Reference operators in Genie Code: Type @ and select a canvas operator from Operators to give your prompt context about that part of the flow. See Prompt Genie Code on the canvas.
• Connect files using your own account: In a Source operator, select My Google account or My Microsoft account to connect to Google Drive, SharePoint, or OneDrive files. Sign in and provide the file link. The corresponding connector must be enabled.
• Save intermediate results with checkpoints: In Operator settings, set Checkpoint to On to save an operator's results for reuse during previews, or use Auto to let Designer choose which results to save. Saved results are reused within the same compute session.
• Organize groups and notes: Use the group hover toolbar to collapse or disable a group, and choose colors for groups and notes. Press Shift+2 to zoom to selected operators.
• New Prepare actions: Use Parse JSON to expand JSON data, Rename columns to rename multiple columns with one rule, and Multi column formula to apply one expression to selected columns. Existing actions such as Change type and Trim also accept multiple columns. See Prepare.
• Run up to an operator: Right-click an operator and select Run up to this operator to run it and its upstream operators against the full dataset. Downstream operators and disconnected branches do not run.
• Reset preview overrides: Select Apply to all operators in the Preview menu to clear individual Rows scanned overrides and use the file's current default. See Preview results.
• Improved legibility for large workflows: Operators retain their size and shape and display a new larger operator icon when you zoom out on the canvas.

OpenAI GPT-6.1 Terra is now available on Unity Gateway

October 27, 2026

OpenAI GPT-6.1 Terra is now available on Unity Gateway. You can access this model using Foundation Model APIs.

Customers are responsible for ensuring their compliance with applicable terms.

Default OAuth apps for external AI agents are now generally available

October 27, 2026

ChatGPT, Codex, Claude, Claude Code, and Cursor can now connect to Azure Databricks MCP servers, including the Genie One MCP server, using default OAuth client IDs. An account admin doesn't need to create an OAuth app. See Default OAuth client IDs.

AI Functions Unity Catalog permissions is now generally available

October 27, 2026

AI Functions Unity Catalog permissions is now generally available. Metastore admins can use Unity Catalog permissions on the system.ai schema to control which task-specific AI Functions users in your organization can run. Contact your Databricks account team to enable this feature. See AI Functions Unity Catalog permissions.

QuickBooks connector is available in Beta

October 26, 2026

The managed QuickBooks connector is now available in Beta in Databricks Lakeflow Connect.

Use the connector to ingest accounting data such as accounts, customers, vendors, items, invoices, bills, payments, and journal entries from QuickBooks Online into Azure Databricks. The connector uses OAuth user authorization and supports incremental ingestion with delete capture.

Improved Lakeflow Performance Observability is now generally available

October 26, 2026

Lakeflow Jobs now show query performance metrics and insights at the job level for supported tasks. You can view job-level data volume metrics and use the Optimize button to open Genie Code to help improve queries with performance insights. See View query performance metrics for serverless jobs.

Check budget usage with the Spend Status API

October 26, 2026

Use the Spend Status API to check your usage against Unity Gateway budget limits. Retrieve a single budget's spend status or list statuses across budgets. See Budget Spend Status API.

Account-level security features are now available by default at GA

October 26, 2026

Going forward, account-level security features will be available to all accounts immediately upon General Availability (GA), without requiring account admins to manually enable them on the Previews page. Account admins must still configure these features before they take effect.

This includes features for network connectivity (such as private connectivity), network security (such as ingress and egress controls), encryption, and enhanced security and compliance.

Why are we making this change?

This change makes it easier for platform teams to discover and adopt security best practices as soon as new security capabilities become generally available. Making these features available does not automatically change an account's security configuration or enforce new controls. Account admins retain full control over whether and how to adopt them.

Use Claude desktop and ChatGPT desktop work agents with Unity Gateway

October 24, 2026

You can now use ug to configure the Claude desktop and ChatGPT desktop work agents with governed models, MCP servers, and skills. Subscription relay is available only in Claude desktop. Learn more.

DataFrame caching on serverless compute is now in Public Preview

October 23, 2026

DataFrame caching on serverless compute is now in Public Preview. You can cache a DataFrame with df.cache() or df.persist() on serverless compute to reuse an expensive result for the rest of your session. Caching requires serverless environment version 5 or above, Databricks Connect for Python 18.1.8 or above, or Databricks Connect for Scala 18.1.5 or above. The preview is enabled by default for most workspaces. Workspace admins can disable it from the Previews page. See Cache DataFrames on serverless compute.

Google Analytics Aggregated connector is available in Beta

October 23, 2026

The managed Google Analytics Aggregated connector is now available in Lakeflow Connect in Beta. Workspace admins can control access to this feature from the Previews page.

Use the connector to ingest aggregated Google Analytics 4 report data, such as user activity, acquisition, engagement, monetization, demographics, and tech reports, into Azure Databricks. You can also define custom reports with your own dimensions, metrics, and aggregation level. The connector supports incremental ingestion and both service account and OAuth user-to-machine (U2M) authentication.

Genie agentic capabilities are now processed in South Korea

October 23, 2026

Genie Code agentic capabilities, Genie Agents Agent mode, and chat in Genie One now process data within South Korea for workspaces in South Korea regions, without cross-Geo processing. For where each AI assistive feature processes data, see Databricks Designated Services.

Files API 3.0 for Unity Catalog volumes is now in Beta

October 23, 2026

Files API 3.0 is in Beta and introduces two new capabilities:

• Multipart uploads: Upload files larger than 5000 MiB to Unity Catalog volumes.
• Conditional operations: Upload, download, and delete files based on their current version to prevent unintended changes.

For more information, see Use the Files API with Unity Catalog volumes.

Box Audit Logs managed ingestion connector (Beta)

October 23, 2026

The Box Audit Logs connector in Lakeflow Connect is now available in Beta. Use the connector to ingest enterprise audit events from Box into Azure Databricks. See Box Audit Logs connector.

Serverless job environments from pyproject.toml (Beta)

October 22, 2026

Serverless notebook and Python script tasks can use a pyproject.toml file to configure their job environment. Configure the project environment in the Jobs UI, the Jobs API, or a bundle. Workspace admins can enable Project-Scoped Shared Compute on the Previews page. See Configure a project environment with pyproject.toml.

Shared Serverless (Beta)

October 22, 2026

With Shared Serverless, notebooks and files in the same bundle can share serverless compute and an environment defined in the bundle-root pyproject.toml file. Workspace admins can enable Project-Scoped Shared Compute on the Previews page. See Use Shared Serverless in bundles.

Screen MCP tool calls and results for jailbreaks (Beta)

October 21, 2026

You can now screen MCP tool calls and their results in Unity Gateway for jailbreak and prompt injection attempts. Apply the Jailbreak guardrail on input, output, or both. See Attach a built-in policy.

Lakeflow pipelines system tables are now generally available (GA)

October 21, 2026

The lakeflow system tables pipelines and pipeline_update_timeline are now generally available. These tables record the pipelines and pipeline updates in your account.

For a reference of these tables, see Jobs system table reference.

Genie Code tasks in Lakeflow Jobs are now generally available

October 21, 2026

Genie Code tasks in Lakeflow Jobs are now generally available. A Genie Code task runs your prompt autonomously as part of a job. It can read upstream task outputs and call tools as needed, and it returns a link to the resulting Genie Code chat with its response. See Genie Code task for jobs.

SurveyMonkey connector is available in Beta

October 20, 2026

The managed SurveyMonkey connector is now available in Lakeflow Connect in Beta. Workspace admins can control access to this feature from the Previews page.

Use the connector to ingest surveys, survey structure, collectors, survey responses, and contacts from SurveyMonkey into Azure Databricks. The connector uses OAuth user-to-machine (U2M) authentication and supports incremental ingestion, UI-based pipeline authoring, Declarative Automation Bundles, and API-based pipeline authoring.

Oracle Eloqua connector is available in Beta

October 20, 2026

The managed Oracle Eloqua connector is now available in Lakeflow Connect in Beta. Workspace admins can control access to this feature from the Previews page.

Use the connector to ingest marketing data such as contacts, accounts, campaigns, email and form assets, form submissions, events, and website visitors from Oracle Eloqua into Azure Databricks. The connector uses OAuth user-to-machine (U2M) authentication and supports incremental ingestion, UI-based pipeline authoring, Declarative Automation Bundles, and API-based pipeline authoring.

Asana connector is available in Beta

October 20, 2026

The managed Asana connector is now available in Lakeflow Connect in Beta. Workspace admins can control access to this feature from the Previews page.

Use the connector to ingest work management data such as workspaces, teams, projects, tasks, portfolios, and goals from Asana into Azure Databricks. The connector uses OAuth user-to-machine (U2M) authentication.

ai_enrich can ground rows with external MCP search providers (Beta)

October 20, 2026

The ai_enrich function can ground each row with a search tool on an external Model Context Protocol (MCP) server that you register in Unity Gateway, such as You.com or Exa. Add an mcp knowledge source alone or alongside other knowledge sources in the same call. This feature is in Beta. Workspace admins can enable the Ai Enrich preview from the Previews page.

See MCP configuration.

Saving an unchanged job no longer adds rows to the jobs system tables

October 19, 2026

Saving a job without changing its settings no longer adds rows to system.lakeflow.jobs or system.lakeflow.job_tasks, and change_time stays at the last change. This applies to saves from the UI, the Jobs API, and Declarative Automation Bundles. See Jobs table schema.

Filter data per end user with OAuth custom identity claims

October 19, 2026

You can now add a custom identity claim to a service principal's OAuth token and filter rows by it in a dynamic view or ABAC policy. Serve many end users through one service principal while each sees only their own data.

See Filter data per end user with OAuth custom identity claims.

DeepSeek V4.1 Flash is scheduled for retirement

October 19, 2026

DeepSeek V4.1 Flash will be retired on November 19, 2026. DeepSeek V4.1 Flash (1017) is the recommended replacement. See Deprecated and retired models for migration guidance.

DeepSeek V4.1 Flash (1017) is now available on Unity Gateway

October 19, 2026

DeepSeek V4.1 Flash (1017) is now available on Unity Gateway with text and image inputs. See supported regions. You can access this model using Foundation Model APIs.

Customers are responsible for ensuring their compliance with applicable terms.

Asynchronous processing with transformWithState is now generally available

October 19, 2026

Asynchronous processing for the Python row-based transformWithState API is now generally available. Run state operations and user logic concurrently for higher throughput with only minor code changes. See Asynchronous processing with transformWithState.

TypeSafe AI Jev 1.14.0 is now available on Unity Gateway

October 16, 2026

TypeSafe AI Jev 1.14.0 is now available on Unity Gateway. TypeSafe AI hosts it, and an account admin must enable the TypeSafe AI Models preview. TypeSafe's terms govern its use.

READ METADATA privilege support for compliance security profile standards

October 16, 2026

The READ METADATA privilege now supports all compliance security profile standards supported by Azure Databricks and is available by default for workspaces with the compliance security profile enabled.

For a full list of supported compliance standards, see Compliance security profile.

Delegate budget access with access control lists (ACLs)

October 16, 2026

Budgets now support access control lists (ACLs). Account and workspace admins can grant the Budget Manager or Budget Viewer role to users, groups, or service principals, delegating who can view and manage a budget. See Manage budget permissions.

ADBC driver for Power BI is now generally available

October 15, 2026

The Arrow Database Connectivity (ADBC) driver for the Azure Databricks connector for Power BI is now generally available. ADBC is the default driver for new connections in Power BI Desktop and the Power BI service. See Configure ADBC or ODBC driver for Power BI.

MySQL integrated CDC pipeline is now generally available

October 15, 2026

The integrated CDC pipeline for MySQL is now generally available. An integrated CDC pipeline ingests change data from MySQL into Azure Databricks using a single pipeline, combining extraction and application into one pipeline update. Unlike the standard gateway-based architecture, an integrated CDC pipeline requires no separate ingestion gateway. See Create an integrated CDC pipeline for MySQL.

Data Classification adds 50 new classes and support for 16 more countries and regions

October 15, 2026

Data Classification now detects 50 new classes of sensitive data, along with new regional support for 16 countries and regions:

• Payment card and financial data: Card security codes, card expiration dates, card track data, card PINs, SWIFT codes, and credit scores.
• Personal and employee data: Gender, residency status, disability data, sexual data, street addresses, geographic coordinates, compensation, and employment status.
• Software security secrets: Credentials and secrets used by software.
• Regional identifiers: Added 35 new classes and expanded coverage in existing classes across 18 countries and regions, including China, Mexico, the UK, other European countries, and more. See the documentation for details.

Regional tags are available in select regions. See Supported classification tags.

Context-based ingress policies for inbound private connectivity are now generally available

October 15, 2026

Context-based ingress policies for inbound Private Link are now generally available. Control which registered private endpoints can reach your workspaces, and combine endpoint rules with identity and request type conditions in the same policy. To use them, an account admin turns on Context-Based Ingress: Workspace Private Access Policies from the account console Previews page. See Private network access.

Consumer access to query Unity Gateway services is generally available

October 15, 2026

Users with the consumer access entitlement no longer need an account admin to enable the "Consumer access to Unity Gateway" preview to query the model services and model provider services shared with them, or to use Unity Gateway coding agent features. See Consumer access capabilities.

This change can increase model traffic from consumer access users, including traffic to external providers. To control this traffic, account admins can set budgets and rate limits, or disable direct model access, for consumer access users. See Manage budgets for Unity Gateway, Apply rate limits to model and MCP services, and Manage entitlements.

Redesigned MLflow Logs tab for AI Runtime runs

October 15, 2026

The MLflow run page Logs tab for AI Runtime runs now supports searching and filtering logs by node, level, and time range, following a running workload as new output arrives, and downloading logs. For new runs, it replaces the log files previously stored on the run's Artifacts tab, which are deprecated. Logs are available for 60 days. Logs for existing runs remain on the Artifacts tab. See View logs in the MLflow Logs tab.

Genie Migrate is generally available for SQL conversion

October 15, 2026

Genie Migrate, formerly the agentic code converter, is now generally available for the SQL target framework. Powered by Genie Code, it converts SQL from dialects such as T-SQL, Snowflake, Redshift, Oracle, BigQuery, and Teradata into Databricks SQL queries. You organize the work in a migration project, and Genie Migrate validates the output and fixes errors before writing the results to a workspace folder. After a conversion, you can continue chatting with Genie Code about the converted files to address action items or summarize the changes.

See Convert SQL with Genie Migrate.

Transactions support both managed Delta Lake and Apache Iceberg tables

October 14, 2026

Transactions are generally available for both Unity Catalog managed Delta Lake tables and Unity Catalog managed Apache Iceberg tables. Group multiple SQL statements across one or more managed Delta Lake or managed Apache Iceberg tables into a single atomic transaction using BEGIN ATOMIC ... END; or BEGIN TRANSACTION; ... COMMIT; syntax. Transactions require catalog commits enabled on participating tables.

See Transactions.

Genie agentic capabilities are now processed in India

October 14, 2026

Genie Code agentic capabilities, Genie Agents Agent mode, and chat in Genie One now process data within India for workspaces in India regions, without cross-Geo processing. For where each AI assistive feature processes data, see Databricks Designated Services.

Data Classification API is now generally available

October 14, 2026

The Data Classification API and its Terraform resource are now generally available. Auto-tagging configuration (auto_tag_configs) remains in Public Preview. See the API reference.

Workspace-level package repositories for Databricks Apps are generally available

October 14, 2026

Workspace admins can now configure default Python and npm package repositories for Databricks Apps. Apps inherit the workspace configuration while still allowing app-level overrides.

See Configure default package repositories.

On-demand state repartitioning is now generally available

October 13, 2026

On-demand state repartitioning is now generally available. You can resize the number of shuffle partitions for a stateful Structured Streaming query or Lakeflow pipeline without losing checkpoint state. See On-demand state repartitioning for stateful streaming queries.

External writes to managed Delta tables are now generally available

October 13, 2026

Support for creating and writing to Unity Catalog managed Delta tables from external Apache Spark clients is now generally available. Tables must have catalog commits enabled. See Access Databricks tables from Delta clients.

Google Gemini 4 Argon is now available on Unity Gateway

October 13, 2026

Google Gemini 4 Argon is now available on Unity Gateway. You can access this model using Foundation Model APIs.

Customers are responsible for ensuring their compliance with applicable terms.

External access to views through the Unity REST API is generally available

October 13, 2026

External engines can now query Unity Catalog views over Delta Lake tables through the Unity REST API. See External access to views.

Cribl connector is available in Beta

October 13, 2026

The managed Cribl connector is now available in Beta in Databricks Lakeflow Connect.

Use the connector to ingest Cribl.Cloud Worker Group configuration, worker and health status, organization metadata, and Leader audit and access logs into Azure Databricks. The connector uses OAuth machine-to-machine authentication and supports incremental ingestion for audit and access logs.

Shared output in clean rooms is now generally available

October 13, 2026

Clean room runs can now write to a shared output schema that every collaborator can read as soon as each table is created, even before the run finishes. Use it to share results, logs, and debugging information with all collaborators. See Share output with all collaborators.

JAR workloads in clean rooms are now generally available

October 13, 2026

You can now run compiled Java or Scala code in clean rooms. Run a JAR as its own clean room analysis, or register a function from a JAR and call it from a clean room notebook as a temporary UDF. See Run JAR workloads in Azure Databricks clean rooms.

Create clean rooms with identity resolution providers in one step (GA)

October 13, 2026

You can now create a ready-to-use packaged clean room with an approved identity resolution provider, such as Acxiom, Adstra, LiveRamp, or The Trade Desk, in one step from the Clean Rooms page. The provider is preconfigured as the package provider, so you can add your data and run the provider's analysis right away. See Create a clean room with an identity resolution provider.

Databricks AI Runtime SDK replaces serverless_gpu

October 13, 2026

Starting in GPU environment version 6, the Databricks AI Runtime SDK (databricks-sdk-air) replaces the deprecated serverless_gpu package. It provides the @distributed and ray_init APIs and the databricks.air.data utilities under the databricks.air namespace. The gpus and gpu_type arguments are renamed to num_accelerators and accelerator_type. The old names still work in databricks.air but emit a FutureWarning, and support will end in version 7.

Serverless GPU environment version 6 includes both packages. Version 6 is the last version that includes serverless_gpu. Versions 5 and below continue to use it. See Migrate from serverless_gpu.

Zoho CRM connector is available in Beta

October 12, 2026

The managed Zoho CRM connector is now available in Beta in Databricks Lakeflow Connect.

Use the connector to ingest CRM records such as leads, contacts, accounts, and deals, plus activities, line items, settings data, and custom modules, from Zoho CRM into Azure Databricks. The connector uses OAuth client credentials and supports incremental ingestion.

Unity Gateway Skills API and developer tools are available in Beta

October 12, 2026

The Unity Gateway Skills REST API is now available in Beta, with create, read, update, list, delete, and finalize support across Azure Databricks developer tools:

• Databricks CLI
• Python SDK
• Go SDK
• Go Modular SDK
• Java SDK
• JavaScript SDK

See the Skills API and SDK reference.

Governed tag propagation is in Beta

October 12, 2026

Tag propagation in Unity Catalog is in Beta. When you enable tag propagation for a governed tag, Unity Catalog uses lineage to automatically apply that tag to derived tables and views whenever a supported operation runs, such as CREATE TABLE AS SELECT, CREATE VIEW, INSERT INTO ... SELECT, or MERGE. This keeps classification and ABAC enforcement consistent at both the table and column levels as data moves downstream.

See Tag propagation.

Parameters for Lakeflow pipelines are now generally available

October 12, 2026

Pipeline parameters are now generally available. Parameterize Lakeflow pipeline SQL source code with key-value pairs so a single pipeline can run against different catalogs, schemas, or tables without editing the source. Define parameter defaults in pipeline settings, override them when you start an update, and reference them in SQL with named parameter syntax. See Use parameters with pipelines.

PayPal connector is available in Beta

October 24, 2026

The managed PayPal connector is now available in Beta in Databricks Lakeflow Connect.

Use the connector to ingest payments data such as transactions, disputes, invoices, balances, catalog products, and billing plans from PayPal into Azure Databricks. The connector uses OAuth client credentials and supports incremental ingestion.

Agent memory pipelines are in Beta

October 12, 2026

Agent memory pipelines are in Beta. A memory pipeline connects a session store to a memory store. Each run uses an LLM to distill durable facts, preferences, and decisions from stored conversations into memory entries that your agent recalls in later conversations. You can run a pipeline on demand or about every 24 hours. See Agent memory pipelines.

Knowledge Assistant and Supervisor Agent are now legacy

October 12, 2026

Knowledge Assistant and Supervisor Agent are now legacy offerings. For new agents written in code, Databricks recommends the Agent Bricks CLI. To build agents without code, use Genie Agents. See Legacy agent offerings.

Feature Views are now generally available

October 12, 2026

Feature Views are now generally available for batch, streaming, and request-time data. They will be enabled for compliance security profile workspaces in mid-November 2026. See Feature Views.

Use request tags in Unity Gateway service policies (Beta)

October 9, 2026

Custom service policies in Unity Gateway can now check caller-supplied request tags, such as requiring a tag before a model request or MCP tool call proceeds. See Request tags.

Use OpenJev as the evaluator for LLM-as-a-judge service policies (Beta)

October 9, 2026

You can now select OpenJev (Qwen3.5 4B) as the evaluator model service of a custom LLM-as-a-judge service policy. OpenJev classifies content without generating output tokens, so it typically responds faster than a chat evaluator. See Use OpenJev as the evaluator.

Google Workspace connector is available in Beta

October 9, 2026

The managed Google Workspace connector is now available in Beta in Databricks Lakeflow Connect.

Use the connector to ingest audit activity from Google Workspace applications and services into Azure Databricks. The connector uses OAuth user authorization and supports incremental ingestion.

Unity Gateway supports Amazon Bedrock Mantle

October 9, 2026

You can now access Amazon Bedrock Mantle models through Unity Gateway model provider services, with Unity Catalog permissions, rate limits, budgets, and inference tables. See Model providers external to Databricks.

Productboard connector is available in Beta

October 8, 2026

The managed Productboard connector is now available in Lakeflow Connect in Beta. Workspace admins can control access to this feature from the Previews page.

Use the connector to ingest product hierarchy, roadmap, objectives, customer feedback notes, and workspace member data from Productboard into Azure Databricks. The connector uses Server-to-Server OAuth authentication and supports incremental ingestion for notes, UI-based pipeline authoring, Declarative Automation Bundles, and API-based pipeline authoring.

Microsoft Entra ID connector is available in Beta

October 22, 2026

The managed Microsoft Entra ID connector is now available in Beta in Databricks Lakeflow Connect.

Use the connector to ingest Microsoft Entra ID users, groups, applications, service principals, directory roles, identity configuration, and audit and sign-in logs into Azure Databricks. The connector uses OAuth machine-to-machine authentication and supports incremental ingestion for audit and sign-in logs.

The Discover page and domains are now GA

October 8, 2026

The Discover page and domains are now generally available. Discover is a curated browsing experience that helps users find assets across Azure Databricks without requiring deep knowledge of catalog hierarchies. Use domains and subdomains to organize assets such as tables, dashboards, notebooks, and Genie Agents by business area, highlight key assets with custom curation, and explore AI-recommended assets.

Azure Standard HDD OS disk retirement

October 8, 2026

Azure will retire Standard HDD OS disks on September 8, 2028. Before this date, Azure Databricks will migrate the affected classic compute resources. A future release note will confirm when the migration is complete and when to restart your compute.

Azure DevOps connector is available in Beta

October 8, 2026

The managed Azure DevOps connector is now available in Beta in Databricks Lakeflow Connect.

Use the connector to ingest project, repository, work item, build, release, and identity data from Azure DevOps into Azure Databricks. The connector authenticates with a Microsoft Entra service principal and supports incremental ingestion of commits.

Enforce partner guardrails with external service policies (Beta)

October 7, 2026

You can now enforce a third-party guardrail on Unity Gateway traffic. An external service policy sends request and response content to your guardrail vendor and blocks the call when the vendor denies it, with no changes to your applications. See Enforce a partner guardrail with an external service policy.

DeepSeek V4.1 Flash supports priority pay-per-token and reserved provisioned throughput

October 7, 2026

You can now use DeepSeek V4.1 Flash with priority pay-per-token for latency-sensitive traffic or reserved provisioned throughput for dedicated capacity.

Dataset materialization for AI/BI dashboards is now in Beta

October 7, 2026

You can now pre-compute and store dashboard dataset results on a schedule to make dashboard interactivity much faster. Published dashboards render from stored results instead of rerunning expensive queries on every load or interaction. See Dataset materialization in AI/BI dashboards.

Azure Databricks integration for Microsoft Copilot Studio is now generally available

October 7, 2026

Using Azure Databricks data in Microsoft Copilot Studio is now generally available. Connect Genie Agents as tools or use your Azure Databricks data as a knowledge source to build custom agents. See Use Azure Databricks data in Microsoft Copilot Studio.

Anthropic Claude Haiku 5.5 is now available on Unity Gateway

October 7, 2026

Anthropic Claude Haiku 5.5 is now available on Unity Gateway. You can access this model using Foundation Model APIs.

Customers are responsible for ensuring their compliance with applicable terms.

Metric view window measures are generally available

October 6, 2026

Window measures in metric views are now generally available. Window measures define rolling window, cumulative, or semiadditive aggregations, such as moving averages, period-over-period changes, and running totals. See Window measures.

Zhipu AI GLM 5.2 is now a legacy model

October 6, 2026

GLM 5.2 is now a legacy model. Databricks recommends migrating to GLM 5.3 or GLM 5.3 Flash.

Genie Code CLI is in Beta

October 6, 2026

Genie Code CLI is a coding agent that runs in your terminal, tuned for data and AI work on Azure Databricks. It works with your local files and uses the Databricks CLI to discover data, answer questions, and build and deploy assets such as pipelines, models, and apps. Model access is provided and governed through Unity Gateway. See Genie Code CLI.

DeepSeek V4 Flash (0731) is scheduled for retirement

October 6, 2026

DeepSeek V4 Flash (0731) will be retired on November 5, 2026. DeepSeek V4.1 Flash is the recommended replacement. See Deprecated and retired models for migration guidance.

Use multiple triggers for Lakeflow Jobs (Beta)

October 5, 2026

Lakeflow Jobs can now use up to five triggers. You can combine trigger types, add multiple triggers of the same type, and pause each trigger independently. See Add multiple triggers to a job.

Run Lakeflow pipelines as a group

October 5, 2026

You can now set a pipeline's run-as identity to an account group, in addition to a user or a service principal. Pipeline updates run with the group's permissions, so a team can own an automated pipeline without tying it to one person's account. See Set the run-as identity to a group.

Genie Code scheduled tasks are now available by default for workspaces with the compliance security profile enabled

October 5, 2026

Genie Code scheduled tasks are now available by default for workspaces with the compliance security profile enabled.

See Genie Code scheduled tasks.

ai_parse_document now extracts chart data as JSON

October 5, 2026

ai_parse_document now extracts chart values as structured JSON and describes their series, legends, and axes. Search and agents can use these values in answers. See ai_parse_document function.

Agent Bricks documentation for code-first agent development

October 5, 2026

The Agent Bricks documentation now centers on building, deploying, and running custom agents in code. See Develop agents on Azure Databricks:

• Agent compute stack: New pages describe how a deployed agent's framework or harness, agent server, and agent runtime fit together. See Deploy agents on Azure Databricks.
• DurableAgentServer and Agent Runtime: DurableAgentServer serves agents through the invocation API, with synchronous, streaming, and background runs, persistent run state, and crash recovery. Agent Runtime runs it on Databricks Apps. See Agent Server and Agent Runtime.
• Querying agents: The query guide is organized by agent server, starting with the invocation API. See Query agents deployed on Azure Databricks.
• Legacy offerings: Offerings that are no longer recommended for new agents, including the MLflow AgentServer, LongRunningAgentServer, and agents deployed to Model Serving, are now in a Legacy section that maps each one to its replacement. See Legacy agent offerings.

OpenJev (Qwen3.5 4B) is now available on Unity Gateway

October 2, 2026

OpenJev (Qwen3.5 4B) is available as a pay-per-token model service. Use the TypeSafe System One API to evaluate yes or no, choice, and scoring questions and get structured answers and probabilities. See model availability by region.

Customers are responsible for ensuring their compliance with applicable model terms.

JDBC Unity Catalog connections are now generally available

October 2, 2026

JDBC Unity Catalog connections are now generally available on serverless compute, Databricks Runtime 19 and above, and SQL warehouses 2025.40 and above, including support for SSL certificates. OAuth M2M authentication remains in Beta. See JDBC connection.

Save reusable query templates in Google Sheets

October 2, 2026

The Databricks Connector for Google Sheets now lets you save imports as a reusable template that you and your team can run in one step, each with your own Unity Catalog permissions. See Templates in Google Sheets and Query Azure Databricks data in Google Sheets.

Google Gemini 2.5 Pro is retired

October 2, 2026

Google Gemini 2.5 Pro is no longer available. The recommended replacement models are Gemini 3.1 Pro or Gemini 3.5 Flash. See Deprecated and retired models for migration guidance.

Google Gemini 2.5 Flash is retired

October 2, 2026

Google Gemini 2.5 Flash is no longer available. The recommended replacement models are Gemini 3.1 Pro or Gemini 3.5 Flash. See Deprecated and retired models for migration guidance.

Customer-managed keys for query history are now generally available

October 2, 2026

You can now use a customer-managed key on the system catalog to decrypt statement_text and error_message in the query history system table. See Reading encrypted fields.

ai_parse_document now extracts chart data

October 2, 2026

ai_parse_document now returns more detailed figure descriptions. For charts, the description also includes the chart data as structured JSON, such as series values and legend labels. See ai_parse_document function.

Standard ai_extract now delivers higher-quality extraction

October 2, 2026

The standard (default) mode for ai_extract now uses a new model checkpoint that is 2.3x faster while improving overall quality at no additional cost. See the ai_extract documentation.

Vimeo connector (Beta)

October 1, 2026

The Vimeo connector is now available in Lakeflow Connect in Beta. Workspace admins can control access to this feature from the Previews page.

The connector ingests team, team member, team role, and audit log data from Vimeo into Azure Databricks. Authentication uses a Vimeo personal access token.

See Vimeo connector.

GitLab connector is available in Beta

October 1, 2026

The managed GitLab connector is now available in Lakeflow Connect in Beta. Workspace admins can control access to this feature from the Previews page.

Use the connector to ingest repository, project, group, CI/CD, and security data from GitLab into Azure Databricks. The connector uses OAuth U2M authentication and supports incremental ingestion, UI-based pipeline authoring, Declarative Automation Bundles, and API-based pipeline authoring.

Schedule automatic data refresh in the Azure Databricks Excel Add-in (Public Preview)

October 1, 2026

You can now schedule automatic refreshes of Azure Databricks data imported into Microsoft Excel. Choose an interval or calendar schedule and the SQL warehouse that runs each refresh, then review recent runs from the Azure Databricks Excel Add-in. See Schedule automatic data refresh in the Azure Databricks Excel Add-in.

Cross-engine attribute-based access controls (ABAC) is now generally available

October 1, 2026

Cross-engine attribute-based access controls (ABAC) is now generally available. Supported external engines can read Unity Catalog managed tables with ABAC policies, row filters, and column masks enforced by Azure Databricks serverless compute.

See Cross-engine attribute-based access controls (ABAC) for requirements, supported clients, and serverless compute costs.