Share via


Accelerate time to insights with data in Delta Lake format

Important

Some of the functionality described in this release plan has not been released. Delivery timelines may change and projected functionality may not be released (see Microsoft policy). Learn more: What's new and planned

Enabled for Public preview General availability
Admins, makers, marketers, or analysts, automatically Sep 2025 Mar 2026<!-- end ga date

Business value

Your customer data constantly grows and includes rapidly changing signals like online activities and mobile interactions. As the data set grows, reprocessing the data takes longer. This delay slows your ability to respond to changes and provides stale insights. With native support for the Delta Lake data format in Customer Insights - Data, you can speed up unifying customer data by processing only the incremental changes to your data. You get results faster and engage customers with the most up-to-date insights.

Feature details

Delta Lake format lets you track changes to your data over time. When you use Customer Insights with native support for the Delta Lake table format, you can use Delta Lake incremental data updates to speed up processing in Customer Insights - Data.

Customer profile data usually changes by only a small percentage each day. Instead of reprocessing the entire data set every day, Customer Insights - Data processes only the changed source data for unification in the Delta format. This approach saves time and delivers results faster. This improvement happens automatically when all tables use the Delta format. You don't need to set up or change anything.

We plan to add incremental processing for segments, measures, activities, and predictions in future updates.

Note

In this release, incremental unification requires that all source tables in the unification process use the Delta format. When you ingest tables to Customer Insights - Data with the Delta Lake connector or the Dataverse connector, you use the Delta format.