Ingestion framework enhancements

Important

This content is archived and is not being updated. For the latest documentation, go to the Microsoft Dynamics 365 documentation. For the latest release plans, go to Dynamics 365 and Microsoft Power Platform release plans.

Important

Some of the functionality described in this release plan has not been released. Delivery timelines may change and projected functionality may not be released (see Microsoft policy). Learn more: What's new and planned

Enabled for Public preview General availability
Admins, makers, marketers, or analysts, automatically Sep 30, 2022 To be announced

Business value

Users will quickly and efficiently ingest large amounts of data (up to 1 million records) without timeout or failure. This ability will result in more real-time visibility into their carbon emissions. Enhancements will also include the ability to create multiple connections at the same time across different data types without causing delays in data processing or throttling the ingestion engine. These enhancements will decrease processing delays and throttling issues by more efficient data processing. This will also provide engineering team baseline performance metrics to measure against future changes and prevent regressions.

Feature details

We're focusing on specific milestones with ingestion targeting requirements around volume of records, stability of ingestion, and incremental data upload. For 2022 release wave 1, we're focusing on specific milestones that include the following ingestion targeting requirements:

  • Ingest 1 million records with timeout or exception.
  • Ingest 10 100K sources at a time without timeout or exception.
  • Ingest incrementally as opposed to a full wipe-and-replace.