Importing data from Dynamics to Azure SQL Server with limitations

Adila mebrek 0 Reputation points

How can I copy data from Dynamics to Azure SQL Server using the Dataverse connector in ADF when a plugin in Dynamics is limiting access to the entity I am trying to copy data from? Even when I use Fetch XML, I still get this error:

Failure happened on 'Source' side. 'Type=System.ServiceModel.FaultException`1[[Microsoft.Xrm.Sdk.OrganizationServiceFault, Microsoft.Xrm.Sdk, Version=, Culture=neutral, PublicKeyToken=31bf3856ad364e35]],Message=System.InvalidOperationException: Message size exceeded when sending context to Sandbox. Message size: 217Mb. Please refer to this document:
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
8,451 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Dillon Silzer 49,071 Reputation points

    Hi Adila,

    Please see the following:

    Error Code: -2147220970

    Error Message: Message size exceeded when sending context to Sandbox. Message size: ### Mb

    This error occurs when a message payload is greater than 116.85 MB, and a plug-in is registered for the message. The error message includes the size of the payload that caused this error.

    The limit helps ensure that users running applications can't interfere with each other based on resource constraints. The limit helps provide a level of protection from unusually large message payloads that threaten the availability and performance characteristics of the Dataverse platform.

    116.85 MB is large enough that it should be rare to encounter this case. The most likely situation where this case might occur is when you retrieve a record with multiple related records that include large binary files.

    If you receive this error, you can:

    In other terms, you cannot upload more than 116.85 MB. My suggestion is to do it in chunks if you want to go down this path.

    If this is helpful please accept answer.