Importing data from Dynamics to Azure SQL Server with limitations

Adila mebrek 25 Reputation points
2023-11-08T14:40:01.24+00:00

How can I copy data from Dynamics to Azure SQL Server using the Dataverse connector in ADF when a plugin in Dynamics is limiting access to the entity I am trying to copy data from? Even when I use Fetch XML, I still get this error:

Failure happened on 'Source' side. 'Type=System.ServiceModel.FaultException`1[[Microsoft.Xrm.Sdk.OrganizationServiceFault, Microsoft.Xrm.Sdk, Version=9.0.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35]],Message=System.InvalidOperationException: Message size exceeded when sending context to Sandbox. Message size: 217Mb. Please refer to this document: https://go.microsoft.com/fwlink/?linkid=2190717
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,027 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Dillon Silzer 57,471 Reputation points
    2023-11-08T15:21:41.6066667+00:00

    Hi Adila,

    Please see the following:

    Error Code: -2147220970

    Error Message: Message size exceeded when sending context to Sandbox. Message size: ### Mb

    This error occurs when a message payload is greater than 116.85 MB, and a plug-in is registered for the message. The error message includes the size of the payload that caused this error.

    The limit helps ensure that users running applications can't interfere with each other based on resource constraints. The limit helps provide a level of protection from unusually large message payloads that threaten the availability and performance characteristics of the Dataverse platform.

    116.85 MB is large enough that it should be rare to encounter this case. The most likely situation where this case might occur is when you retrieve a record with multiple related records that include large binary files.

    If you receive this error, you can:

    In other terms, you cannot upload more than 116.85 MB. My suggestion is to do it in chunks if you want to go down this path.


    If this is helpful please accept answer.


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.