Azure data factory: Copy Data (SQL to CE) - CrmCheckPrivilege failed

John Lau 1

I have a copy data activity in a pipeline that is throwing the following error, it copies from SQL to CE:

Failure happened on 'Sink' side. ErrorCode=DynamicsOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Dynamics operation failed with error code: -2147220839, error message: SecLib::CrmCheckPrivilege failed. Returned hr = -2147220839 on UserId: 5af0cfdd-9904-eb11-a813-000d3a654ce0 and PrivilegeType: Read.,Source=Microsoft.DataTransfer.ClientLibrary.DynamicsPlugin,''Type=System.ServiceModel.FaultException`1[[Microsoft.Xrm.Sdk.OrganizationServiceFault, Microsoft.Xrm.Sdk, Version=9.0.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35]],Message=The creator of this fault did not specify a Reason.,Source=Microsoft.DataTransfer.ClientLibrary.DynamicsPlugin,'

There is a similar copy data activity that uses the same linked service that works fine. I've tried to find the user id that is specified in the CE environment but it doesn't seem to exist.
The linked service uses a dedicated account that has the "System Administrator" privilege so shouldn't have this issue.

Any help would be appreciated.

Saurabh Sharma 23,671 Reputation points Microsoft Employee

2021-03-10T21:12:59.997+00:00

@John Lau Thanks for using Microsoft Q&A !!

Is it a new pipeline or existing pipeline which started failing ? Also, what kind of data you are trying to import from SQL to your dynamics ? Can you please share your pipeline run id, activity id and correlation id if any so that check internally with the team. Also, share the run id of the pipeline which succeeds with the same linked service ?
John Lau 1 Reputation point

2021-03-11T09:21:10.76+00:00

The data for this specific copy data activity is moving "Accounts" into the respective CE entity.
Something I forgot to mention is that it seems to work for lower volumes but then fails when we start hitting higher volumes.

For the failed activity:
Pipeline run Id - 1dc1daa4-dad3-4b0e-8716-53a19e1806aa
Run Id - f5e4f711-8863-40a3-bf85-1f93b7f4a57a
Activity Id - f5e4f711-8863-40a3-bf85-1f93b7f4a57a

For the successful activity:
Pipeline run Id - bf084339-2920-46b2-ab84-e2304338bfe4
Run Id - b4e43db9-1176-44a4-8476-9f48c32fb2c1
Activity Id - b4e43db9-1176-44a4-8476-9f48c32fb2c1

Thanks!
Saurabh Sharma 23,671 Reputation points Microsoft Employee

2021-03-12T16:54:03.037+00:00

@John Lau Thanks for sharing. I will check and get back to you with my findings.
John Lau 1 Reputation point

2021-03-12T16:56:44.99+00:00

We now believe this was a permission issue in Dynamics CE. After some updates, we now get the following error:

It now gives a meaningful error that we can fix.
Saurabh Sharma 23,671 Reputation points Microsoft Employee

2021-03-15T23:59:29.237+00:00

@John Lau yes, looks like that. Are you able to resolve your issue ?
John Lau 1 Reputation point

2021-03-16T09:03:05.05+00:00

Yes but it the original error was really generic so not sure what was going on there.
Saurabh Sharma 23,671 Reputation points Microsoft Employee

2021-03-18T21:14:53.21+00:00

@John Lau yeah, I will provide this as a feedback internally. You can also share raise this with UserVoice available here.