Azure data factory: Copy Data (SQL to CE) - CrmCheckPrivilege failed

I have a copy data activity in a pipeline that is throwing the following error, it copies from SQL to CE:
Failure happened on 'Sink' side. ErrorCode=DynamicsOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Dynamics operation failed with error code: -2147220839, error message: SecLib::CrmCheckPrivilege failed. Returned hr = -2147220839 on UserId: 5af0cfdd-9904-eb11-a813-000d3a654ce0 and PrivilegeType: Read.,Source=Microsoft.DataTransfer.ClientLibrary.DynamicsPlugin,''Type=System.ServiceModel.FaultException`1[[Microsoft.Xrm.Sdk.OrganizationServiceFault, Microsoft.Xrm.Sdk, Version=9.0.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35]],Message=The creator of this fault did not specify a Reason.,Source=Microsoft.DataTransfer.ClientLibrary.DynamicsPlugin,'
There is a similar copy data activity that uses the same linked service that works fine. I've tried to find the user id that is specified in the CE environment but it doesn't seem to exist.
The linked service uses a dedicated account that has the "System Administrator" privilege so shouldn't have this issue.
Any help would be appreciated.