Data Factory Pipeline Copy Activity (Cosmos DB - Mongo API) does not run

Question

A simple data copy activity pipeline in Azure Data Factory to copy collection data from one Cosmos DB Account (Mongo API) to another Cosmos DB Account (Mongo API) does fail with the following error:

{
    "errorCode": "2200",
    "message": "'Type=Microsoft.Azure.Documents.DocumentClientException,Message=, Request URI: /, RequestStats: , SDK: documentdb-dotnet-sdk/2.5.1 Host/64-bit MicrosoftWindowsNT/6.2.9200.0,Source=Microsoft.Azure.Documents.Client,'",
    "failureType": "UserError",
    "target": "dev_copy_mongo_subscriptions",
    "details": []
}

in Output:

{
    "dataRead": 44294,
    "dataWritten": 0,
    "sourcePeakConnections": 1,
    "sinkPeakConnections": 1,
    "rowsRead": 12,
    "rowsCopied": 0,
    "copyDuration": 5,
    "throughput": 8.651,
    "errors": [
        {
            "Code": 11000,
            "Message": "'Type=Microsoft.Azure.Documents.DocumentClientException,Message=, Request URI: /, RequestStats: , SDK: documentdb-dotnet-sdk/2.5.1 Host/64-bit MicrosoftWindowsNT/6.2.9200.0,Source=Microsoft.Azure.Documents.Client,'",
            "EventType": 0,
            "Category": 5,
            "Data": {},
            "MsgId": null,
            "ExceptionType": null,
            "Source": null,
            "StackTrace": null,
            "InnerEventInfos": []
        }
    ],

Answer 1

Hello @Patrick Steiner ,

I am aware that you have raised a request with the MS support , but I did try to copy a very simple document with zipcode and it worked fine for me . The error which you have pasted does not help a lot . The below clip may help you understand what I am doing .

Answer 2

Hi @Prithvi Chawla
Yes - there is a solution provided by MS Support:

Symptom:
Pipeline with Copy Activity in context of Cosmos DB Accounts (mongo) does not work
Cause:
ADF Not fully compatible with Mongo API 3.6
Resolution:
Change the host name in connection string from ‘.mongo.cosmos.azure.com’ to ‘.documents.azure.com' and then retry it.

After I adapted the connection strings stored in the Key Vault as shown above, it started to work.

Hope this helps

Answer 3

I am facing the similar issue while trying to migrate data between two different subscriptions.
I am using Key vault to store the access keys.
The error message I am getting is -

Operation on target Copy data1 failed: 'Type=Microsoft.Azure.Documents.DocumentClientException,Message=, Request URI: /, RequestStats: , SDK: documentdb-dotnet-sdk/2.5.1 Host/64-bit MicrosoftWindowsNT/6.2.9200.0,Source=Microsoft.Azure.Documents.Client,'

Is there any resolution yet? @Mike-Ubezzi-MSFT

Answer 4

@Patrick Steiner Thanks, it worked by making this change.