Copying from Cosmos DB needs many retrys to succeed

Jona Lövheim 1 Reputation point
2022-09-28T11:45:22.403+00:00

In our Azure data factory, I have a copy pipeline that copies from Cosoms DB.

This night the copy activity had to retry 87 times...

30th of august it "only" retried 17 times , and some time before time before that ran without having to retry..

what could be the reason , and any solutions?

245419-increasingtime.png

Azure Cosmos DB
Azure Cosmos DB
An Azure NoSQL database service for app development.
1,471 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,785 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Jona Lövheim 1 Reputation point
    2022-10-17T08:23:06.597+00:00

    hi! the issue was at the source side. the operation took to much time. this was because we had 7.5 million documents, and the field that I was filtering on was not indexed. So after indexing the values in the monogo DB , everything now runs smoothly.

    0 comments No comments