Azure Cosmos DB
An Azure NoSQL database service for app development.
The size of 2MB is small , Can it be adjusted to 10MB in the future?
Error writing to cosmosdb sink
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 94%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESA%3C/text%3E%3C/svg%3E)
Scott Alvis
1
Reputation point
I'm getting the following error trying to write to a cosmosdb sink. I've tried decreasing the batch size to 1 and the problem persists. Any thoughts on how to solve this problem?
Thank you!
{
"StatusCode": "DFExecutorUserError",
"Message": "Job failed due to reason: Errors encountered in bulk import API execution. PartitionKeyDefinition: {\"paths\":[\"/product_id\"],\"kind\":\"Hash\"}, Number of failures corresponding to exception of type: com.microsoft.azure.documentdb.DocumentClientException = 1; FAILURE: com.microsoft.azure.documentdb.DocumentClientException: {\"Errors\":[\"Request size is too large\"]}\nActivityId: 6efc5f73-b85b-11eb-a5d6-8560775d5c0f, Request URI: /apps/837b86bc-7029-4526-9f8c-86dc293a7b49/services/d8ea2608-02d9-4bbd-bf9b-04341fac787a/partitions/8ee291e7-b52f-4e2c-bf24-115193243591/replicas/132657744298919356p//, StatusCode: RequestEntityTooLarge, SubStatusCode: , \nRequestStartTimeUTC: \"19 May 2021 04:34:00.850\", RequestEndTimeUTC: \"19 May 2021 04:34:00.911\", Number of regions attempted: 1\nStoreResponseStatistics{requestStartTimeUTC=\"19 May 2021 04:34:00.850\", requestResponseTimeUTC=\"19 May 2021 04:34:00.911\", storeReadResult=StoreReadResult{statusCode=413, storePhysicalAddress=https://cdb-ms-prod-eastus2-fd4.documents.azure.com:14612/a",
"Details": "Errors encountered in bulk import API execution. PartitionKeyDefinition: {\"paths\":[\"/product_id\"],\"kind\":\"Hash\"}, Number of failures corresponding to exception of type: com.microsoft.azure.documentdb.DocumentClientException = 1; FAILURE: com.microsoft.azure.documentdb.DocumentClientException: {\"Errors\":[\"Request size is too large\"]}\nActivityId: 6efc5f73-b85b-11eb-a5d6-8560775d5c0f, Request URI: /apps/837b86bc-7029-4526-9f8c-86dc293a7b49/services/d8ea2608-02d9-4bbd-bf9b-04341fac787a/partitions/8ee291e7-b52f-4e2c-bf24-115193243591/replicas/132657744298919356p//, StatusCode: RequestEntityTooLarge, SubStatusCode: , \nRequestStartTimeUTC: \"19 May 2021 04:34:00.850\", RequestEndTimeUTC: \"19 May 2021 04:34:00.911\", Number of regions attempted: 1\nStoreResponseStatistics{requestStartTimeUTC=\"19 May 2021 04:34:00.850\", requestResponseTimeUTC=\"19 May 2021 04:34:00.911\", storeReadResult=StoreReadResult{statusCode=413, storePhysicalAddress=https://cdb-ms-prod-eastus2-fd4.documents.azure.com:14612/apps/837b86bc-7029-4526-9f8"
}
Azure Cosmos DB
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 26%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EH%3C/text%3E%3C/svg%3E)
HimanshuSinha 19,597 Reputation points Microsoft Employee Moderator2021-05-25T16:21:53.623+00:00 Hello @Scott Alvis ,
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, will respond back with the more details and we will try to help .
Thanks
Himanshu -
HimanshuSinha 19,597 Reputation points Microsoft Employee Moderator
2021-05-26T17:10:23.93+00:00 Hello @Scott Alvis ,
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .In case if you have any resolution please do share that same with the community as it can be helpful to others . Otherwise, will respond back with the more details and we will try to help .
Thanks
Himanshu
Sign in to comment
2 answers
Sort by: Most helpful
-
Hao Huancheng 1 Reputation point2021-09-16T03:54:14.523+00:00 -
HimanshuSinha 19,597 Reputation points Microsoft Employee Moderator
2021-05-19T21:34:49.98+00:00 Hello @Scott Alvis ,
Thanks for the ask and using the Microsoft Q&A platform .
Since you have not mentioned what is the source , I am assumeing that you may be hitting anyone of the limits called out here
Please do let me know how it goes .
Thanks
Himanshu
Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members