Bulk Insertion of records in Cosmos DB getting failed

Question

Bulk Insertion of records in Cosmos DB getting failed

Debashis Jena 71

With our Web API application we are trying to upload 3500 records to cosmos DB. As regular For loop is taking much more time for uploading all the records, we are trying to upload using bulk execution. For that we have used Task.WhenAll multithreading mechanism. However it is not able to upload all the records & some of the records are not getting processed. So it seems like this mechanism is not Reliable.
Please provide how we can resolve this issue.
Please suggest if there is any other mechanisms to insert large number of records into Cosmos DB.

AgaveJoe 29,946 Reputation points

2024-02-02T13:30:31.3166667+00:00

Most likely there is a bug in your design. Is there any way you can share sample code that reproduces this issue?
Oury Ba-MSFT 20,536 Reputation points Microsoft Employee

2024-02-02T19:44:35.0266667+00:00

@Debashis Jena
Thank you for reaching out. Task.WhenAll is a reliable method to execute concurrent operations. The error could be simply that you are getting throttled for sending too many operations with your current provisioned RU. Your code could also have a bug and you are incorrectly using Task.WhenAll. We have tutorials that show ways to use the Task.WhenAll successfully: https://learn.microsoft.com/en-us/azure/cosmos-db/nosql/tutorial-dotnet-bulk-import Please suggest if there are any other mechanisms to insert large number of records into Cosmos DB. Copy and transform data in Azure Cosmos DB for NoSQL by using Azure Data Factory If you are using Azure Cosmos b for Mongo API then the following article would help. https://learn.microsoft.com/en-us/azure/cosmos-db/mongodb/tutorial-insert Regards, Oury
Debashis Jena 71 Reputation points

2024-02-03T11:33:10.7033333+00:00

We are using Cosmos DB NoSQL api. Please suggest mechanism for Bulk upload in Cosmos DB for NoSQL using C#.
AgaveJoe 29,946 Reputation points

2024-02-03T13:58:50.4766667+00:00

We cannot point out the error(s) if you do not share the code. Have you gone through the official docs linked above?
Bulk import data to Azure Cosmos DB for NoSQL account by using the .NET SDK
Debashis Jena 71 Reputation points

2024-02-03T20:23:19.5966667+00:00

Hi @AgaveJoe ,
Thanks for your response. I went through the documentation you've shared above. We've followed the same code sample described in the documentation.
Using this when I'm trying to insert 3500 records to Cosmos DB container(having 2000 RUs) it is taking more than 1 minute to process the records and some record insertion is getting failed.
AgaveJoe 29,946 Reputation points

2024-02-03T21:13:10.2533333+00:00

Your code is buggy. I'm sure how we can help you if you post your source code.

Debashis Jena 71

Hi ,
Please find below my code snippet. Please have a look into it and let my know if anything needs to be corrected.

			Container container = database.GetContainer(ContainerName);
            List<Task> concurrentTasks = new List<Task>();
            List<Response<T>> results = new List<Response<T>>();
            foreach (T item in items)
            {
                concurrentTasks.Add(container.CreateItemAsync(item)
                    .ContinueWith(itemResponse =>
                    {
                        if (!itemResponse.IsCompletedSuccessfully)
                        {
                            results.Add(new Response<T>() {Data = item, Status ='Failure'});
                        }
                        else
                        {
                            results.Add(new Response<T>() { Data = item, Status = 'Success') });
                        }
                    }));
            }
            await Task.WhenAll(concurrentTasks); 
            return results;

Accepted answer

0 additional answers

Your answer

AgaveJoe 29,946 Reputation points

2024-02-02T13:30:31.3166667+00:00

Most likely there is a bug in your design. Is there any way you can share sample code that reproduces this issue?
Oury Ba-MSFT 20,536 Reputation points Microsoft Employee

2024-02-02T19:44:35.0266667+00:00

@Debashis Jena
Thank you for reaching out. Task.WhenAll is a reliable method to execute concurrent operations. The error could be simply that you are getting throttled for sending too many operations with your current provisioned RU. Your code could also have a bug and you are incorrectly using Task.WhenAll. We have tutorials that show ways to use the Task.WhenAll successfully: https://learn.microsoft.com/en-us/azure/cosmos-db/nosql/tutorial-dotnet-bulk-import Please suggest if there are any other mechanisms to insert large number of records into Cosmos DB. Copy and transform data in Azure Cosmos DB for NoSQL by using Azure Data Factory If you are using Azure Cosmos b for Mongo API then the following article would help. https://learn.microsoft.com/en-us/azure/cosmos-db/mongodb/tutorial-insert Regards, Oury
Debashis Jena 71 Reputation points

2024-02-03T11:33:10.7033333+00:00

We are using Cosmos DB NoSQL api. Please suggest mechanism for Bulk upload in Cosmos DB for NoSQL using C#.
AgaveJoe 29,946 Reputation points

2024-02-03T13:58:50.4766667+00:00

We cannot point out the error(s) if you do not share the code. Have you gone through the official docs linked above?
Bulk import data to Azure Cosmos DB for NoSQL account by using the .NET SDK
Debashis Jena 71 Reputation points

2024-02-03T20:23:19.5966667+00:00

Hi @AgaveJoe ,
Thanks for your response. I went through the documentation you've shared above. We've followed the same code sample described in the documentation.
Using this when I'm trying to insert 3500 records to Cosmos DB container(having 2000 RUs) it is taking more than 1 minute to process the records and some record insertion is getting failed.
AgaveJoe 29,946 Reputation points

2024-02-03T21:13:10.2533333+00:00

Your code is buggy. I'm sure how we can help you if you post your source code.
Debashis Jena 71 Reputation points

2024-02-05T06:40:35.0533333+00:00

Hi ,
Please find below my code snippet. Please have a look into it and let my know if anything needs to be corrected.

Container container = database.GetContainer(ContainerName); List<Task> concurrentTasks = new List<Task>(); List<Response<T>> results = new List<Response<T>>(); foreach (T item in items) { concurrentTasks.Add(container.CreateItemAsync(item) .ContinueWith(itemResponse => { if (!itemResponse.IsCompletedSuccessfully) { results.Add(new Response<T>() {Data = item, Status ='Failure'}); } else { results.Add(new Response<T>() { Data = item, Status = 'Success') }); } })); } await Task.WhenAll(concurrentTasks); return results;

Answer 1

Bruce (SqlWork.com) 72,996

you should not create 3500 threads. use the Parallel library, and set max concurrent threads: https://learn.microsoft.com/en-us/dotnet/api/system.threading.tasks.parallel?view=net-8.0

Debashis Jena 71 Reputation points

2024-02-03T11:40:46.1233333+00:00

We have used Parallel.ForEachAsync. But we're facing the same issue.
Bruce (SqlWork.com) 72,996 Reputation points

2024-02-03T22:00:17.91+00:00

Did you set MaxDegreeOfParallelism to a reasonable value, and add proper error handling to detect why some requests failed?
Debashis Jena 71 Reputation points

2024-02-05T06:42:34.45+00:00

Hi Bruce,
Can you please let me know what value should I provide for MaxDegreeOfParallelism or how to calculate appropriate value for it?
Debashis Jena 71 Reputation points

2024-02-05T10:19:00.94+00:00

I tried with MaxDegreeOfParallelism value as 7, which is processor count of my PC minus 1. Still some of the records are not getting processed.

Share via

Bulk Insertion of records in Cosmos DB getting failed

0 additional answers

Your answer