Not able to create a sharepoint list for a Very large dataset(10 gb) using Rest API (Python)

Question

I am trying to create a list in Share-point using Python Rest API. I have used the same kind of payload as mentioned in Documentation too. But the issue is I am dealing with crores of row and when I am trying to create list it mostly uploads till 750 rows and discard other and states Bad request or syntax. We are already using batch request upload (REF: https://learn.microsoft.com/en-us/sharepoint/dev/sp-add-ins/make-batch-requests-with-the-rest-apis)"learn.microsoft.com") but this seems very slow and takes only 750 requests at a time.

Do we have any option to upload bulk data in Sharepoint lists?

Answer 1

Hi @Mayank Agrawal，

Per my research, we have a throttling in SharePoint Online. When usage limits are exceeded, SharePoint Online throttles any further requests from that client for a short period. You can refer to the following document

https://learn.microsoft.com/en-us/sharepoint/dev/general-development/how-to-avoid-getting-throttled-or-blocked-in-sharepoint-online

---

If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".

Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.