Share via

Not able to create a sharepoint list for a Very large dataset(10 gb) using Rest API (Python)

Mayank Agrawal 0 Reputation points
2023-10-05T05:44:01.39+00:00

I am trying to create a list in Share-point using Python Rest API. I have used the same kind of payload as mentioned in Documentation too. But the issue is I am dealing with crores of row and when I am trying to create list it mostly uploads till 750 rows and discard other and states Bad request or syntax. We are already using batch request upload (REF: https://learn.microsoft.com/en-us/sharepoint/dev/sp-add-ins/make-batch-requests-with-the-rest-apis)"learn.microsoft.com") but this seems very slow and takes only 750 requests at a time.

Do we have any option to upload bulk data in Sharepoint lists?

SharePoint
SharePoint
A group of Microsoft Products and technologies used for sharing and managing content, knowledge, and applications.
10,300 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. RaytheonXie_MSFT 33,641 Reputation points Microsoft Vendor
    2023-10-05T06:42:26.0066667+00:00

    Hi @Mayank Agrawal，

    Per my research, we have a throttling in SharePoint Online. When usage limits are exceeded, SharePoint Online throttles any further requests from that client for a short period. You can refer to the following document

    https://learn.microsoft.com/en-us/sharepoint/dev/general-development/how-to-avoid-getting-throttled-or-blocked-in-sharepoint-online

    If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".

    Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.