Any way to exceed 10mb payload size limit in Custom Text Classification API?

Jurijs Tolokoncevs 16 Reputation points
2022-10-14T07:59:21.143+00:00

Hi. I am training a Custom Text Classification model. 500k text documents are uploaded to Blob storage, so I only have to use API to create a training project.

Issue that I am facing is that in API for project creation payload is limited to 10mb. My training set would requite a payload of about 80mb.

This would be fine if I could create a project and then append labeled documents to it in multiple batches, but from what I am able to see, in Custom Text Classification API the only way to add this data is to do it once during project creation. This means available training dataset for this service is hard-limited to whatever I can fit in 10mb payload.

Does this make sense? I imagine there needs to be a way to add more data labels than fits into 10mb payload to a project?

PS: I tried to upload json file to blob and create project this way, but it looks like this approach uses same API and is limited to the same 10mb payload restriction. I also tried to create a project and then substitute the project json in blob, but it then fails, complaining that file was manually changed.

Azure AI Language
Azure AI Language
An Azure service that provides natural language capabilities including sentiment analysis, entity extraction, and automated question answering.
430 questions
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
2,959 questions
{count} votes

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.