Increasing the Fine-Tuning Dataset Limit

Question

I am using the fine-tuning model to traing on my data. Is it possible to increase the 100 MB limit for fine-tuning datasets on current models?

Answer 1

https://learn.microsoft.com/en-us/azure/ai-services/openai/quotas-limits#:~:text=Max%20size%20of%20all%20files,16%20MB

Regarding the fine-tuning dataset limit for Azure OpenAI Service, the current default quota allows a maximum size of 16 MB for all files per upload when using Azure OpenAI on your data. If you need to increase this limit, you can create a request

https://learn.microsoft.com/en-us/azure/ai-services/cognitive-services-support-options?context=/azure/ai-services/openai/context/context

Answer 2

Thanks for the question. You can use the blob storage for upload and here is the document that can help.

https://learn.microsoft.com/en-us/rest/api/azureopenai/files/import?view=rest-azureopenai-2023-05-15&tabs=HTTP