Increasing the Fine-Tuning Dataset Limit

Jai-6363 245 Reputation points
2023-11-15T13:16:59.2766667+00:00

I am using the fine-tuning model to traing on my data. Is it possible to increase the 100 MB limit for fine-tuning datasets on current models?

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,481 questions
0 comments No comments
{count} votes

2 answers

Sort by: Most helpful
  1. Sedat SALMAN 13,265 Reputation points
    2023-11-15T14:00:04.2733333+00:00

    https://learn.microsoft.com/en-us/azure/ai-services/openai/quotas-limits#:~:text=Max%20size%20of%20all%20files,16%20MB

    Regarding the fine-tuning dataset limit for Azure OpenAI Service, the current default quota allows a maximum size of 16 MB for all files per upload when using Azure OpenAI on your data. If you need to increase this limit, you can create a request

    https://learn.microsoft.com/en-us/azure/ai-services/cognitive-services-support-options?context=/azure/ai-services/openai/context/context

    0 comments No comments

  2. Ramr-msft 17,641 Reputation points
    2023-11-15T14:51:28.6533333+00:00

    Thanks for the question. You can use the blob storage for upload and here is the document that can help.

    https://learn.microsoft.com/en-us/rest/api/azureopenai/files/import?view=rest-azureopenai-2023-05-15&tabs=HTTP

    0 comments No comments