Is fine-tuning GPT-3.5-Turbo 16K version linked to subscription tier?

Question

I am trying to fine tune a GPT-3.5-Turbo 16K model. But I can see an option to train only 4K model but not 16 K model. Is it linked to my Azure subscription? I currently have BASIC subscription.

Answer 1

Karuna Tiwari Greetings & Welcome to Microsoft Q&A forum!

I am trying to fine tune a GPT-3.5-Turbo 16K model. But I can see an option to train only 4K model but not 16 K model. Is it linked to my Azure subscription? I currently have BASIC subscription.

As mentioned in the documentation, fine-tuning GPT-3.5-Turbo the gpt-35-turbo-0613 model's input token is limited to 4096 tokens. This is the maximum sequence length that can be fine-tuned using the Azure OpenAI Service. The model's sequence length is determined by the number of tokens in the input text.

Also, see Fine-tuning models for more details.

Regarding your Azure subscription, the Basic subscription provides access to the same features as the Standard subscription, but with lower quotas. However, the sequence length of the GPT-3.5-Turbo model is not linked to the subscription type.

Hope this helps. Do let me know if you have any further queries.

---

If the response helped, please do click Accept Answer and Yes for was this answer helpful.

Doing so would help other community members with similar issue identify the solution. I highly appreciate your contribution to the community.