Is it possible to fine tune gpt-35-turbo-16k model?

Question

Is it possible to fine tune gpt-35-turbo-16k model?

Karuna Tiwari 100

I am fine-tuned gpt-35-turbo-0613 model but when I play with it in the playground it gives me an error saying - "AOAI Error: This model's maximum context length is 4096 tokens. However, your messages resulted in 5652 tokens. Please reduce the length of the messages." . So I am planning to switch to gpt-35-turbo-16k model for fine-tuning. But I cant see any option to fine-tune gpt-35-turbo-0613 model.

Azar 29,520 Reputation points MVP Volunteer Moderator

2023-12-21T18:05:31.3566667+00:00

Hi Karuna Tiwari

Fine-tuning was available only for base GPT-3 models, but you can just follow the link below and you will have a detailed info on fine tuning gpt 3.5 turbo 16

https://platform.openai.com/docs/guides/fine-tuning/can-i-fine-tune-gpt-4-or-gpt-3-5-turbo-16k

https://platform.openai.com/docs/guides/fine-tuning/can-i-fine-tune-gpt-4-or-gpt-3-5-turbo-16k

If you find this helpful kindly accept the answer to close this thread thanks much.
Karuna Tiwari 100 Reputation points

2023-12-22T12:11:26.9966667+00:00

I dont see the option of fine-tuning 'gpt-3.5-turbo-1106' when I try using Azure OpenAI resourse although its mentioned in the link that you shared.

Accepted answer

0 additional answers

Your answer

Azar 29,520 Reputation points MVP Volunteer Moderator

2023-12-21T18:05:31.3566667+00:00

Hi Karuna Tiwari

Fine-tuning was available only for base GPT-3 models, but you can just follow the link below and you will have a detailed info on fine tuning gpt 3.5 turbo 16

https://platform.openai.com/docs/guides/fine-tuning/can-i-fine-tune-gpt-4-or-gpt-3-5-turbo-16k

https://platform.openai.com/docs/guides/fine-tuning/can-i-fine-tune-gpt-4-or-gpt-3-5-turbo-16k

If you find this helpful kindly accept the answer to close this thread thanks much.
Karuna Tiwari 100 Reputation points

2023-12-22T12:11:26.9966667+00:00

I dont see the option of fine-tuning 'gpt-3.5-turbo-1106' when I try using Azure OpenAI resourse although its mentioned in the link that you shared.

Answer 1

Saurabh Sharma 23,851 Microsoft Employee Moderator

Hi @Karuna Tiwari

You are not seeing GPT 3.5 1106 in the fine-tuning list as the list shows the base model's name only. Also, fine tuning is available only for gpt-35-turbo-0613 version.

User's image

Please let me know if you have any other questions.

Please 'Accept as answer' and Upvote if it helped so that it can help others in the community looking for help on similar topics.

Karuna Tiwari 100 Reputation points

2023-12-29T06:18:49.06+00:00

Thanks for you answer, Saurabh. Just wanted to know if gpt-35-turbo-16k or gpt-35-turbo (1106) models are available for fine-tuning. I can see that gpt-3.5-turbo-1106 (recommended) is available, reference link - https://platform.openai.com/docs/guides/fine-tuning
Saurabh Sharma 23,851 Reputation points Microsoft Employee Moderator

2023-12-29T16:34:44.74+00:00

@Karuna Tiwari No, it is not available yet in Azure Open AI models. Please keep an eye out for the updates on the same. Thanks.
Saurabh Sharma 23,851 Reputation points Microsoft Employee Moderator

2024-01-05T20:01:59.6333333+00:00

@Karuna Tiwari

Please let me know if you find above reply useful. If yes, please 'Accept the answer' for the above reply. This will help other community members facing similar query to refer to this solution.

Thanks,

Saurabh

Share via

Is it possible to fine tune gpt-35-turbo-16k model?

0 additional answers

Your answer