Azure OpenAI Service - API(gpt-3.5-turbo) Error response

Question

Azure OpenAI Service - API(gpt-3.5-turbo) Error response

혁우 권 0

I received 400 (model_error) as an API error response, and the message I got from the Java 'Throwable' object was 'null_context_length_exceeded'.

Please tell me what the error means and how I can fix it.

santoshkc 15,325 Reputation points Microsoft External Staff Moderator

2023-10-05T10:46:45.6133333+00:00

Hi @혁우 권 ,

Thank you for reaching out to Microsoft Q&A!

I will be happy to help you with your query regarding the Azure OpenAI Service API (gpt-3.5-turbo) error response you received. I understand that you received a 400 (model_error) response, and the message you got from the Java 'Throwable' object was 'null_context_length_exceeded'.

The error message 'null_context_length_exceeded' indicates that the context length of the input text is too long for the model to process. The maximum context length for the gpt-3.5-turbo model is 2048 tokens and for the newest models, which support 4096. Please look into the below table:

If the input text exceeds this limit, you will receive the 'null_context_length_exceeded' error message.

To fix this error, you can try reducing the length of the input text. Also, you can try splitting the input text into smaller chunks and processing them separately.

Try these and let us know.

I hope this helps. Thank you.
santoshkc 15,325 Reputation points Microsoft External Staff Moderator

2023-10-06T12:54:36.48+00:00

Hi @혁우 권 ,

Following up to see if the above information was helpful. Thank you.
santoshkc 15,325 Reputation points Microsoft External Staff Moderator

2023-10-09T04:03:19.8366667+00:00

Hi @혁우 권 ,

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Thank you

Your answer

santoshkc 15,325 Reputation points Microsoft External Staff Moderator

2023-10-05T10:46:45.6133333+00:00

Hi @혁우 권 ,

Thank you for reaching out to Microsoft Q&A!

I will be happy to help you with your query regarding the Azure OpenAI Service API (gpt-3.5-turbo) error response you received. I understand that you received a 400 (model_error) response, and the message you got from the Java 'Throwable' object was 'null_context_length_exceeded'.

The error message 'null_context_length_exceeded' indicates that the context length of the input text is too long for the model to process. The maximum context length for the gpt-3.5-turbo model is 2048 tokens and for the newest models, which support 4096. Please look into the below table:

If the input text exceeds this limit, you will receive the 'null_context_length_exceeded' error message.

To fix this error, you can try reducing the length of the input text. Also, you can try splitting the input text into smaller chunks and processing them separately.

Try these and let us know.

I hope this helps. Thank you.
santoshkc 15,325 Reputation points Microsoft External Staff Moderator

2023-10-06T12:54:36.48+00:00

Hi @혁우 권 ,

Following up to see if the above information was helpful. Thank you.
santoshkc 15,325 Reputation points Microsoft External Staff Moderator

2023-10-09T04:03:19.8366667+00:00

Hi @혁우 권 ,

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Thank you

Share via

Azure OpenAI Service - API(gpt-3.5-turbo) Error response

Your answer