How to use Japanese Language on chatgpt-35-turbo-16k, when I use json using "on your data"?

N.SAITO 70 Reputation points
2023-07-11T01:14:30.88+00:00

I'm developing chatbot using Azure openAI gpt-35-turbo-16k.

I could use Azure cognitive search with Azure openAI using json file.

But openAI returned "I'm sorry, but I couldn't find any information related to "[JAPANESE_KEYWORD]" in the retrieved documents. As a result, I am unable to provide an answer."

On the returned json file, OpenAI retrieved Japanese documents properly.
But OpenAI could not understand it.

Are there any properties abount language on json?

==Request parameters==
"role": "system",
"content": "You are an AI assistant that helps people find information. You retrieve Japanese document, and you should read them carefully in Japanese and answer in Japanese"

"role": "user",
"content": "[JAPANESE_KEYOWRD]について教えて"

"role": "system",
"content": "出力は日本語です"

==Return from openAI==

{"id": "eed1ce0f-1191-4c45-8b8d-1afddea3934e", "model": "gpt-35-turbo-16k", "created": 1689034093, "object": "chat.completion", "choices": [{"index": 0, "messages": [{"index": 0, "role": "tool", "content": "{"citations": [{"content": "[SERIALIZED_JAPANESE_CONTENT]", "id": null, "title": "[DOCUMENTS_URL]", "filepath": null, "url": null, "metadata": {"chunking": "orignal document size=4140. Scores=8.227168 and None.Org Highlight count=88.Filtering to chunk no. 0/Highlights=33 of size=770"}, "chunk_id": "0"}, {"content": "[SERIALIZED_JAPANESE_CONTENT]", "id": null, "title": "[DOCUMENTS_URL]", "filepath": null, "url": null, "metadata": {"chunking": "orignal document size=4140. Scores=8.227168 and None.Org Highlight count=88.Filtering to chunk no. 2/Highlights=28 of size=765"}, "chunk_id": "2"}, {"content": "[SERIALIZED_JAPANESE_CONTENT]", "id": null, "title": "[DOCUMENTS_URL]", "filepath": null, "url": null, "metadata": {"chunking": "orignal document size=4140. Scores=8.227168 and None.Org Highlight count=88.Filtering to chunk no. 3/Highlights=8 of size=308"}, "chunk_id": "3"}, {"content": "[SERIALIZED_JAPANESE_CONTENT]", "id": null, "title": "[DOCUMENTS_URL]", "filepath": null, "url": null, "metadata": {"chunking": "orignal document size=2782. Scores=7.9718704 and None.Org Highlight count=18.Filtering to highlight size=684"}, "chunk_id": "0"}, {"content": "[SERIALIZED_JAPANESE_CONTENT]", "id": null, "title": "[DOCUMENTS_URL]", "filepath": null, "url": null, "metadata": {"chunking": "orignal document size=4140. Scores=8.227168 and None.Org Highlight count=88.Filtering to chunk no. 1/Highlights=19 of size=830"}, "chunk_id": "1"}], "intent": "[\"[SERIALIZED_JAPANESE_CONTENT]\"]"}", "end_turn": false}, {"index": 1, "role": "assistant", "content": "I'm sorry, but I couldn't find any information related to "[JAPANESE_SERIARIZED_KEYWORD]" in the retrieved documents. As a result, I am unable to provide an answer.", "end_turn": true}]}]}

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
4,111 questions
{count} votes

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.