Does Azure Open AI REST API Chat completions support Japanese questions?

Question

Hi I'm using BYOD feature to make openAi to read Japanese documents and answer in Japanese.

It works pretty well on 'Chat playground'.

the problem is that if I use REST API Chat completions, it always respond 'The requested information is not available in the retrieved data. Please try another query or topic' for same questions, and I've realised that in tool response, my Japanese question has automatically turned into english.

original question: "content": "しばらく秋晴れが続いた頃に空の高いところにあらわれる雲とは？"

tool response: {"index": 0, "role": "tool", \"intent\": \"What is the meaning of the clouds that appear high in the sky during the long autumn sunny days?\"}",…},

why is this happening and is there any way to keep the question in Japanese?

Answer 1

AGT 金恩哲 I'm glad that your issue is resolved and thank you for posting your solution so that others experiencing the same thing can easily reference this!

Since the Microsoft Q&A community has a policy that the question author cannot accept their own answer, they can only accept answers by others, I'll repost your solution in case you'd like to Accept the answer.

Error Message:

It works pretty well on 'Chat playground'.

the problem is that if I use REST API Chat completions, it always respond 'The requested information is not available in the retrieved data. Please try another query or topic' for same questions, and I've realised that in tool response, my Japanese question has automatically turned into english.

original question: "content": "しばらく秋晴れが続いた頃に空の高いところにあらわれる雲とは？"

tool response: {"index": 0, "role": "tool", \"intent\": \"What is the meaning of the clouds that appear high in the sky during the long autumn sunny days?\"}",…},

Solution:

Problem is that I was using api-version=2023-06-01 and it is fixed in version api-version=2023-09-01

2023-09-01 version does answer japanese question pretty well.

just one more question, when I use HttpPost in JAVA and send same request through it, it still doesnt answer anything even in version 2023-09-01. it seems like if I turn question into unicode, it responds something, such as correct citations but still doesnt give correct answer. any idea on this?

Edit: I guess it is the problem of not setting UTF-8 encoding.

If you have any other questions, please let me know. Thank you again for your time and patience throughout this issue.