I'm having trouble getting a translation prompt to work in my Azure OpenAI studio-deployed web app, despite it functioning in the chat playground. Can you assist?

Question

I'm having trouble getting a translation prompt to work in my Azure OpenAI studio-deployed web app, despite it functioning in the chat playground. Can you assist?

Jeff Herman 0

I have a web application deployed from an Azure OpenAI studio chat playground session that uses my own data source where the checkbox "Limit responses to your data content" is unchecked (False). When I use the prompt "translate the word house from English to Spanish", I receive a correct response (I get a translation) in the chat playground, but not in the web app. All "..._IN_DOMAIN" environment variables in the web app are set to false. Can you help me understand why the translation prompt is not providing a response in the web app, even though it works in the chat playground?

Prompt:

translate the word house from English to Spanish

Chat playground response:

I'm sorry, but as an AI text-based model, I don't have real-time translation capabilities. However, based on my training data, the word "house" translates to "casa" in Spanish. Please note that for more complex translations or context-specific translations, it's recommended to use a dedicated translation service.

Web App response:

The retrieved documents do not provide a translation for the word "house" from English to Spanish.

Rohit Mungi 49,131 Reputation points Microsoft Employee Moderator

2024-05-20T06:37:19.7333333+00:00

@Jeff Herman Since this seems to be an issue with the deployment, Is the webapp using the same parameters in the call as the one set in the playground? I think it might be easier to debug this with a support case or it might be easier to redeploy the app and check if the same behavior is seen and raise a case if required. Thanks!!