I encountered issues with the accuracy and reliability of responses generated by the Azure OpenAI service.

Ashlesha Sharma 0 Reputation points

I have been using the Azure OpenAI service for a while now, and I have encountered several issues with the responses generated by the system. These issues have led to inaccuracies and inconsistencies in the information provided, impacting the overall user experience.

The task is to generate a few tags on the basis of some given information. Using prompts the code is hitting Azure's OpenAI API to generate tags in response but got weird results:

  1. Getting a set of weird instructions, which might be executed to generate results.

Screenshot 2023-07-10 at 5.30.02 PM

  1. Response is including different languages in response.

Screenshot 2023-07-10 at 2.09.26 PM

3 Getting all results as 'UNKNOWN'

Screenshot 2023-07-10 at 2.09.53 PM

  1. Instead of having enough token left, the response is not complete and truncated by '....'

Screenshot 2023-07-10 at 2.20.35 PM

In order to investigate this further, I decided to conduct a comparison by using the same inputs in both the Azure OpenAI service and the OpenAI-Chat GPT service. The results were quite surprising. The responses generated by the OpenAI-Chat GPT service were consistently more accurate and aligned with the intended meaning of the queries.

I'm seeking help here. Thanks in advance.

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
1,882 questions
{count} votes