I encountered issues with the accuracy and reliability of responses generated by the Azure OpenAI service.
I have been using the Azure OpenAI service for a while now, and I have encountered several issues with the responses generated by the system. These issues have led to inaccuracies and inconsistencies in the information provided, impacting the overall user experience.
The task is to generate a few tags on the basis of some given information. Using prompts the code is hitting Azure's OpenAI API to generate tags in response but got weird results:
- Getting a set of weird instructions, which might be executed to generate results.
- Response is including different languages in response.
3 Getting all results as 'UNKNOWN'
- Instead of having enough token left, the response is not complete and truncated by '....'
In order to investigate this further, I decided to conduct a comparison by using the same inputs in both the Azure OpenAI service and the OpenAI-Chat GPT service. The results were quite surprising. The responses generated by the OpenAI-Chat GPT service were consistently more accurate and aligned with the intended meaning of the queries.
I'm seeking help here. Thanks in advance.