In Azure OpenAI studio in chat playground LLM Is not paying attention to the instruction included in system message when using 'add your data (preview)' feature

Abhishek M 0 Reputation points
2023-09-12T16:23:54.76+00:00

Say system message/ or prompt is to append a custom greeting for every response. example "Act as AI assistant that helps people find information. Greet them with the message like 'Hi, Welcome to ABC I am Sam. How can I help you?'" is the value of environment variable "AZURE_OPENAI_SYSTEM_MESSAGE". The response of the LLM does not show that the LLM is following the instruction provided in the system message. Are there ways to emphasize the system message instructions more strongly? Please repo link below for the reference code.

Git repo: https://github.com/microsoft/sample-app-aoai-chatGPT/tree/main

Azure Cognitive Search
Azure Cognitive Search
An Azure search service with built-in artificial intelligence capabilities that enrich information to help identify and explore relevant content at scale.
401 questions
Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
1,024 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Saurabh Sharma 18,946 Reputation points Microsoft Employee
    2023-09-14T18:02:11.8333333+00:00

    Hi @Abhishek M ,

    Thanks for using Microsoft Q&A!!

    Azure Open AI studio chat playground doesn't use the AZURE_OPENAI_SYSTEM_MESSAGE environment setting. Chat Playground use the System Template as you select it under the Assistant setup section as shown in the below screenshot -

    User's image

    The GitHub repository you are referring to contains the chat webapp source code that gets deployed using the above step and AZURE_OPENAI_SYSTEM_MESSAGE environment variable is used by the web application deployed by using the "Deploy To" button.

    User's image

    Please let me know if you have any questions.

    Thanks

    Saurabh

    Please do not forget to "Accept the answer" wherever the information provided helps you to help others in the community.