How to get the system message from trained model in java code

Poornima Baddi 0

Hi,

I have written simple java code to get customized response.

List<ChatRequestMessage> chatMessages = new ArrayList<>();

chatMessages.add(new ChatRequestSystemMessage(

"If asked about your name, respond with 'Poornima'. If asked where you work, respond with 'Motive'. If a question is outside your knowledge, say 'I can look that up for you, but currently I don't have that information.'"));

chatMessages.add(new ChatRequestUserMessage("What is your name?"));

With above code, I am getting the correct response as Poornima as expected.

I have configured same data in the model Azure OpenAI Service. So when I removed ChatRequestSystemMessage line from above code, I am not getting the same response. It giving random answer eventhough I have trained my model.

How do I get the response from my trained model in Azure OpenAI Service to respond with specific answers like "Poornima" from java code?

How to configure/use trained data in java code as system message?.

Thanks,

Poornima

AshokPeddakotla-MSFT 33,851 Reputation points

2024-09-25T13:11:54.9466667+00:00

Poornima Baddi Greetings & Welcome to Microsoft Q&A forum!

As per my understanding, to achieve consistent responses from your Azure OpenAI Service model using Java, you need to ensure the context and instructions are provided with every request. If you omit the ChatRequestSystemMessage line, the model won't have the necessary context to respond correctly.

Always include the initial system message with your instructions to maintain the context. This approach ensures that your trained model responds consistently, even if the training data alone isn't sufficient to guide every response.

I would suggest you, check My fine-tuned model does not seem to have improved for improvements.

Also, see Azure OpenAI client library for Java , SystemMessage and System message framework and template recommendations for Large Language Models (LLMs) for more details.

Do let me know if that helps or have any further queries.
Poornima Baddi 0 Reputation points

2024-09-26T06:11:41.7866667+00:00

Hi AshokPeddakotla-MSFT,

Thank you for your reply.

We have huge chunk of data in our project, so don't want to train the model for every request. Instead of this we thought we can achieve same by uploading file. We have created index and uploaded the files using below steps in UI of Azure AI studio.

Add your data --Create or select project --select --uploaded the file.

Is it possible to receive the required response from this file using java code.

Without going to internet, we are thinking of asking AI to get the answer from uploaded file.

Can we achieve this using java? If yes it will great if you can share some related links.

Appreciate your reply.

Regards,

Poornima
Poornima Baddi 0 Reputation points

2024-09-26T06:18:26.69+00:00

Hi Ashok,

Thank you for your reply.

We have huge chunk of data in our project, so don't want to train the model for every request.

Instead of this we thought we can achieve the same by uploading file.

We have created index and uploaded the files using below steps in UI of Azure AI studio.

Add your data --Create or select project --select --uploaded the file.

Is it possible to reteive this file using java code.

Without going to internet we are thinking of asking AI to get the answer from uploaded file/s using java code and Azure OpenAI API or SDK.

If we can achieve this using java, it will be great if you can share the related link(s).

Appreciate your reply.

Regards,

Poornima
Poornima Baddi 0 Reputation points

2024-09-27T08:28:46.7033333+00:00

Hi AshokPeddakotla-MSFT,

Thank you for your reply.

We have huge chunk of data in our project, so don't want to train the model for every request. Instead of this we thought we can achieve same by uploading file. We have created index and uploaded the files using below steps in UI of Azure AI studio.

Add your data --Create or select project --select --uploaded the file.

Is it possible to receive the required response from this file using java code.

Without going to internet, we are thinking of asking AI to get the answer from uploaded file.

Can we achieve this using java? If yes it will great if you can share some related links.

Appreciate your reply.

Regards,

Poornima

Share via

How to get the system message from trained model in java code

Your answer