Automatically Storing Conversations from an Azure OpenAI Chat Service Deployment

Question

I'm currently employing a chatbot deployed via the Azure OpenAI Service and am actively seeking a method to automatically store conversations from this service. The status quo requires manually downloading conversation logs in JSON format and exporting setup details. However, my objective is to transition towards a more efficient, automated approach.

Within the scope of an App Service, I'm curious if there's a possibility to directly access and store these conversation histories. In addition to this, I'm particularly interested in low code solutions that could streamline this process. The aim is to optimize the procedure of retrieving and storing these conversations for future analysis and utilization.

I would greatly appreciate any guidance or advice on how to configure the Azure OpenAI Chat Playground or an App Service to automatically save these conversations. I'm also open to integrating additional Azure services if it's necessary for this purpose.

Do not hesitate to request any further information if it's required to provide a more detailed answer.

Answer 1

Hi @techleadpd ,

If I understand you correctly you're looking for a 'conversational memory' method.

From what I'm reading "that's coming..." like everything else in OpenAI, meaning in a month or 2 it will likely be a built in feature.
Every time I look at https://ml.azure.com/ there are a ton new features, so I'll keep watching along with you.

For now, my understanding is that you'd have to code in a conversational loop like this example:
https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/chatgpt?pivots=programming-language-chat-completions#creating-a-basic-conversation-loop

Hopefully someone else will have a better answer for you.
Good luck.