azure open ai cache responses

AdityaSa 796 Reputation points

I am using the Azure OpenAI service, is there a way to "cache" responses for use with related questions from other users? .Please provide any necessary steps, code snippets that can be referred to.

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
1,834 questions
0 comments No comments
{count} vote

Accepted answer
  1. Ramr-msft 17,441 Reputation points

    @A-4824 Thanks for the question. Can you please add more details about the use case. This sample demonstrates a few approaches for creating ChatGPT-like experiences over your own data. It uses Azure OpenAI Service to access the ChatGPT model (gpt-35-turbo and gpt3), and vector store (Pinecone, Redis and others) or Azure cognitive search for data indexing and retrieval. The nature of AOAI calls are stateless, so to be able to create a "Cache" layer you will build solution using Cognitive Search (or other Vector DB) for custom scenarios.

    The repo provides a way to upload your own data so it's ready to try end to end.

    Kindly accept the answer if it is helpful.

    0 comments No comments

0 additional answers

Sort by: Most helpful