I have deployed an Azure OpenAI Service endpoint for GPT-3.5.
For several compliance reasons, I would like to know how one could have access to prompts sent to my endpoint.
It seems that there is no built-in recording of prompts sent to my endpoint, where I could easily access them later.
I see two ways to make it work:
- Either we deploy Azure OpenAI internally, and users first send data to a proxy server that I setup, which will log prompts, before calling my Azure OpenAI Service endpoint.
- Azure OpenAI Service has a direct way to register prompts and those can be inspected manually / programmatically.
As the second would be a feature, do you think it's something that will be implemented any time soon?