OpenAI audit logging

Shivam Ojha 0 Microsoft Vendor

Is there an audit log of the prompts given to OpenAI we can review? Can we see what staff are submitting for audit purposes?

1 answer

Dillon Silzer 57,231 Reputation points

2024-02-27T05:48:17.3466667+00:00

Hi Shivam,

I review the following video and I would recommend following it to get all HTTP responses from your OpenAI instance:

Log & Monitor Everything in Azure Open AI with API Management Service

https://www.youtube.com/watch?v=j40RGK5SAeY

Note that you will need to use APIM to log and monitor these events.

More documentation on this solution can be found here:

Implement logging and monitoring for Azure OpenAI models

https://learn.microsoft.com/en-us/azure/architecture/ai-ml/openai/architecture/log-monitor-azure-openai

If this is helpful please accept answer.
Please sign in to rate this answer.
romungi-MSFT 44,761 Reputation points Microsoft Employee

2024-02-27T07:31:58.6+00:00

Shivam Ojha To add to @Dillon Silzer response, the documentation for enabling diagnostic logging is available here. Thanks!!

Shivam Ojha 0 Reputation points Microsoft Vendor

2024-02-28T01:04:30.14+00:00

is there any option to see the prompts people are entering?

romungi-MSFT 44,761 Reputation points Microsoft Employee

2024-03-01T11:05:52.92+00:00

Shivam Ojha I think diagnostic logging can help to check. the YT video demonstrates the setup that is required to achieve this.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Your answer