How can I view ChatCompletion API request details made from the Azure OpenAI Playground in the Azure portal?

Question

How can I view ChatCompletion API request details made from the Azure OpenAI Playground in the Azure portal?

Padma Dighe 20

Is it possible to view the details like system prompt passed to the ChatCompletion API made from the Azure OpenAI Playground in the Azure portal?

Padma Dighe 20 Reputation points

2024-12-06T06:57:48.9166667+00:00

Hi,

I enabled diagnostic settings and can view some details. However, I wanted to see the prompt flow, but as you mentioned, I am unable to view it, so I posted here to confirm.
santoshkc 15,325 Reputation points Microsoft External Staff Moderator

2024-12-06T14:06:40.3133333+00:00

Hi @Padma Dighe,

Thank you for your follow-up query. As mentioned, while you can enable diagnostic settings to view some useful metadata, the actual prompt flow (including system and user prompts) is not logged in the Azure portal due to privacy and security reasons. Unfortunately, Azure does not provide a built-in mechanism to capture the full prompt content in diagnostic logs.

If you are using the Playground, you can manually observe and copy the prompts and responses, but this still won't be available as part of the Azure portal’s logs.

I hope you understand! Thank you.
santoshkc 15,325 Reputation points Microsoft External Staff Moderator

2024-12-09T03:20:13.0266667+00:00

Hi @Padma Dighe,

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others.

Thank you.
Padma Dighe 20 Reputation points

2024-12-09T11:01:20.72+00:00

ok thanks

2 answers

Your answer

Padma Dighe 20 Reputation points

2024-12-06T06:57:48.9166667+00:00

Hi,

I enabled diagnostic settings and can view some details. However, I wanted to see the prompt flow, but as you mentioned, I am unable to view it, so I posted here to confirm.
santoshkc 15,325 Reputation points Microsoft External Staff Moderator

2024-12-06T14:06:40.3133333+00:00

Hi @Padma Dighe,

Thank you for your follow-up query. As mentioned, while you can enable diagnostic settings to view some useful metadata, the actual prompt flow (including system and user prompts) is not logged in the Azure portal due to privacy and security reasons. Unfortunately, Azure does not provide a built-in mechanism to capture the full prompt content in diagnostic logs.

If you are using the Playground, you can manually observe and copy the prompts and responses, but this still won't be available as part of the Azure portal’s logs.

I hope you understand! Thank you.
santoshkc 15,325 Reputation points Microsoft External Staff Moderator

2024-12-09T03:20:13.0266667+00:00

Hi @Padma Dighe,

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others.

Thank you.
Padma Dighe 20 Reputation points

2024-12-09T11:01:20.72+00:00

ok thanks

Answer 1

santoshkc 15,325 Microsoft External Staff Moderator

Hi @Padma Dighe,

Thank you for reaching out to Microsoft Q&A forum!

It is not possible to view details like the system prompt passed to the ChatCompletion API from the Azure OpenAI Playground directly in the Azure portal.

However, you can enable Diagnostics on the Azure OpenAI resource. Once enabled, this can provide more detailed logging and monitoring information about the API requests, which might include metadata and usage statistics related to the calls.

User's image

I hope you understand! Thank you.

Answer 2

Max Lacy 345

You're looking to view the parameters sent to your model. While not directly possible in the Azure Open AI portal you could use developer mode on your internet browser as an alternative Developer Mode on your browser would allow you to review the threads. Below is an example of a thread I was able to grab using developer mode. User's image

Padma Dighe 20 Reputation points

2024-12-06T06:59:09.7133333+00:00

Hi,

For Azure playground calls, I can see request/response headers but not the prompt flow.
Padma Dighe 20 Reputation points

2024-12-09T11:14:52.5+00:00

I could see request and response headers but not the prompt flow.

Share via

How can I view ChatCompletion API request details made from the Azure OpenAI Playground in the Azure portal?

2 answers

Your answer