Azure OpenAI Content filters blocking content incorrectly. DefaultV2 and Default

Christian 140

Azure OpenAI Content filters blocking content incorrectly. DefaultV2 and Default.

Can be reproduced in Playground.

Question in spanish: como puedo seleccionar el compromiso de una suscripción?
translation: how can I select a subscription commitment?

User's image

Deployment info
User's image

navba-MSFT 26,125 Reputation points Microsoft Employee

2024-11-21T11:49:39.7266667+00:00
@Christian Welcome to Microsoft Q&A Forum, Thank you for posting your query here!

.

I am unable to reproduce this issue at my end. I tried with multiple api-versions using both DefaultV2 and Default content filters but it is working just fine.

Model: gpt4o

api-version: 2024-05-13

I also tried with the same version as your GPT model:

Model: gpt4o

api-version: 2024-08-06

Did you create any customized content filters ? If Yes, please share that details.

Which region is your resource deployed to ?

Was this working fine previously?

Does it happen only with Spanish language ? Will it work with other languages ?

.

Awaiting your reply.
Christian 140 Reputation points

2024-11-21T13:18:56.2533333+00:00
Hi @navba-MSFT

Problem seems to be transient as I've retried the few prompts that we found that triggered the issues and it's not happening now. As for the rest of your questions

No custom filters. Tested with Default and DefaultV2

Sweden central

Yes

Only found with spanish, it's relatively hard to find the prompts that trigger this

Here's another prompt that seems not to be transient, tested it right now:

spanish: donde puedo ver las condiciones de los servicios de softeng max?

english translation (aprox): Where can I see the conditions of softeng max services?

(softeng max being the name of the services our company provides)
navba-MSFT 26,125 Reputation points Microsoft Employee

2024-11-21T13:59:43.51+00:00

@Christian Thanks for getting back. Using the new query, donde puedo ver las condiciones de los servicios de softeng max? I am able to consistently reproduce this issue and get the same response as your scenario:

I am looking into this further. I will get back to you once I have an update on this.
navba-MSFT 26,125 Reputation points Microsoft Employee

2024-11-21T14:01:18.0966667+00:00

@Christian I have sent you a private message asking for more details. Please reply to that once you get a chance.

Accepted answer

navba-MSFT 26,125 Reputation points Microsoft Employee

2024-11-27T09:16:01.87+00:00

@Christian Apologies for the late reply.

.

I have heard back from the Product Owners. They have confirmed that the Content Filter blocking the Spanish prompt is a False positive.

They have created a workitem to fix this. This fix should be released in the next model refresh.

Update: The tentative ETA for next model refresh is Jan 15, 2025.

We appreciate your feedback, this will help us improve our product .

Hope this helps.

**

Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.
Please sign in to rate this answer.
Christian 140 Reputation points

2024-11-27T09:44:32.8433333+00:00

@navba-MSFT thanks for the help. Would you please clarify what you mean by "next model refresh"? Aprox when is this happening and also I will need to upgrade the model deployment?

navba-MSFT 26,125 Reputation points Microsoft Employee

2024-11-27T09:54:41.73+00:00

@Christian The fix release date is not yet fixed / finalized. I will let you know once I get these details from Product Owners.

You don't need to update the model deployment as long as You have set the Auto-update to default option for your gpt model as shown below:

Hope this helps.

navba-MSFT 26,125 Reputation points Microsoft Employee

2024-11-28T04:41:53.06+00:00

@Christian I have updated the release ETA in my above comment. Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Azure OpenAI Content filters blocking content incorrectly. DefaultV2 and Default

0 additional answers

Your answer