{"detail":"Extra parameters ['safe_prompt'] are not allowed when extra-parameters is not set or set to be 'error'. Set extra-parameters to 'pass-through' to pass to the model."}

Question

{"detail":"Extra parameters ['safe_prompt'] are not allowed when extra-parameters is not set or set to be 'error'. Set extra-parameters to 'pass-through' to pass to the model."}

Anonymous

Hi,

I have a working code, it suddenly getting following exception:

httpx.HTTPStatusError: Error response 400 while fetching https://mistral-nemo-iggff.swedencentral.models.ai.azure.com/chat/completions: {"detail":"Extra parameters ['safe_prompt'] are not allowed when extra-parameters is not set or set to be 'error'. Set extra-parameters to 'pass-through' to pass to the model."}

I am using langchain ChatMistralAI to initiate the connection. How can I fix it? this code was working for last 15 days and no changes were deployed. suddenly I'm getting this issue.

YutongTie-MSFT 53,971 Reputation points Moderator

2024-10-31T00:24:52.3733333+00:00

@Prasenjit Thanks for reaching out to us, could you please share more details about this issue and the document you are following so that we can reproduce your issue?

Regards,

Yutong
Gari Jose Ciodaro Guerra 5 Reputation points

2024-11-07T10:26:19.37+00:00
I am having the same problem.

from langchain_mistralai import ChatMistralAI mistral_model = ChatMistralAI( base_url=base_url_mistral, api_key=os.getenv("AZURE_MISTRAL_KEY"), model=deployment_name_mistral, ) # This produces an exception. mistral_model.invoke("hi")

HTTPStatusError: Error response 400 while fetching https://xxxx.eastus.models.ai.azure.com/chat/completions: {"detail":"Extra parameters ['safe_prompt'] are not allowed when extra-parameters is not set or set to be 'error'. Set extra-parameters to 'pass-through' to pass to the model."}
Christian von Appen 0 Reputation points

2024-11-08T11:19:09.1533333+00:00

Same problem here. Could use it successfully a few weeks ago, but getting the same error 400 today.

Also, when setting the Header "extra-parameters": "pass-through" to let the parameter "safe_prompt" be allowed, it would return a 422 error:

Error response 422 while fetching https://mistral-small-model-serverless.eastus.models.ai.azure.com/chat/completions: {"error":{"code":"Invalid input","message":"{"detail":[{"type":"extra_forbidden","loc":["body","safe_prompt"],"msg":"Extra inputs are not permitted","input":false}]}","status":422}}
Dmitrii Tiron 5 Reputation points

2024-11-11T23:32:52.0566667+00:00

same problem. langchain + MistralLarge (2407) serverless deployment in Azure AI Studio.
my suspicion is azure HTTP validation fails due to the "extra" parameter "safe_prompt". Didn't find any documentation from LangChain on "passing through" the parameters.
Deleted

This comment has been deleted due to a violation of our Code of Conduct. The comment was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.

2 answers

Your answer

YutongTie-MSFT 53,971 Reputation points Moderator

2024-10-31T00:24:52.3733333+00:00

@Prasenjit Thanks for reaching out to us, could you please share more details about this issue and the document you are following so that we can reproduce your issue?

Regards,

Yutong
Gari Jose Ciodaro Guerra 5 Reputation points

2024-11-07T10:26:19.37+00:00

I am having the same problem.

from langchain_mistralai import ChatMistralAI mistral_model = ChatMistralAI( base_url=base_url_mistral, api_key=os.getenv("AZURE_MISTRAL_KEY"), model=deployment_name_mistral, ) # This produces an exception. mistral_model.invoke("hi")

HTTPStatusError: Error response 400 while fetching https://xxxx.eastus.models.ai.azure.com/chat/completions: {"detail":"Extra parameters ['safe_prompt'] are not allowed when extra-parameters is not set or set to be 'error'. Set extra-parameters to 'pass-through' to pass to the model."}
Christian von Appen 0 Reputation points

2024-11-08T11:19:09.1533333+00:00

Same problem here. Could use it successfully a few weeks ago, but getting the same error 400 today.

Also, when setting the Header "extra-parameters": "pass-through" to let the parameter "safe_prompt" be allowed, it would return a 422 error:

Error response 422 while fetching https://mistral-small-model-serverless.eastus.models.ai.azure.com/chat/completions: {"error":{"code":"Invalid input","message":"{"detail":[{"type":"extra_forbidden","loc":["body","safe_prompt"],"msg":"Extra inputs are not permitted","input":false}]}","status":422}}
Dmitrii Tiron 5 Reputation points

2024-11-11T23:32:52.0566667+00:00

same problem. langchain + MistralLarge (2407) serverless deployment in Azure AI Studio.
my suspicion is azure HTTP validation fails due to the "extra" parameter "safe_prompt". Didn't find any documentation from LangChain on "passing through" the parameters.
Deleted

This comment has been deleted due to a violation of our Code of Conduct. The comment was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.

Answer 1

Michael Jaumann 35

I have found a solution for this by using the OpenAI-compltible endpoint of the mistral model and setting the extra-parameter header.

from langchain_openai import  ChatOpenAI

mistral_model = ChatOpenAI(
        default_headers={"extra-parameters": "pass-through"},
        base_url=base_url_mistral,
        api_key=os.getenv("AZURE_MISTRAL_KEY"),
        model=deployment_name_mistral,
    )

# This produces an exception.
mistral_model.invoke("hi")

The extra-parameters header is documented here

Answer 2

Philipp Lang 0

This is likely a breaking change on the Azure side. Using the OpenAI client will break some features, like structured output. Another option is to set safe_mode to None

This way it won't be added to the headers:


mistral_model = ChatMistralAI(
	base_url=base_url_mistral,
	api_key=os.getenv("AZURE_MISTRAL_KEY"),
	model=deployment_name_mistral,
)
mistral_model.safe_mode = None

Deleted

This comment has been deleted due to a violation of our Code of Conduct. The comment was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.

Share via

{"detail":"Extra parameters ['safe_prompt'] are not allowed when extra-parameters is not set or set to be 'error'. Set extra-parameters to 'pass-through' to pass to the model."}

2 answers

Your answer