deploy of a prompt flow just reponse I dont Know

Question

deploy of a prompt flow just reponse I dont Know

Caio Freire - Databasers 20

I developed a prompt flow in Azure AI foundry which uses a Index on Azure AI Search.
in the portal i get the responses, but when i try to use the REST API, i only get the response:
"i dont know"

Accepted answer

0 additional answers

Your answer

Answer 1

kothapally Snigdha 3,020 Microsoft External Staff Moderator

Hi Caio Freire - Databasers

The issue of receiving "I don't know" as a response when using the REST API for your prompt flow could be related to several factors. Here are some steps to follow.

Ensure that the endpoint identity has the necessary permissions to access the Azure AI Search index. If your flow contains an Index Look Up tool, the endpoint needs to access the workspace datastore to read the necessary files.
Check if the model used in your flow is powerful enough. If the model is not suitable for the queries being made, it might return a generic response. Consider using a more powerful model if available.
If the index query is not optimized, it may lead to poor performance or generic responses. Review the index and ensure that it is set up correctly to handle the queries you are sending.
If your flow has many steps or is overly complex, it might lead to delays or failures in processing the query. Simplifying the flow could help improve response accuracy.
Before deploying, ensure that you test the flow thoroughly in the Azure AI Foundry portal to confirm that it behaves as expected.
kindly refer these https://learn.microsoft.com/en-us/azure/machine-learning/prompt-flow/how-to-deploy-for-real-time-inference?view=azureml-api-2#troubleshoot-endpoints-deployed-from-prompt-flow

Hope this helps. Do let us know if you any further queries.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Caio Freire - Databasers 20 Reputation points

2025-03-21T14:46:43.15+00:00

Ainda sim, recebo a mesma mensagem independente da pergunta.
Estou usando o modelo Gtp4-o

A máquina Standard_DS3_v2
Caio Freire - Databasers 20 Reputation points

2025-03-21T14:49:05.7166667+00:00

Ainda sim, recebo a mesma mensagem independente da pergunta. Estou usando o modelo Gtp4-o

A máquina Standard_DS3_v2
kothapally Snigdha 3,020 Reputation points Microsoft External Staff Moderator

2025-03-25T00:19:55.43+00:00
Hi Caio Freire - Databasers

Ensure that the model you are using is appropriate for your queries. Sometimes, the model may not have enough context or information to provide a meaningful response.

Check the configuration of your deployment environment. Ensure that the machine type (Standard_DS3_v2) is suitable for the workload and that it has sufficient resources.

Consider optimizing your prompts. The way questions are phrased can significantly impact the quality of the responses. Try rephrasing your questions or providing more context.

Review the flow configuration to ensure that all necessary components are correctly set up. If there are any missing configurations or errors in the deployment, it could lead to unexpected responses.

I hope these helps you. Thank you!
Caio Freire - Databasers 20 Reputation points

2025-03-25T09:58:44.91+00:00
the cause is because in the API request i was using the Json like:

json
{
"query":"",
"chat_history": []
}

But the correct is not query is chat_input Thanks for the help

Share via

deploy of a prompt flow just reponse I dont Know

0 additional answers

Your answer