How can I increase the response time of custom question answering? Why is it too slow?

Andrew Ovsyannikov 0

Custom question answering became too slow after loading my resources and question-answer pairs

Carlos Solís Salazar 16,621 Reputation points MVP

2023-12-21T00:53:03.61+00:00
To provide a detailed and accurate answer, especially when it comes to troubleshooting or addressing specific technical scenarios like those involving Azure, Microsoft 365, and Windows technologies, there are several key pieces of information that would be helpful:

Exact Nature of the Issue or Requirement:

What specific problem are you facing, or what specific outcome are you trying to achieve?

Environment Details:

What is the specific technology, software, or service you are using (e.g., Azure services, Windows version, Microsoft 365 apps)?

Are there any specific configurations, customizations, or integrations involved?

Error Messages or Codes:

If you are encountering an error, what is the exact error message or code?

Steps Already Taken:

What steps have you already taken to try to resolve the issue or achieve your goal?

Have you followed any specific troubleshooting steps, documentation, or guides?

Desired Timeline or Urgency:

Is there a specific timeline or level of urgency for resolving this issue or achieving this goal?

Security and Compliance Considerations:

Are there any particular security, privacy, or compliance requirements that need to be taken into account?

Budget or Resource Constraints:

Are there any constraints regarding budget, resources, or available tools?

Previous Experience or Background:

What is your level of expertise or familiarity with the technology involved?

Intended Use or Business Context:

What is the broader context or business scenario in which this technology is being used?

Other Relevant Information:

Any other information you think might be relevant or helpful for understanding the full picture.

Having this information allows me to tailor the response more precisely to your situation, ensuring that the guidance is relevant, actionable, and addresses your specific needs.
Andrew Ovsyannikov 0 Reputation points

2023-12-21T07:29:29.5133333+00:00
I use Language Studio and have uploaded my resources and question-answer pairs.
In the begining I tested Custom question answering with 2 resources and small count of question-answer pairs it was fast enough.
Now I loaded 91 text resources with 1825 question-answer pairs in total, and I should wait a 15-30 seconds before I got an answer to most of the question.
I already deployed knowledge base and got same speed throug API by SDK

from azure.ai.language.questionanswering import QuestionAnsweringClient

I use method get_answers with confidence_threshold confidence_threshold=0.4 without any filters
romungi-MSFT 42,286 Reputation points Microsoft Employee

2023-12-21T09:39:44.2733333+00:00

@Andrew Ovsyannikov I think the performance in this case could be improved if your Azure AI search resource uses a higher tier. Please see this page on resource planning for custom question answering feature.

AI search resource tier descriptions and capabilities are also documented in the AI search document.
romungi-MSFT 42,286 Reputation points Microsoft Employee

2023-12-27T05:55:15.8533333+00:00

@Andrew Ovsyannikov Did the change in tier of search resource help?