Azure AI Language
An Azure service that provides natural language capabilities including sentiment analysis, entity extraction, and automated question answering.
How can I increase the response time of custom question answering? Why is it too slow?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(211.20000000000002, 43%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAO%3C/text%3E%3C/svg%3E)
Andrew Ovsyannikov
0
Reputation points
Custom question answering became too slow after loading my resources and question-answer pairs
Azure AI Language
{count} votes
-
Carlos Solís Salazar 18,291 Reputation points MVP Volunteer Moderator2023-12-21T00:53:03.61+00:00 To provide a detailed and accurate answer, especially when it comes to troubleshooting or addressing specific technical scenarios like those involving Azure, Microsoft 365, and Windows technologies, there are several key pieces of information that would be helpful:
- Exact Nature of the Issue or Requirement:
- What specific problem are you facing, or what specific outcome are you trying to achieve?
- Environment Details:
- What is the specific technology, software, or service you are using (e.g., Azure services, Windows version, Microsoft 365 apps)?
- Are there any specific configurations, customizations, or integrations involved?
- Error Messages or Codes:
- If you are encountering an error, what is the exact error message or code?
- Steps Already Taken:
- What steps have you already taken to try to resolve the issue or achieve your goal?
- Have you followed any specific troubleshooting steps, documentation, or guides?
- Desired Timeline or Urgency:
- Is there a specific timeline or level of urgency for resolving this issue or achieving this goal?
- Security and Compliance Considerations:
- Are there any particular security, privacy, or compliance requirements that need to be taken into account?
- Budget or Resource Constraints:
- Are there any constraints regarding budget, resources, or available tools?
- Previous Experience or Background:
- What is your level of expertise or familiarity with the technology involved?
- Intended Use or Business Context:
- What is the broader context or business scenario in which this technology is being used?
- Other Relevant Information:
- Any other information you think might be relevant or helpful for understanding the full picture.
Having this information allows me to tailor the response more precisely to your situation, ensuring that the guidance is relevant, actionable, and addresses your specific needs.
- Exact Nature of the Issue or Requirement:
-
Andrew Ovsyannikov 0 Reputation points
2023-12-21T07:29:29.5133333+00:00 I use Language Studio and have uploaded my resources and question-answer pairs.
In the begining I tested Custom question answering with 2 resources and small count of question-answer pairs it was fast enough.
Now I loaded 91 text resources with 1825 question-answer pairs in total, and I should wait a 15-30 seconds before I got an answer to most of the question.
I already deployed knowledge base and got same speed throug API by SDKfrom azure.ai.language.questionanswering import QuestionAnsweringClientI use method get_answers with confidence_threshold confidence_threshold=0.4 without any filters
-
romungi-MSFT 49,106 Reputation points Microsoft Employee Moderator2023-12-21T09:39:44.2733333+00:00 @Andrew Ovsyannikov I think the performance in this case could be improved if your Azure AI search resource uses a higher tier. Please see this page on resource planning for custom question answering feature.
AI search resource tier descriptions and capabilities are also documented in the AI search document.
-
romungi-MSFT 49,106 Reputation points Microsoft Employee Moderator
2023-12-27T05:55:15.8533333+00:00 @Andrew Ovsyannikov Did the change in tier of search resource help?
Sign in to comment
Sign in to answer