Azure AI Search
An Azure search service with built-in artificial intelligence capabilities that enrich information to help identify and explore relevant content at scale.
1,274 questions
Getting massive throttling on AI Search
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(44.800000000000004, 67%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDN%3C/text%3E%3C/svg%3E)
Dimitris Nomikos
21
Reputation points
Throttling and Latency went through the roof for one of our Engines that have 3 replicas on Basic Tier Plan without any Application changes or weird influx on our site traffic on North Europe in the last 1 and a half hour. Is there an unreported problem?
{count} votes
-
Grmacjon-MSFT 19,001 Reputation points2024-01-29T22:05:18.7966667+00:00 @Dimitris Nomikos Thanks for bringing this our attention. We are checking internally with the engineering team to get more insights on your question and will get back to you when we hear back from them. Are you currently seeing the same level of throttling?
Best,
Grace
-
Dimitris Nomikos 21 Reputation points
2024-01-30T10:28:44.3133333+00:00 The throttling made our App unusable and we couldn't handle the downtime. We ended up recreating our AI Search resource in West Europe, it seems a lot more stable for now.
Our index volume is ~3500 Documents of ~35MB Size and the query frequency is around 4-5 queries per second, and we started having more than 30% of our queries throttled with a peak of 72% throttle. I can't believe our size volumes or the query frequency should have such a performance for 3 replicas.
-
Dimitris Nomikos 21 Reputation points
2024-01-30T10:31:26.6+00:00 Accidental repost...~~
We had to recreate our resource in West Europe since we couldn't handle the downtime. We had 30-70% of queries throttled in North Europe.~~
For additional information we have an index of 3500 documents, 35MB size with a query frequency of 4-5 per second. I don't think we should have such performance issues with this kind of traffic and index volume. -
Grmacjon-MSFT 19,001 Reputation points
2024-02-08T02:54:02.08+00:00 @Dimitris Nomikos apologies for the late response. thanks for the additional information. just to clarify, is your app still stable with your resource in west Europe? what region did you have it in before?
-
Dimitris Nomikos 21 Reputation points
2024-02-15T12:43:14.3066667+00:00 We had our Search resource in North Europe. After we created it in West Europe it seemed stable until today that we started having up to 20% of our requests throttled while not having more than 3.5 queries per second.
-
Grmacjon-MSFT 19,001 Reputation points
2024-02-21T00:21:38.74+00:00 This is definitely odd behavior. Checking internally to see if this is a known issue and will get back to you.
-
Grmacjon-MSFT 19,001 Reputation points
2024-02-21T16:54:25.5+00:00 @Dimitris Nomikos Thanks for your patience. It looks like this issue require deeper investigation. Could you please send us an email to AzCommunity[at]Microsoft[dot]com with the below details, so that we can enable a one-time-free support for you to work closely on this issue?
Email subject: <Attn - Grace >
Thread URL: <Microsoft Q&A Thread>
Subscription ID: <your Azure subscription id>
Please let me know here once the email is sent along with above requested details.
-Grace
Sign in to comment
Sign in to answer