Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
Why my OpenAI embedding service latency so high?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(307.2, 65%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EZE%3C/text%3E%3C/svg%3E)
Zo Earl
0
Reputation points
Azure OpenAI Service
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 44%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Saurabh Sharma 23,866 Reputation points Microsoft Employee Moderator2024-03-04T21:22:25.02+00:00 Hi @Zo Earl
Welcome to Microsoft Q&A! Thanks for posting the question.
- Have you made any changes to your application, or you are seeing this latency on a newly deployed application?
- Which model you are using and in which region ?
- how many tokens are in prompt and how are generated tokens.
Please refer to the documentation to understand latency causes and recommendations to improve the performance per-call latency.
Thanks
Saurabh
-
Saurabh Sharma 23,866 Reputation points Microsoft Employee Moderator
2024-03-18T23:25:40.86+00:00 Hi @Zo Earl ,
We haven't heard back from you. Just wanted to check if you are you still facing the issue? In case If you already found a solution, would you please share it here with the community? Otherwise, let us know and we will continue to engage with you on the issue.
Thanks
Saurabh
Sign in to comment
Sign in to answer