This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(227.2, 9%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
How to enable the usage report in the Azure Open AI service, OpenAI uses tiktoken as tokenizer, Is Azure Open AI uses different tokenizer?
Hello @A-4824 !
Azure OpenAI is part of Cognitive Services, which uses Azure Monitor. If you're unfamiliar with the features of Azure Monitor common to all Azure services that use it, read Monitoring Azure resources with Azure Monitor.
Monitoring data
Azure OpenAI collects the same kinds of monitoring data as other Azure resources that are described in Monitoring data from Azure resources.
Collection and routing
Platform metrics and the Activity log are collected and stored automatically, but can be routed to other locations by using a diagnostic setting.
Resource Logs aren't collected and stored until you create a diagnostic setting and route them to one or more locations.
See Create diagnostic setting to collect platform logs and metrics in Azure for the detailed process for creating a diagnostic setting using the Azure portal, CLI, or PowerShell. When you create a diagnostic setting, you specify which categories of logs to collect.
Keep in mind that using diagnostic settings and sending data to Azure Monitor Logs has additional costs associated with it. To understand more, consult the Azure Monitor cost calculation guide.
The metrics and logs you can collect are discussed in the following sections.
Analyzing metrics
You can analyze metrics for Azure OpenAI by opening Metrics which can be found underneath the Monitoring section when viewing your Azure OpenAI resource in the Azure portal. See Getting started with Azure Metrics Explorer for details on using this tool.
Azure OpenAI is a part of Cognitive Services. For a list of all platform metrics collected for Cognitive Services and Azure OpenAI, see Cognitive Services supported metrics.
For the current subset of metrics available in Azure OpenAI:
Azure OpenAI Metrics
| BlockedCalls | Yes | Blocked Calls | Count | Total | Number of calls that exceeded rate or quota limit. | ApiName, OperationName, Region, RatelimitKey |
| ClientErrors | Yes | Client Errors | Count | Total | Number of calls with client side error (HTTP response code 4xx). | ApiName, OperationName, Region, RatelimitKey |
| DataIn | Yes | Data In | Bytes | Total | Size of incoming data in bytes. | ApiName, OperationName, Region |
| DataOut | Yes | Data Out | Bytes | Total | Size of outgoing data in bytes. | ApiName, OperationName, Region |
| FineTunedTrainingHours | Yes | Processed FineTuned Training Hours | Count | Total | Number of Training Hours Processed on an OpenAI FineTuned Model | ApiName, ModelDeploymentName, FeatureName, UsageChannel, Region |
| Latency | Yes | Latency | MilliSeconds | Average | Latency in milliseconds. | ApiName, OperationName, Region, RatelimitKey |
| Ratelimit | Yes | Ratelimit | Count | Total | The current ratelimit of the ratelimit key. | Region, RatelimitKey |
| ServerErrors | Yes | Server Errors | Count | Total | Number of calls with service internal error (HTTP response code 5xx). | ApiName, OperationName, Region, RatelimitKey |
| SuccessfulCalls | Yes | Successful Calls | Count | Total | Number of successful calls. | ApiName, OperationName, Region, RatelimitKey |
| TokenTransaction | Yes | Processed Inference Tokens | Count | Total | Number of Inference Tokens Processed on an OpenAI Model | ApiName, ModelDeploymentName, FeatureName, UsageChannel, Region |
| TotalCalls | Yes | Total Calls | Count | Total | Total number of calls. | ApiName, OperationName, Region, RatelimitKey |
| TotalErrors | Yes | Total Errors | Count | Total | Total number of calls with error response (HTTP response code 4xx or 5xx). | ApiName, OperationName, Region, RatelimitKey |
You can start with this link :
https://learn.microsoft.com/en-us/azure/cognitive-services/openai/how-to/monitoring
And this
You can enable AzureOPENAI to leverage the tiktoken
Similar thread :
I hope this helps!
Kindly mark the answer as Accepted and Upvote in case it helped!
Regards
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(73.60000000000001, 98%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
hello, I want to know what the ratelimit metric means in azure openai?
Dose is means the times of the trafiic reach out the limit?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(22.400000000000002, 11%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERM%3C/text%3E%3C/svg%3E)