Quality metrics for Azure Translate language pairs

Question

Dmitry Denisenko 0

Hello!

I wonder if you have any translation quality metrics published for Azure Translate? I am interested in Thai-English and English-Thai pairs.

Thank you so much in advance.

VasaviLankipalle-MSFT 18,666 Reputation points Moderator

2023-10-24T22:29:06.1866667+00:00

Hello @Dmitry Denisenko , Thanks for using Microsoft Q&A Platform.

Generally, the metrics BLEU score which is a widely used metric for evaluating machine translation quality. Is this something you are looking for please share more information with the documentation you are referring to.
Dmitry Denisenko 0 Reputation points

2023-10-25T03:18:12.93+00:00

Hello! BLEU is correct metric, right. But I am talking about existing service metrics. E.g. for this product: https://azure.microsoft.com/en-us/products/ai-services/ai-translator#layout-container-uidfe1a

Your answer

VasaviLankipalle-MSFT 18,666 Reputation points Moderator

2023-10-24T22:29:06.1866667+00:00

Hello @Dmitry Denisenko , Thanks for using Microsoft Q&A Platform.

Generally, the metrics BLEU score which is a widely used metric for evaluating machine translation quality. Is this something you are looking for please share more information with the documentation you are referring to.
Dmitry Denisenko 0 Reputation points

2023-10-25T03:18:12.93+00:00

Hello! BLEU is correct metric, right. But I am talking about existing service metrics. E.g. for this product: https://azure.microsoft.com/en-us/products/ai-services/ai-translator#layout-container-uidfe1a