Azure Cognitive Service - Text Analytics - Detect Language Feature : Not able to detect Ukrainian and Vietnamese languages. Showing (Unknown) for detected language name and iso6391Name

Question

Hi Guys,

I am using Azure Cognitive service Text Analytics, Language Detection feature in my application. However, the API is not able to detect Ukrainian and Vietnamese languages. And showing (Unknown) for detected language name and iso6391Name.

From the below link, it is said that, both the languages are supported.

https://learn.microsoft.com/en-us/azure/cognitive-services/text-analytics/language-support?tabs=language-detection

Please let me know why its not able to detect these two languages. Resource created in Central India region and have Visual Studio Enterprise Subscription.

Attached are the screen shots for 4 languages including Ukrainian and Vietnamese for comparison in POSTMAN. Please let me know if any more details are needed.

French

Turkish

Ukrainian

Vietnamese

Answer 1

Hi,

Below are details requested. I updated with Italian and Japanese languages which are working.

Italian and Japanese

Request Body
{
"documents": [
{
"id": "1",
"text": "Metodi diagnostici convenzionali in patologia dopo aver prelevato un campione di tessuto da un paziente"
},
{
"id":"2",
"text":"蛍光抗体検査、電子のためのグルタルアルデヒドでの固定顕微鏡学"
}
]
}

Output

{
"documents": [
{
"id": "1",
"detectedLanguage": {
"name": "Italian",
"iso6391Name": "it",
"confidenceScore": 1.0
},
"warnings": []
},
{
"id": "2",
"detectedLanguage": {
"name": "Japanese",
"iso6391Name": "ja",
"confidenceScore": 1.0
},
"warnings": []
}
],
"errors": [],
"modelVersion": "2021-01-05"
}

Ukrainian and Vietnamese which is not working

Request Body

{
"documents": [
{
"id": "1",
"text": "Зусилля з метою комерціалізації біоконверсії лінгоцелюлозних сировинних ресурсів можуть потенційно"
},
{
"id": "2",
"text": "Sự đa dạng về các đặc điểm hóa lý của sinh khối xenlulo cho thấy nhu cầu về công nghệ tiền xử lý"
}
]
}

Output

{
"documents": [
{
"id": "1",
"detectedLanguage": {
"name": "(Unknown)",
"iso6391Name": "(Unknown)",
"confidenceScore": 0.0
},
"warnings": []
},
{
"id": "2",
"detectedLanguage": {
"name": "(Unknown)",
"iso6391Name": "(Unknown)",
"confidenceScore": 0.0
},
"warnings": []
}
],
"errors": [],
"modelVersion": "2021-01-05"
}

name and iso6391Name are (Unknown)