Confidence score clarification

Piyushkumar Gupta 0

I was doing Azure Language studio exercise using this url

https://language.cognitive.azure.com/tryout/sentiment and trying Sentiment and opinion mining tryout

Question is: confidence scores at the sentence and document-level, but what i observed confidence score is same as positive %. So is confidence score is all about positivity? My understanding is either positive or negative or neutral, confidence score is about how confidence model is about the sentiment.

For below e.g., here positive score is 73% and sentiment confidence score is 73%. Make sense.

User's image

But on the other side in below example, here in this case, my understanding was confidence score should not be 0% but it should be about how confidence is model even the sentiment is negative 97%. Seems it only reflect when it is positive. So question is - Confidence is only about how confident in positive sentiment, doesnt reflect negative sentiment or neutral sentiment?

Can you clarify? I tried with neutral example also, but again it only relate to positive

User's image

dupammi 7,950 Reputation points Microsoft Vendor

2024-06-07T09:08:16.9266667+00:00

Hi @Piyushkumar Gupta

Thank you for your question.

The confidence score represents how certain the model is about its classification for positive, neutral, or negative sentiment. It should not be solely associated with positive sentiment. If you're seeing confidence scores as 0% for non-positive sentiments, it may be worth checking if there's an issue with the specific implementation or interpretation of the results in the Azure Language Studio. The confidence score is not exclusively about positive sentiment but about the model's certainty in its sentiment classification (positive, neutral, negative). If the observed behavior persists, you might want to reach out to Azure support for further clarification or to report a potential bug.

Share via

Confidence score clarification