Wrong ICD codes being returned for some conditions in Text Analytics for Health in Azure

Question

Wrong ICD codes being returned for some conditions in Text Analytics for Health in Azure

Jawwad Tanvir 0

Hi,

I am using Text Analytics for Health to determine ICD 10 CM codes depending on clinician notes and it is not returning correct ICD codes for many conditions.

For example for "Major depressive disorder, recurrent, moderate" which has ICD 10 CM code F33.1 it returns three entities i.e., "Major depressive disorder" AND "recurrent" AND "moderate".

It then links the first entity i.e., "Major depressive disorder" with ICD 10 CM code "F32.9" and treats "recurrent" as "course" and "moderate" as "condition". Whereas actually it shall return and ICD 10 CM Code F33.1 which is the correct classification of the disease.

Am I doing something wrong or do we need to add a custom model to improve it?

Thank you,

Jawwad

romungi-MSFT 48,911 Reputation points Microsoft Employee Moderator

2023-10-11T10:58:41.3933333+00:00

@Jawwad Tanvir With regards to the service returning wrong codes, I am not too familiar with the mapping as I believe it is based on mapping entities to umls, and based on that it maps to other sources, like ICD10CM as per documentation. I would advise to raise a support case from azure portal to check if this mapping is incorrect and pass the feedback to the product team for correction/improvement.

With respect to using the custom models, I see this is based on the same lines as creating a custom product for language that can improve extraction of healthcare specific entities from unstructured text, such as clinical notes and reports. By creating a custom Text Analytics for health project, developers can iteratively define new vocabulary, label data, train, evaluate, and improve model performance before making it available for consumption. This can help to better extract data from text but the mapping of terms with UMLS should remain unchanged.
Jawwad Tanvir 0 Reputation points

2023-10-11T15:34:19.06+00:00

Hi @romungi-MSFT The code which it is returning is wrong when checked from the UMLSL documents so the mapping is definitely incorrect and needs fixing. How do I pass the feedback to product team for correction/improvement?
romungi-MSFT 48,911 Reputation points Microsoft Employee Moderator

2023-10-12T04:09:16.9333333+00:00

@Jawwad Tanvir You can raise a support case from Azure portal with details of your request and the mapping from UMLS for reference.

Your answer

romungi-MSFT 48,911 Reputation points Microsoft Employee Moderator

2023-10-11T10:58:41.3933333+00:00

@Jawwad Tanvir With regards to the service returning wrong codes, I am not too familiar with the mapping as I believe it is based on mapping entities to umls, and based on that it maps to other sources, like ICD10CM as per documentation. I would advise to raise a support case from azure portal to check if this mapping is incorrect and pass the feedback to the product team for correction/improvement.

With respect to using the custom models, I see this is based on the same lines as creating a custom product for language that can improve extraction of healthcare specific entities from unstructured text, such as clinical notes and reports. By creating a custom Text Analytics for health project, developers can iteratively define new vocabulary, label data, train, evaluate, and improve model performance before making it available for consumption. This can help to better extract data from text but the mapping of terms with UMLS should remain unchanged.
Jawwad Tanvir 0 Reputation points

2023-10-11T15:34:19.06+00:00

Hi @romungi-MSFT The code which it is returning is wrong when checked from the UMLSL documents so the mapping is definitely incorrect and needs fixing. How do I pass the feedback to product team for correction/improvement?
romungi-MSFT 48,911 Reputation points Microsoft Employee Moderator

2023-10-12T04:09:16.9333333+00:00

@Jawwad Tanvir You can raise a support case from Azure portal with details of your request and the mapping from UMLS for reference.

Share via

Wrong ICD codes being returned for some conditions in Text Analytics for Health in Azure

Your answer