Azure Cognitve Service Custom NER - Relation between entities

Spöring, Paul, CL 1

Hi,
I`m trying to find a way to implement relationships between my custom NER entities.
Currently I use it to identify entities in an mail about metering readings. There are entity like reading date, that are relevant for all meter readings, but some entities have to have a relationship with each other.
For example when I got an mail with 2 meter readings and 2 meter numbers, I have to identify which belongs to which.
Currently I use the postion of the entities, but that is not really working great, because sometime the metering reading come before the meter number, sometime after it.
Any idea or alternative ways?
Best regards,
Paul

romungi-MSFT 42,206 Reputation points Microsoft Employee

2022-12-05T09:22:06.333+00:00

@Spöring, Paul, CL Are you using the auto labeling feature while training your model?
In the above example, I believe the datatype for both the entities are similar which might be causing the confusion along with the position of the entities.
Have you tried to add more data and examples to train your model? I mean the case where the data contains the meter reading before meter number and vice versa?

Some best practices and design guidelines are mentioned in this document.
Spöring, Paul, CL 1 Reputation point

2022-12-05T11:53:02.187+00:00

Hi @romungi-MSFT ,

I know that datatype for both entries are mostly the same, the model has to learn in which context what lable to use, but this is not the problem that I asked about.
To be more clear the following combinations are both valid:

Email 1:

Hello company,

here is my meter readings 11223 from the meter 12233442

Email 2:
Hello company,

for my meter 12233442 the reading is 11223

In this example it doesn't matter in which order the entities come, because if there are just one of evry type, I get my key/value pair.
The problem arises when I got more than one combination:

Email 3:

Hello company,

my meter readings are
Meter 111234, Reading 22
Meter 22344 Reading 33

In this example I would have to know which reading belongs to which meter. Easy engough in this example, because I can get the position or look in the same line. But the problem is it has to work also with this example:

Email 4:

Hello company,

for my meter 112233 the reading is 11 and 22 for the meter 223344

I found some information online it is possible to model the relationships between enties https://towardsdatascience.com/how-to-train-a-joint-entities-and-relation-extraction-classifier-using-bert-transformer-with-spacy-49eb08d91b5c my question is, how to do this in azure.

for my meter 12233442