How do you link a Custom Classification model to Custom Extraction Model

Question

How do you link a Custom Classification model to Custom Extraction Model

Kris Robbins 55

We are currently using 2023-07-31 (3.1 General Availability).

I can create Custom Classification Models and Custom Extraction Models. I don't understand how the two are linked. I can see you can compose Extraction models together.

Ideally we need to call Classification first as this allows split of documents. How would I then call Extraction for each result (page). Or Make this into a single call?

It looks like version 4 allows you to compose Extraction Models and Classification Models together.

When will version 4 be available for preview in Australia?

Kris Robbins 55 Reputation points

2024-10-11T07:02:39.5733333+00:00

Thanks for the information. Just quick one. Does a composed model split muti page? All pages would be same type. We get some invoices on a multi page document. Each page is a different invoice. I thought Classification was the only one that split. I will run some tests with our new composed models and see how it goes. Much appreciated for you quick response :)
Kris Robbins 55 Reputation points

2024-10-14T01:33:59.4766667+00:00

After playing around with compose models a little bit, I have a follow up question. If I have 5 examples of an invoice from one company. Then want to create a custom model for another invoice. Do I have to remove those 5 documents. Add my new examples and then train again. I was hoping it would show models across projects. It is just a bit painful, especially if I want to go back to the first company again to train again, I have to select documents again and map fields. I was hoping Train would allow you to train on selected documents or something.
Rohit Mungi 49,116 Reputation points Microsoft Employee Moderator

2024-10-14T15:35:00.5166667+00:00

@Kris Robbins You can add new document examples and train a new model and add it as part of a composed model.

If there are pages with different types of invoices, you can split the document with pages and pass each page to the API instead. This will require some pre-processing at client side to split the document by pages. Thanks!!
Kris Robbins 55 Reputation points

2024-10-14T23:48:22.75+00:00

My question was to the best way to do this. Do I have to remove the current examples that I have and then drop new examples in. I have to do this for each different type of invoice (they are all quite different). I was kind of hoping I could either have a project per invoice type or have a quick and easy way to switch back to a model I had created in case I need to adjust or re-train. Currently all I can do is delete the examples for my current example and add new ones.
Rohit Mungi 49,116 Reputation points Microsoft Employee Moderator

2024-10-15T05:33:45.24+00:00

@Kris Robbins you can have a project for every invoice type and create a custom model and add it to a composed model. If you have composed a model with document type A, lets say Model A and document type B, Model B, let's say the composed model is Model C. When you add a new project to train a model and create a new custom model D you can create a new composed model(E) by adding composed model C and custom model D, this should contain all the models A, B and D. This will allow you to use your previously trained model and use the new model too without having to delete anything.
Kris Robbins 55 Reputation points

2024-10-16T00:04:06.0933333+00:00

My confusion was more about if I can have multiple projects and that they can see each other models if using the same Resource Group. I was sure I tried that before and my Models did NOT show. I can now see it is because one of those projects was against a different API version. I can now create separate projects and merge models between them. Thanks for your patience and the answers.
Rohit Mungi 49,116 Reputation points Microsoft Employee Moderator

2024-10-16T05:24:05.5733333+00:00

@Kris Robbins Yes, they should be with same API version to be able to list and compose. I'll move my original response to an answer, please feel free to accept if it helped. Thanks!!

Answer accepted by question author

0 additional answers

Your answer

Kris Robbins 55 Reputation points

2024-10-11T07:02:39.5733333+00:00

Thanks for the information. Just quick one. Does a composed model split muti page? All pages would be same type. We get some invoices on a multi page document. Each page is a different invoice. I thought Classification was the only one that split. I will run some tests with our new composed models and see how it goes. Much appreciated for you quick response :)
Kris Robbins 55 Reputation points

2024-10-14T01:33:59.4766667+00:00

After playing around with compose models a little bit, I have a follow up question. If I have 5 examples of an invoice from one company. Then want to create a custom model for another invoice. Do I have to remove those 5 documents. Add my new examples and then train again. I was hoping it would show models across projects. It is just a bit painful, especially if I want to go back to the first company again to train again, I have to select documents again and map fields. I was hoping Train would allow you to train on selected documents or something.
Rohit Mungi 49,116 Reputation points Microsoft Employee Moderator

2024-10-14T15:35:00.5166667+00:00

@Kris Robbins You can add new document examples and train a new model and add it as part of a composed model.

If there are pages with different types of invoices, you can split the document with pages and pass each page to the API instead. This will require some pre-processing at client side to split the document by pages. Thanks!!
Kris Robbins 55 Reputation points

2024-10-14T23:48:22.75+00:00

My question was to the best way to do this. Do I have to remove the current examples that I have and then drop new examples in. I have to do this for each different type of invoice (they are all quite different). I was kind of hoping I could either have a project per invoice type or have a quick and easy way to switch back to a model I had created in case I need to adjust or re-train. Currently all I can do is delete the examples for my current example and add new ones.
Rohit Mungi 49,116 Reputation points Microsoft Employee Moderator

2024-10-15T05:33:45.24+00:00

@Kris Robbins you can have a project for every invoice type and create a custom model and add it to a composed model. If you have composed a model with document type A, lets say Model A and document type B, Model B, let's say the composed model is Model C. When you add a new project to train a model and create a new custom model D you can create a new composed model(E) by adding composed model C and custom model D, this should contain all the models A, B and D. This will allow you to use your previously trained model and use the new model too without having to delete anything.
Kris Robbins 55 Reputation points

2024-10-16T00:04:06.0933333+00:00

My confusion was more about if I can have multiple projects and that they can see each other models if using the same Resource Group. I was sure I tried that before and my Models did NOT show. I can now see it is because one of those projects was against a different API version. I can now create separate projects and merge models between them. Thanks for your patience and the answers.
Rohit Mungi 49,116 Reputation points Microsoft Employee Moderator

2024-10-16T05:24:05.5733333+00:00

@Kris Robbins Yes, they should be with same API version to be able to list and compose. I'll move my original response to an answer, please feel free to accept if it helped. Thanks!!

Answer 1

@Kris Robbins With v4.0 an explicit classification model is required for compose model if you are using multiple extraction models in the compose model. As per documentation:

The 2024-07-31-preview implementation of the model compose operation replaces the implicit classification from the earlier versions with an explicit classification step and adds conditional routing.

So, with the current GA version that you are using, the composed model determines implicitly without the need of a custom classification model to generate a response that best matches one of the models in the composed model.

So, as per the composed model compatibility list your region can support composing v3.0 and v3.1 models in a composed model id without the need of training a custom classification model.

User's image

If you use a custom classification model with v3.0 you can still classify the document types and train a model. Based on the output of your classification model i.e the document type that is returned you will have to make another call to your custom extraction model id to analyze the document.

If you use v4.0 API in a different region you will have to follow the approach of creating a custom classification model with different document types and train the custom classification model and then train individual custom extraction models of the types used in custom classification and link them up in a compose operation i.e use the custom model classification model id, custom extraction model id's for all the types used in the custom classification model.

I am also not sure about ETA of launching v4.0 in Australia region. Please check the What's new page regularly for updates on future rollouts.

I hope this helps!!

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Share via

How do you link a Custom Classification model to Custom Extraction Model

0 additional answers

Your answer