Hello, For a few days, I can no longer train custom Form Recognizer models via Form Recognizer Studio. When starting a train, the error is: "ModelBuildError Could not build the model: OCR file 'xxxx.pdf.ocr.json' has an invalid schema." The API version used in my projects is '2021-09-30-preview' The manipulations are performed directly in the interface https://formrecognizer.appliedai.azure.com/studio The error occurs on new projects and on existing projects for which models have already been trained. So, the ocr file is well generated by Form Recognizer Studio. It doesn't matter the file or the project. The labeling interface is functional.

I had the same problem yesterday , i connected to the support and started sharing the screen to show the problem. It started working byitself. I do not see the error agian.

@Balaganesh Chakrahari @CHIPPENDALE,TOM (Agilent USA) @Aurélien DOLANDE Thanks a lot for the information, product group is investigating this abnormal behavior, I will give update here ASAP. Regards, Yutong

@Balaganesh Chakrahari @CHIPPENDALE,TOM (Agilent USA) @Aurélien DOLANDE Hello everyone, Product team has checked on the backend, they did see failure but not sure about the reason, we want to reach out to you for more information to fix this issue, we would like to invite you for a live debug session if you still have this issue and you are convenient. Information we need as below: Did the repro happen when Form Recognizer Studio was used? (I think it's YES, just double confirm)Or was the customer using their own code to train the model? Have the customer to check their blob and check all of the *.ocr.josn to ensure that they all have valid Layout output (which has ReadResults section) We are working on fixing this issue. Thank you. Regards, Yutong

Unable to train a model on Form Recognizer Studio - OCR file has an invalid schema

Aurélien DOLANDE 1

Hello,

For a few days, I can no longer train custom Form Recognizer models via Form Recognizer Studio.

When starting a train, the error is:

"ModelBuildError

Could not build the model: OCR file 'xxxx.pdf.ocr.json' has an invalid schema."

The API version used in my projects is '2021-09-30-preview'
The manipulations are performed directly in the interface https://formrecognizer.appliedai.azure.com/studio
The error occurs on new projects and on existing projects for which models have already been trained. So, the ocr file is well generated by Form Recognizer Studio.
It doesn't matter the file or the project.
The labeling interface is functional.

YutongTie-MSFT 47,991 Reputation points

2022-01-25T20:08:39.157+00:00

@Aurélien DOLANDE

Hello,

I have no issue to create a new custom project or retrain existing project. Could you please let me know your resource region?

Regards,
Yutong
Balaganesh Chakrahari 1 Reputation point

2022-01-25T20:09:32.713+00:00

EastUS
Aurélien DOLANDE 1 Reputation point

2022-01-25T20:51:09.14+00:00

Hi,

the ressources (storage account and Form Recognizer) are located in the France Central region

The XHR query posted by Form Recognizer Studio :
https://xxxxxxxx.cognitiveservices.azure.com/formrecognizer/documentModels:build?api-version=2021-09-30-preview

Response :
{
"error": {
"code": "InvalidRequest",
"message": "Invalid request.",
"innererror": {
"code": "ModelBuildError",
"message": "Could not build the model: OCR file \u002720220125132147230_0001.pdf.ocr.json\u0027 has an invalid schema."
}
}
}

Regards,
Aurélien
Balaganesh Chakrahari 1 Reputation point

2022-01-25T21:03:04.357+00:00

If you created the model just today , please give a day time . i tried all day and it did not work. It started working after a day.
CHIPPENDALE,TOM (Agilent USA) 21 Reputation points

2022-01-25T21:13:18.123+00:00

I am having the same problem that the original poster reported while trying to train a model. Please see error message below.
Aurélien DOLANDE 1 Reputation point

2022-01-25T21:35:36.343+00:00

I think it's not a matter of time because one of my custom models created 5 days ago and already trained twice also has the problem.

I just tried with a model from another Form Recognizer resource located in Western Europe. On this resource, the problem does not exist.
YutongTie-MSFT 47,991 Reputation points

2022-01-25T23:12:17.483+00:00

@CHIPPENDALE,TOM (Agilent USA)

Could you please share your region, both the resource and your storage account? Thanks.
YutongTie-MSFT 47,991 Reputation points

2022-01-25T23:13:42.727+00:00

@Aurélien DOLANDE

Thanks for the information. So this issue only happened for your France Central region but not Western Europe region correct? I have forwarded this issue to product team for investigation.

Regards,
Yutong
CHIPPENDALE,TOM (Agilent USA) 21 Reputation points

2022-01-25T23:29:06.707+00:00

Here is the information requested.

Region: West US
Resource Group: imageprocessing
Storage Account: blobtestimages
Aurélien DOLANDE 1 Reputation point

2022-01-26T16:01:59.177+00:00

Hi,

Today, the error is different :

the corresponding XHR response :
{
"operationId": "31523155613_346e9aa1-cb43-465d-b0a8-b2fe8912276c",
"kind": "documentModelBuild",
"status": "failed",
"createdDateTime": "2022-01-26T15:53:07Z",
"lastUpdatedDateTime": "2022-01-26T15:53:09Z",
"resourceLocation": "https://xxxxxxxx.cognitiveservices.azure.com/formrecognizer/documentModels/mel-error?api-version=2021-09-30-preview",
"percentCompleted": 100,
"error": {
"code": "InternalServerError",
"message": "An unexpected error occurred.",
"details": [
{
"code": "InternalServerError",
"message": "An unexpected error occurred."
}
]
}
}

So, I created another project on the same resources in a different folder in the same blobstorage container with the same files.
On this new project, I don't have the error.

Same thing for the existing project which was not working anymore: today the trainings are working again.

Is it related to the preview version ?
CHIPPENDALE,TOM (Agilent USA) 21 Reputation points

2022-01-26T16:41:32.167+00:00

I was able to train the form recognition model this morning without the schema error that was occurring yesterday. I did not make any changes to the contents of the blob store image contents (i.e. the same file that was causing the error is still present). It appears the issue has been fixed. Have you been able to identify the root cause for the training schema error and what the fix was?

3 answers

Balaganesh Chakrahari 1 Reputation point

2022-01-25T19:36:25.33+00:00

I had the same problem yesterday , i connected to the support and started sharing the screen to show the problem. It started working byitself. I do not see the error agian.
Please sign in to rate this answer.

0 comments No comments
Sign in to comment
YutongTie-MSFT 47,991 Reputation points

2022-01-27T17:51:06.97+00:00

@Balaganesh Chakrahari @CHIPPENDALE,TOM (Agilent USA) @Aurélien DOLANDE

Thanks a lot for the information, product group is investigating this abnormal behavior, I will give update here ASAP.

Regards,
Yutong
Please sign in to rate this answer.

0 comments No comments
Sign in to comment
YutongTie-MSFT 47,991 Reputation points

2022-02-01T22:51:03.383+00:00

@Balaganesh Chakrahari @CHIPPENDALE,TOM (Agilent USA) @Aurélien DOLANDE

Hello everyone,

Product team has checked on the backend, they did see failure but not sure about the reason, we want to reach out to you for more information to fix this issue, we would like to invite you for a live debug session if you still have this issue and you are convenient.

Information we need as below:
Did the repro happen when Form Recognizer Studio was used? (I think it's YES, just double confirm)Or was the customer using their own code to train the model?
Have the customer to check their blob and check all of the *.ocr.josn to ensure that they all have valid Layout output (which has ReadResults section)

We are working on fixing this issue. Thank you.

Regards,
Yutong
Please sign in to rate this answer.
Aurélien DOLANDE 1 Reputation point

2022-02-04T10:42:14.437+00:00

Hello,

I confirm that the training has been done with Form Recognizer Studio.
I made other tests by moving the files on another blobstorage and on another Form Recognizer resource.

I don't reproduce anymore the first error concerning the invalid schema.

However, I just found a way to reproduce the second error (internal server error).

On my files and labels, it occurs during training when the configuration of one of the files (the last one in my scenario) contains a region linked to a signature field.

I can provide you with the files of my example, as long as they are used for internal debugging.

Feel free to contact me by email.

CHIPPENDALE,TOM (Agilent USA) 21 Reputation points

2022-02-04T20:31:52.14+00:00

I was using Form Recognizer Studio to do the training when I got the schema error.

I am not using my own code to train the model

After sporadically trying to train the model over a 24-48 hour period, the error eventually disappeared. No idea why.

I have not tried to retrain the model since it was successful.
Sign in to comment

Share via

Unable to train a model on Form Recognizer Studio - OCR file has an invalid schema

3 answers