Custom API and Custom Supervised containers, unable to do analyze request for any document.

Raghvendra Dhore 1

Hi,

I am running the custom container from this link on my local, the containers are running and able to access the API, I was able to train the model and can see the results in model details. However when calling the analyze request for one of the pdf in the shared folder, there is no response from the backend. I tried to check the file then realized there is an error in one of the output.json file as follows:

{  
        "status": "failed",  
        "createdDateTime": "2022-08-11T05:02:07Z",  
        "lastUpdatedDateTime": "2022-08-11T05:02:07Z",  
        "analyzeResult": {  
            "version": "2.1.0",  
            "errors": [  
                {  
                    "code": "3014",  
                    "message": "Generic error during prediction."  
                }  
            ]  
        }  
    }

I used /formrecognizer/{apiVersion}/custom/models API to train the model from Postman and the files manually copied in shared folder.
I am using /formrecognizer/{apiVersion}/custom/models/{modelId}/analyze API to start Analyze and the files are again in shared folder, however I am not getting any result back but the API is success with 202.

Please let me know what is wrong.

romungi-MSFT 42,311 Reputation points Microsoft Employee

2022-08-12T06:50:39.477+00:00

@Raghvendra Dhore Have you used the same API version for training and analyze request? That is, if the API used for training is 3.0 and the analyze request API uses 2.1 then this is the most common reason that I have observed for the generic error.

Since you have trained the model using the container, do you see same behavior while using the studio too?

A 202 response does not indicate the analyze operation is completely successful since the request is passed to the model asynchronously the end response of analyze operation could still fail for various reasons i.e incorrect document format, unreadable document or an issue with the model itself.
Raghvendra Dhore 1 Reputation point

2022-08-15T04:31:33.54+00:00
@romungi-MSFT yes I have trained with v2.1 and doing the analyze with v2.1, this is what was there in the documentation. Also the nginx points to v2.1 as per the documentation.

train request is as follows:
URL - http://localhost:5000/formrecognizer/v2.1/custom/models

Payload:

{ "source": "/shared/Train", "useLabelFile": true }

Analyze request:
URL - http://localhost:5000/formrecognizer/v2.1/custom/models/d8724ba4-c8d0-40fb-9cdf-46a6d605aa76/analyze?includeTextDetails=true

Payload:

{ "source": "/shared/Test/Invoice_7.pdf", "jsonRequest": { "source": "/shared/Test/Invoice_7.pdf" } }

Am I missing something here? Is there any alternative way to do it? I am running the container on my local machine and also all the files are in local machine, which are attached as volume to container.
romungi-MSFT 42,311 Reputation points Microsoft Employee

2022-08-16T08:55:31.807+00:00

@Raghvendra Dhore The steps seem correct. But since you are using a local container, I am not too sure if the request is failing with getting the document or an issue with the model itself. Do you see the model id when listing the custom models using the REST API?

If yes, you could try to use the analyze operation by passing the URL of your document using REST API. If the analyze works successfully then this could be an issue with the configuration of nginx.
If the same result is seen then the model did not train correctly, or the state of the model cannot run the analyze operation.
romungi-MSFT 42,311 Reputation points Microsoft Employee

2022-08-19T13:45:18.54+00:00

@Raghvendra Dhore Did the above suggestion help? If you are still facing issues, I would recommend raising a support case from Azure portal to report the issue with your trained model. Thanks!!

Raghvendra Dhore 1

@romungi-MSFT I am back on this task, and tried your suggestion, however i can see the listing of models I can see the out put as below:

   {  
       "modelList": [  
           {  
               "modelId": "d8724ba4-c8d0-40fb-9cdf-46a6d605aa76",  
               "attributes": {  
                   "isComposed": false  
               },  
               "status": "ready",  
               "createdDateTime": "2022-08-11T10:07:10Z",  
               "lastUpdatedDateTime": "2022-08-11T10:11:57Z"  
           },  
           {  
               "modelId": "dea8660e-6228-42a2-bdf7-b5c578d9989c",  
               "attributes": {  
                   "isComposed": false  
               },  
               "status": "ready",  
               "createdDateTime": "2022-11-09T03:39:05Z",  
               "lastUpdatedDateTime": "2022-11-09T03:39:23Z"  
           }  
       ],  
       "nextLink": ""  
   }

However using the URL to do analyze I get error as below:

Forms.Common.UserStorage.Filters.SourceRequestFilter[0]
azure-cognitive-service-custom-api | User-provided resource responded with HTTP 404 - NotFound. SubscriptionId=

also the response as below:

   {  
       "error": {  
           "code": "2001",  
           "message": "Failed to download the image from the submitted URL. The URL may either be invalid or the server hosting the image is experiencing some technical difficulties."  
       }  
   }