Can we integrate Azure form Recongnizer with sharePoint online document library

john john 946

I want to extract info from uploaded documents inside SharePoint.. the documents have standard info such as first name , last name, but have more complicated elements such as Check-boxes & Signatures, as follow:-

Now i am planning to create these Yes/No fields inside SharePoint document library, as follow:-

Private
Luxury
Body-left
Body-Right
Truck

and force the OCR to map the fields to Yes in-case its checkbox has the right mark inside it. for the second image i am planning to create a drop-dwn field and select the option based on which checkbox is checked(the number of wheels in my case). Also for the signature not sure what are the options..

now i were planning to use Power Automate AI Form Processing to extract the data, but i recognized that the current Power automate Form Processing will not support check-boxes and signature recognition. so i am now investigating the Azure Form Recognition capabilities.. so does it support the above kind of data extraction (Check-Boxes and Signatures)?
and second question how we can integrate it with SharePoint? can we force the azure form recognition to run when we upload a file inside SharePoint and populate the extracted data inside SharePoint document libraries?

romungi-MSFT 43,656 Reputation points Microsoft Employee

2021-07-06T14:09:40.957+00:00

@john john Check boxes are supported with V2.1-preview.1 version of the API and with respect to signatures you can train a model to recognize characters but validation of signatures might not be possible. For a signature scenario you can check how it can be used with form recognizer in this blog. If you provide a designated box then you can check if there is text in the signature box.

With respect to Integration with sharepoint you can call the API when there is a new file created or uploaded by passing the URL of the image but public access might be required. You can instead try a scenario using binary data instead as mentioned in this article.
john john 946 Reputation points

2021-07-06T17:48:44.397+00:00

@romungi-MSFT we do not need any signature validation,, so will the Azure form recognizer extract the signature as images?
romungi-MSFT 43,656 Reputation points Microsoft Employee

2021-07-07T03:59:41.917+00:00

@john john Form recognizer does not return images as part of the response. Form recognizer can recognize handwritten data in an image so if the signature letters can be recognized it will return the data as one of the field in JSON.

Example as mentioned in the blog I referenced in my previous post.

Share via

Can we integrate Azure form Recongnizer with sharePoint online document library