Can we train custom model on handwritten signatures not recognized by OCR?

Bogdan Pechounov 60

Signatures that are "artistic" aren't detected by OCR since they don't contain valid characters.

Do custom models perform token classification on the text detected by OCR? Or do they use techniques such as YOLO for object detection to first detect any arbitrary object and then classify it?

I am wondering if I can train a model to extract handwritten signatures even if the signature isn't detected by OCR.

I have seen there is a signature field. What is it doing differently than ordinary fields? (My guess is object detection is used instead of OCR)

YutongTie-MSFT 52,776 Reputation points

2024-06-12T00:31:17.5133333+00:00

Hello @Bogdan Pechounov

Thanks for reaching out to us, yes, if you are training the custom model only for signature, I would highly recommend you trying signature field to see if the accuracy is good enough for you.

For your question "Do custom models perform token classification on the text detected by OCR? Or do they use techniques such as YOLO for object detection to first detect any arbitrary object and then classify it?" I think this information is not disclose at this moment, from technical side, both of the ways are possible.

Please try recognize the signature fields and see how it works, if it is not good enough for you, we can discuss further to see any other ways we can accomplish it.
Bogdan Pechounov 60 Reputation points

2024-06-12T12:20:02.56+00:00

@YutongTie-MSFT "both of the ways are possible". The reason I ask is because if OCR is used, then the signature wouldn't even be detected. However, it might be detected if a different algorithm is used, such as one for object detection.

Are signature fields only for template models? If I understood correctly, they use the text detected by OCR in a specific position.

Here is an example where signatures aren't detected:

Thank you,
Sriramsubramaniyan Nadarajan 76 Reputation points

2024-06-18T06:11:57.9866667+00:00

Hi @YutongTie-MSFT and @Bogdan Pechounov,

I am also facing same issue, some signatures are not getting detected, can you please let me know if there is any work around solution.I am using a custom template extraction model, but signatures are not detected, even if i create a signature field and draw a zone. Please advise.

Share via

Can we train custom model on handwritten signatures not recognized by OCR?

Your answer