Azure AI Document Intelligence
An Azure service that turns documents into usable data. Previously known as Azure Form Recognizer.
How does the layout model determine reading order?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(307.2, 21%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBP%3C/text%3E%3C/svg%3E)
Bogdan Pechounov
125
Reputation points
Initially when I was using the AzureAIDocumentIntelligenceLoader with Langchain, I thought that the API responds with an array of paragraphs and that the markdown is assembled on the client. Is the reading order determined on the server (closed source); can the algorithm be tweaked?
Are there any guarantees that the order calculated is always correct?
Azure AI Document Intelligence
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(278.4, 1%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EYM%3C/text%3E%3C/svg%3E)
YutongTie-MSFT 54,011 Reputation points Moderator2024-03-06T01:04:51.0433333+00:00 @Bogdan Pechounov Thanks for reaching out to us, we are checking on this issue internally, will let you know later.
-
Bogdan Pechounov 125 Reputation points
2024-03-14T17:07:18.89+00:00 @YutongTie-MSFT Thank you. I found an article on LayoutReader, something similar might be used.
-
YutongTie-MSFT 54,011 Reputation points Moderator
2024-03-14T17:26:25.3933333+00:00 @Bogdan Pechounov Thanks for sharing the solution! Please let us know if you have any further questions.
Regards,
Yutong
-
Bogdan Pechounov 125 Reputation points
2024-03-14T17:37:02.83+00:00 @YutongTie-MSFT (It was supposed to be a comment, not sure what happened). Is it correct that the LayoutReader (relying on LayoutLM), or a higher version of it (working with LayoutLMv3?), is being used to determine reading order? (so it's not an algorithm that can be customized)
I am wandering if there are any results, metrics or benchmarks to have a better idea of how well the model determines reading order.
-
YutongTie-MSFT 54,011 Reputation points Moderator
2024-03-14T17:40:41.95+00:00 @Bogdan Pechounov Yes, mine is comment as well. I am checking with internal about those details you need.
Regards,
Yutong
Sign in to comment
Sign in to answer