form recognizer mistranslation when processing multiple documents

Question

form recognizer mistranslation when processing multiple documents

Srikant Naidu 0

i am testing a simple logic app that translates multiple files into english. when I run one file through it, it is very good quality but when i run multiple files the translation is absolutely trash. The test file I am using is a UN paper so I can compare the quality of the translations; original, good, trash. This is my logic app code

{
    "definition": {
        "$schema": "https://schema.management.azure.com/providers/Microsoft.Logic/schemas/2016-06-01/workflowdefinition.json#",
        "actions": {
            "For_each": {
                "type": "Foreach",
                "foreach": "@body('Lists_blobs_(V2)')?['value']",
                "actions": {
                    "Check_if_PDF": {
                        "type": "If",
                        "expression": {
                            "and": [
                                {
                                    "equals": [
                                        "@items('For_each')?['MediaType']",
                                        "application/pdf"
                                    ]
                                }
                            ]
                        },
                        "actions": {
                            "Start_document_translation": {
                                "type": "ApiConnection",
                                "inputs": {
                                    "host": {
                                        "connection": {
                                            "referenceName": "microsofttranslatorv"
                                        }
                                    },
                                    "method": "post",
                                    "body": {
                                        "storageType": "Folder",
                                        "sourceURL": "https://equablobmain.blob.core.windows.net/test-translate-arabic?si=test-translate&spr=https&sv=2022-11-02&sr=c&sig=%2BrZRDITWB%2BxjCbIp2XezHIR7xWpYajxg7IEWbpjDECU%3D",
                                        "targetContainerURL": "https://equablobmain.blob.core.windows.net/test-translate-en?si=test-translate&spr=https&sv=2022-11-02&sr=c&sig=L9IZV7HhJ4CB27bZWbff0Vk1%2FUc5ZAqVgR38OYoIs2A%3D",
                                        "targetLanguage": "en",
                                        "sourceLanguage": "ar"
                                    },
                                    "headers": {
                                        "Content-Type": "application/json"
                                    },
                                    "path": "/translator/text/batch/v1.1/batches/"
                                },
                                "runAfter": {
                                    "Analyze_Layout": [
                                        "SUCCEEDED"
                                    ]
                                }
                            },
                            "Analyze_Layout": {
                                "type": "ApiConnection",
                                "inputs": {
                                    "host": {
                                        "connection": {
                                            "referenceName": "formrecognizer"
                                        }
                                    },
                                    "method": "post",
                                    "headers": {
                                        "inputFileUrl": "@concat('https://equablobmain.blob.core.windows.net/test-translate-arabic/', items('For_each')?['Name'], '?sp=rl&st=2025-01-25T18:53:32Z&se=2025-01-30T02:53:32Z&spr=https&sv=2022-11-02&sr=c&sig=Xnh5XK1WWmvahq%2BsyrLKFl8BBLLTjbAIhP1v6QIg%2FWE%3D')",
                                        "Content-Type": "application/json"
                                    },
                                    "path": "/v2.1/layout/analyze"
                                }
                            }
                        },
                        "else": {
                            "actions": {
                                "Start_document_translation_1": {
                                    "type": "ApiConnection",
                                    "inputs": {
                                        "host": {
                                            "connection": {
                                                "referenceName": "microsofttranslatorv"
                                            }
                                        },
                                        "method": "post",
                                        "body": {
                                            "storageType": "Folder",
                                            "sourceURL": "https://equablobmain.blob.core.windows.net/test-translate-arabic?si=test-translate&spr=https&sv=2022-11-02&sr=c&sig=%2BrZRDITWB%2BxjCbIp2XezHIR7xWpYajxg7IEWbpjDECU%3D",
                                            "targetContainerURL": "https://equablobmain.blob.core.windows.net/test-translate-en?si=test-translate&spr=https&sv=2022-11-02&sr=c&sig=L9IZV7HhJ4CB27bZWbff0Vk1%2FUc5ZAqVgR38OYoIs2A%3D",
                                            "targetLanguage": "en",
                                            "sourceLanguage": "ar"
                                        },
                                        "headers": {
                                            "Content-Type": "application/json"
                                        },
                                        "path": "/translator/text/batch/v1.1/batches/"
                                    }
                                }
                            }
                        }
                    }
                },
                "runAfter": {
                    "Lists_blobs_(V2)": [
                        "Succeeded"
                    ]
                }
            },
            "Lists_blobs_(V2)": {
                "type": "ApiConnection",
                "inputs": {
                    "host": {
                        "connection": {
                            "referenceName": "azureblob"
                        }
                    },
                    "method": "get",
                    "path": "/v2/datasets/@{encodeURIComponent(encodeURIComponent('AccountNameFromSettings'))}/foldersV2/@{encodeURIComponent(encodeURIComponent('test-translate-arabic'))}"
                },
                "runAfter": {},
                "metadata": {
                    "JTJmdGVzdC10cmFuc2xhdGUtYXJhYmlj": "/test-translate-arabic"
                }
            }
        },
        "contentVersion": "1.0.0.0",
        "outputs": {},
        "triggers": {
            "When_a_blob_is_added_or_updated": {
                "type": "ServiceProvider",
                "inputs": {
                    "parameters": {
                        "path": "https://equablobmain.blob.core.windows.net/test-translate-arabic"
                    },
                    "serviceProviderConfiguration": {
                        "connectionName": "AzureBlob-1",
                        "operationId": "whenABlobIsAddedOrModified",
                        "serviceProviderId": "/serviceProviders/AzureBlob"
                    }
                }
            }
        }
    },
    "kind": "Stateful"
}

Anonymous

2025-01-30T07:49:27.6666667+00:00

Hi @Srikant Naidu ,

Welcome to the Microsoft Q&A Platform! Thank you for asking your question here.

It seems like you are having trouble with the quality of translations when running multiple files through your logic app.

Can you provide more information about the specific issues you are encountering? Are the translations inaccurate, incomplete, or difficult to understand? Additionally, have you tried adjusting any of the settings in your logic app to improve the translation quality?
Srikant Naidu 0 Reputation points

2025-01-30T16:00:49.97+00:00

Hi @Shireesha Eeraboina,

I appreciate you reaching out.

The translations are inaccurate. I uploaded the test PDFs in the original post along with the official english version document for reference. When I run multiple files through the logic app, the PDF files translation quality goes down when compared to running a single PDF file through it.

I think that the form recognizer in the analyze layout node may not be fully processing the PDF files. We have tried adding an until loop to make sure that the analyze layout fully completes before going to document translation, but the quality has not improved.

Not sure why the extraction and translation with 1 pdf works well but multiple documents do not.
Srikant Naidu 0 Reputation points

2025-01-30T16:10:20.6533333+00:00

Hi @Anonymous

Thank you for your response. I appreciate your support.

The issue I'm encountering is that when I process multiple PDF files through the logic app, the translations turn out to be significantly worse compared to when I process a single file. The same test file—a UN paper—is used for comparison, and when processed individually, the translation quality is excellent. However, when multiple files are processed together, the translations appear inaccurate and incomplete.

Initially, I thought this might be due to the Form Recognizer Analyze Layout node not fully completing the analysis for each PDF when multiple files are processed. To address this, I added an Until node to ensure that the Form Recognizer step completes successfully (status = 'Succeeded') before proceeding. Despite this adjustment, the issue persists, and the translations for multiple documents remain poor. It still works well only when I process one PDF at a time.

I would like to understand why this discrepancy occurs when handling multiple files and whether there are specific settings or best practices to improve consistency and quality across batches. Could this be related to resource contention or some limitations in the Translator API or Form Recognizer?

Anonymous

Hi @Srikant Naidu ,

Thank you for sharing the required details.

The discrepancy in translation quality between processing a single PDF file and multiple files could be due to several factors. Here are some potential causes and suggestions to improve consistency and quality across batches:

Split the files into smaller batches and process them one at a time to prevent overwhelming resources and exceeding API limits.
Consider moving to a more powerful plan for the Form Recognizer and Translator APIs to enhance the limits on concurrent requests and input file sizes.
Introduce delays and timeouts in the Logic App's workflow to ensure efficient file processing and to avoid overloading resources.
Keep an eye on the Logic App's performance and make adjustments to the configuration and workflow as necessary to maintain consistent and high-quality translations.

Here’s an updated version of your Logic App code that incorporates a sequential processing mechanism and includes a delay between file processing:

{

    "definition": {

        "$schema": "https://schema.management.azure.com/providers/Microsoft.Logic/schemas/2016-06-01/workflowdefinition.json#",

        "actions": {

            "For_each": {

                "type": "Foreach",

                "foreach": "@body('Lists_blobs_(V2)')?['value']",

                "actions": {

                    "Check_if_PDF": {

                        "type": "If",

                        "expression": {

                            "and": [

                                {

                                    "equals": [

                                        "@items('For_each')?['MediaType']",

                                        "application/pdf"

                                    ]

                                }

                            ]

                        },

                        "actions": {

                            "Analyze_Layout": {

                                "type": "ApiConnection",

                                "inputs": {

                                    "host": {

                                        "connection": {

                                            "referenceName": "formrecognizer"

                                        }

                                    },

                                    "method": "post",

                                    "headers": {

                                        "inputFileUrl": "@concat('https://equablobmain.blob.core.windows.net/test-translate-arabic/', items('For_each')?['Name'], '?sp=rl&st=2025-01-25T18:53:32Z&se=2025-01-30T02:53:32Z&spr=https&sv=2022-11-02&sr=c&sig=Xnh5XK1WWmvahq%2BsyrLKFl8BBLLTjbAIhP1v6QIg%2FWE%3D')",

                                        "Content-Type": "application/json"

                                    },

                                    "path": "/v2.1/layout/analyze"

                                }

                            },

                            "Delay": {

                                "type": "Delay",

                                "inputs": {

                                    "interval": {

                                        "count": 10,

                                        "unit": "Second"

                                    }

                                },

                                "runAfter": {

                                    "Analyze_Layout": [

                                        "Succeeded"

                                    ]

                                }

                            },

                            "Start_document_translation": {

                                "type": "ApiConnection",

                                "inputs": {

                                    "host": {

                                        "connection": {

                                            "referenceName": "microsofttranslatorv"

                                        }

                                    },

                                    "method": "post",

                                    "body": {

                                        "storageType": "Folder",

                                        "sourceURL": "https://equablobmain.blob.core.windows.net/test-translate-arabic?si=test-translate&spr=https&sv=2022-11-02&sr=c&sig=%2BrZRDITWB%2BxjCbIp2XezHIR7xWpYajxg7IEWbpjDECU%3D",

                                        "targetContainerURL": "https://equablobmain.blob.core.windows.net/test-translate-en?si=test-translate&spr=https&sv=2022-11-02&sr=c&sig=L9IZV7HhJ4CB27bZWbff0Vk1%2FUc5ZAqVgR38OYoIs2A%3D",

                                        "targetLanguage": "en",

                                        "sourceLanguage": "ar"

                                    },

                                    "headers": {

                                        "Content-Type": "application/json"

                                    },

                                    "path": "/translator/text/batch/v1.1/batches/"

                                },

                                "runAfter": {

                                    "Delay": [

                                        "Succeeded"

                                    ]

                                }

                            }

                        },

                        "else": {

                            "actions": {

                                "Start_document_translation_1": {

                                    "type": "ApiConnection",

                                    "inputs": {

                                        "host": {

                                            "connection": {

                                                "referenceName": "microsofttranslatorv"

                                            }

                                        },

                                        "method": "post",

                                        "body": {

                                            "storageType": "Folder",

                                            "sourceURL": "https://equablobmain.blob.core.windows.net/test-translate-arabic?si=test-translate&spr=https&sv=2022-11-02&sr=c&sig=%2BrZRDITWB%2BxjCbIp2XezHIR7xWpYajxg7IEWbpjDECU%3D",

                                            "targetContainerURL": "https://equablobmain.blob.core.windows.net/test-translate-en?si=test-translate&spr=https&sv=2022-11-02&sr=c&sig=L9IZV7HhJ4CB27bZWbff0Vk1%2FUc5ZAqVgR38OYoIs2A%3D",

                                            "targetLanguage": "en",

                                            "sourceLanguage": "ar"

                                        },

                                        "headers": {

                                            "Content-Type": "application/json"

                                        },

                                        "path": "/translator/text/batch/v1.1/batches/"

                                    }

                                }

                            }

                        }

                    }

                },

                "runAfter": {

                    "Lists_blobs_(V2)": [

                        "Succeeded"

                    ]

                },

                "concurrency": {

                    "count": 1

                }

            },

            "Lists_blobs_(V2)": {

                "type": "ApiConnection",

                "inputs": {

                    "host": {

                        "connection": {

                            "referenceName": "azureblob"

                        }

                    },

                    "method": "get",

                    "path": "/v2/datasets/@{encodeURIComponent(encodeURIComponent('AccountNameFromSettings'))}/foldersV2/@{encodeURIComponent(encodeURIComponent('test-translate-arabic'))}"

                },

                "runAfter": {},

                "metadata": {

                    "JTJmdGVzdC10cmFuc2xhdGUtYXJhYmlj": "/test-translate-arabic"

                }

            }

        },

        "contentVersion": "1.0.0.0",

        "outputs": {},

        "triggers": {

            "When_a_blob_is_added_or_updated": {

                "type": "ServiceProvider",

                "inputs": {

                    "parameters": {

                        "path": "https://equablobmain.blob.core.windows.net/test-translate-arabic"

                    },

                    "serviceProviderConfiguration": {

                        "connectionName": "AzureBlob-1",

                        "operationId": "whenABlobIsAddedOrModified",

                        "serviceProviderId": "/serviceProviders/AzureBlob"

                    }

                }

            }

        }

    },

    "kind": "Stateful"

}

For your reference, please review the following documentations for further clarification.

I hope this helps! Let me know if you have any further questions or need additional assistance.

Srikant Naidu 0 Reputation points

2025-01-31T20:31:30.39+00:00
Hi @Anonymous

Thank you for your detailed response and suggestions.

We have tried implementing a time delay in the logic app workflow to address this issue, but unfortunately, it did not resolve the problem. Here are additional observations from our testing:

Testing Details: All the test documents are less than 10 pages in length.

Mixed File Types: When testing with two files—one PDF and one DOCX—the PDF's translation quality was still significantly worse than when extracting and translating a single PDF file at a time.

Plans Used: We are on standard plans for Azure AI Document Intelligence, Azure AI Translator, and Logic Apps.

Translation Comparison: Please refer to the attached test files in the original post to compare the original documents, high-quality translations (single file), and poor-quality translations (multiple files).

Question: When processing multiple documents, is the Document Translator API attempting to translate the output of the Form Recognizer (Analyze Layout) node, or is it directly trying to translate the original PDF files?

We suspect that when multiple files are processed together, the Form Recognizer may not fully analyze each document before passing it to the Translator API, causing the quality degradation. Despite adding an Until node to ensure the Form Recognizer step completes successfully (status = 'Succeeded'), the issue persists.

Any further guidance or clarification on improving translation consistency when processing multiple files would be greatly appreciated.

1 answer

Your answer

Anonymous

2025-01-30T07:49:27.6666667+00:00

Hi @Srikant Naidu ,

Welcome to the Microsoft Q&A Platform! Thank you for asking your question here.

It seems like you are having trouble with the quality of translations when running multiple files through your logic app.

Can you provide more information about the specific issues you are encountering? Are the translations inaccurate, incomplete, or difficult to understand? Additionally, have you tried adjusting any of the settings in your logic app to improve the translation quality?
Srikant Naidu 0 Reputation points

2025-01-30T16:00:49.97+00:00

Hi @Shireesha Eeraboina,

I appreciate you reaching out.

The translations are inaccurate. I uploaded the test PDFs in the original post along with the official english version document for reference. When I run multiple files through the logic app, the PDF files translation quality goes down when compared to running a single PDF file through it.

I think that the form recognizer in the analyze layout node may not be fully processing the PDF files. We have tried adding an until loop to make sure that the analyze layout fully completes before going to document translation, but the quality has not improved.

Not sure why the extraction and translation with 1 pdf works well but multiple documents do not.
Srikant Naidu 0 Reputation points

2025-01-30T16:10:20.6533333+00:00

Hi @Anonymous

Thank you for your response. I appreciate your support.

The issue I'm encountering is that when I process multiple PDF files through the logic app, the translations turn out to be significantly worse compared to when I process a single file. The same test file—a UN paper—is used for comparison, and when processed individually, the translation quality is excellent. However, when multiple files are processed together, the translations appear inaccurate and incomplete.

Initially, I thought this might be due to the Form Recognizer Analyze Layout node not fully completing the analysis for each PDF when multiple files are processed. To address this, I added an Until node to ensure that the Form Recognizer step completes successfully (status = 'Succeeded') before proceeding. Despite this adjustment, the issue persists, and the translations for multiple documents remain poor. It still works well only when I process one PDF at a time.

I would like to understand why this discrepancy occurs when handling multiple files and whether there are specific settings or best practices to improve consistency and quality across batches. Could this be related to resource contention or some limitations in the Translator API or Form Recognizer?
Srikant Naidu 0 Reputation points

2025-01-31T20:31:30.39+00:00

Hi @Anonymous

Thank you for your detailed response and suggestions.

We have tried implementing a time delay in the logic app workflow to address this issue, but unfortunately, it did not resolve the problem. Here are additional observations from our testing:

Testing Details: All the test documents are less than 10 pages in length.

Mixed File Types: When testing with two files—one PDF and one DOCX—the PDF's translation quality was still significantly worse than when extracting and translating a single PDF file at a time.

Plans Used: We are on standard plans for Azure AI Document Intelligence, Azure AI Translator, and Logic Apps.

Translation Comparison: Please refer to the attached test files in the original post to compare the original documents, high-quality translations (single file), and poor-quality translations (multiple files).

Question: When processing multiple documents, is the Document Translator API attempting to translate the output of the Form Recognizer (Analyze Layout) node, or is it directly trying to translate the original PDF files?

We suspect that when multiple files are processed together, the Form Recognizer may not fully analyze each document before passing it to the Translator API, causing the quality degradation. Despite adding an Until node to ensure the Form Recognizer step completes successfully (status = 'Succeeded'), the issue persists.

Any further guidance or clarification on improving translation consistency when processing multiple files would be greatly appreciated.

Answer 1

Hi @Srikant Naidu ,

I apologize for any inconvenience caused.

Based on the information you provided, it seems that the quality of translations is significantly worse when processing multiple files compared to when processing a single file. You have also mentioned that you have tried implementing a time delay in the logic app workflow to address this issue, but it did not resolve the problem.

Regarding your question, when processing multiple documents, the Document Translator API is attempting to translate the original PDF files, not the output of the Form Recognizer (Analyze Layout) node.

It is possible that when multiple files are processed together, the Form Recognizer may not fully analyze each document before passing it to the Translator API, causing the quality degradation. Despite adding an Until node to ensure the Form Recognizer step completes successfully (status = 'Succeeded'), the issue persists.
To improve translation consistency when processing multiple files, you may want to consider breaking down the process into smaller batches and processing them separately. This will allow the Form Recognizer to fully analyze each document before passing it to the Translator API, potentially improving the quality of translations.
Additionally, you may want to review the settings and configurations of your Azure AI Document Intelligence, Azure AI Translator, and Logic Apps plans to ensure that they are optimized for your use case.

Also, for your better understanding, please refer to the following documentations:

I hope this information helps! Let me know if you have any further questions.

Anonymous

2025-02-04T05:12:17.89+00:00

Hi @Srikant Naidu ,

If you find the answer helpful, kindly click "Accept Answer" and upvote it. If you have any further questions or concerns, please feel free to reach out to us. We are happy to assist you.
Anonymous

2025-02-05T04:52:55.5333333+00:00

Hi @Srikant Naidu ,

If you found the response helpful, please click Accept Answer and Yes for the provided answer. This will help other community members with similar issues find the solution more easily.

Share via

form recognizer mistranslation when processing multiple documents

1 answer

Your answer