Training file: Preprocessing Summary: The provided data failed validation.

Question

Training file: Preprocessing Summary: The provided data failed validation.

Hassan K 5

I get training data set validation errors on about 1/3 of my training dataset. I looked at the images with the problems and I do not agree with the status. The images are all RBG or RGBA files and open fine. All these documents are for engineering documents and pictures of equipment. In the Ignite conference they said if you need to disable checks, reach out to the support team. Here is the link to the video:
https://youtu.be/7LzNwsQVTZ8?t=1705

status : Training file: Preprocessing Summary: The provided data failed validation. Number of skipped multimodal examples exceed the maximum allowed 200 limit: not an image (889), image oversize (35), contains captcha (131), contains faces (6), contains people (1). Please visit our docs to learn how to resolve these issues, and try again.

VarunTha 14,995 Reputation points Microsoft External Staff Moderator

2025-03-03T18:52:15.7633333+00:00

Hi Hassan K,

Can you please specify the Learn Path/Module that you are going through?
Hassan K 5 Reputation points

2025-03-03T18:54:48.0833333+00:00

Hi sorry, this is in Azure AI Foundry, I choose "Azure Training" because I am fine tuning and training = fine-tuning. I could not find any other relevant tags related to Azure Open AI.
santoshkc 15,615 Reputation points Microsoft External Staff Moderator

2025-03-07T14:09:32.2+00:00
Hi @Hassan K,

Thank you for providing the details. The validation errors indicate that a portion of your dataset is being flagged for various reasons, such as "not an image," "oversized image," or "contains captcha, faces, or people." Since you believe these images are valid, here are some steps to troubleshoot:

Ensure the files have correct extensions and are not corrupted. Try re-saving a few flagged images.

Confirm that images meet size limits and do not contain patterns that may trigger face or text recognition flags.

Also, please refer: Image prompt engineering techniques.

Thank you.
santoshkc 15,615 Reputation points Microsoft External Staff Moderator

2025-03-10T06:45:14.81+00:00

Hi @Hassan K,

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others.

Thank you.