Azure OpenAI fine-tuning with image fails but no details given in logs.

Question

Azure OpenAI fine-tuning with image fails but no details given in logs.

Ah Kun, Leo 0

I'm trying to test fine-tuning with images using the Azure OpenAI with GPT-4o. I tried it first with 10 items using a simple image stored in blob storage which works.

When I try to test it with an actual image I want to fine-tune with, it fails during pre-processing, but gives me no details in the logs. I'm stumped to what the problem could be. The logs show "pre-processing complete" as the last item, but the status of the job is "failed".

kothapally Snigdha 3,020 Reputation points Microsoft External Staff Moderator

2025-03-05T22:49:44.0166667+00:00
Hi Ah Kun, Leo

It sounds like you are encountering issues with the fine-tuning process for images using Azure OpenAI. Since the logs do not provide specific details about the failure, here are a few common issues to consider:

Ensure that the image you are trying to fine-tune with meets the requirements. Images must be in JPEG, PNG, or WEBP format and should not exceed 10 MB in size.

Check if the image contains any elements that are not allowed, such as faces, people, or CAPTCHAs. Images with these elements will be skipped during training.

Verify that the image URL is publicly accessible. If the image is stored in blob storage, ensure that the permissions are set correctly.

If the image is part of a larger dataset, ensure that the dataset is well-curated and representative of the task you are trying to train the model for.

https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/fine-tuning-troubleshoot#fine-tuning-with-vision

I hope these helps you. Thank you!
Ah Kun, Leo 0 Reputation points

2025-03-07T10:54:52.16+00:00

Hi there, after running it again, I it says that it skipped the images because they are CAPTCHA's. But they are not. What can I do if they are incorrectly detected as CAPTCHA's? It seems to detect it for all images, not just a few.
kothapally Snigdha 3,020 Reputation points Microsoft External Staff Moderator

2025-03-10T22:31:32.7866667+00:00

Hi Ah Kun, Leo

Ensure that the images do not contain any elements that might resemble CAPTCHAs, such as distorted text or patterns that could be misinterpreted by the detection algorithms.

As a temporary solution, you might want to try using different images that do not trigger the CAPTCHA detection to continue your fine-tuning process.

Kindly refer these documents https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/fine-tuning-troubleshoot#fine-tuning-with-vision

I hope these helps you. Thank you!
kothapally Snigdha 3,020 Reputation points Microsoft External Staff Moderator

2025-03-12T20:22:42.08+00:00

Hi Ah Kun, Leo

Following up to see if the response was helpful.
kothapally Snigdha 3,020 Reputation points Microsoft External Staff Moderator

2025-03-17T04:40:41.6233333+00:00

Hi Ah Kun, Leo

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

1 answer

Your answer

kothapally Snigdha 3,020 Reputation points Microsoft External Staff Moderator

2025-03-05T22:49:44.0166667+00:00

Hi Ah Kun, Leo

It sounds like you are encountering issues with the fine-tuning process for images using Azure OpenAI. Since the logs do not provide specific details about the failure, here are a few common issues to consider:

Ensure that the image you are trying to fine-tune with meets the requirements. Images must be in JPEG, PNG, or WEBP format and should not exceed 10 MB in size.

Check if the image contains any elements that are not allowed, such as faces, people, or CAPTCHAs. Images with these elements will be skipped during training.

Verify that the image URL is publicly accessible. If the image is stored in blob storage, ensure that the permissions are set correctly.

If the image is part of a larger dataset, ensure that the dataset is well-curated and representative of the task you are trying to train the model for.

https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/fine-tuning-troubleshoot#fine-tuning-with-vision

I hope these helps you. Thank you!
Ah Kun, Leo 0 Reputation points

2025-03-07T10:54:52.16+00:00

Hi there, after running it again, I it says that it skipped the images because they are CAPTCHA's. But they are not. What can I do if they are incorrectly detected as CAPTCHA's? It seems to detect it for all images, not just a few.
kothapally Snigdha 3,020 Reputation points Microsoft External Staff Moderator

2025-03-10T22:31:32.7866667+00:00

Hi Ah Kun, Leo

Ensure that the images do not contain any elements that might resemble CAPTCHAs, such as distorted text or patterns that could be misinterpreted by the detection algorithms.

As a temporary solution, you might want to try using different images that do not trigger the CAPTCHA detection to continue your fine-tuning process.

Kindly refer these documents https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/fine-tuning-troubleshoot#fine-tuning-with-vision

I hope these helps you. Thank you!
kothapally Snigdha 3,020 Reputation points Microsoft External Staff Moderator

2025-03-12T20:22:42.08+00:00

Hi Ah Kun, Leo

Following up to see if the response was helpful.
kothapally Snigdha 3,020 Reputation points Microsoft External Staff Moderator

2025-03-17T04:40:41.6233333+00:00

Hi Ah Kun, Leo

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

Answer 1

Lin, Fanghe (Emily) 20

Hi there, I've encountered the same issue with my images—most are being flagged as containing CAPTCHAs. I used the same set of images as training data to fine-tune GPT4o a month ago without any problems (no captchas issue). Have there been any changes to the CAPTCHA threshold this month?

Share via

Azure OpenAI fine-tuning with image fails but no details given in logs.

1 answer

Your answer