Issue with Azure OpenAI GPT-4 Model: Invalid Content Type for Image URL

Question

Hello everyone,

I'm encountering an issue while using the Azure OpenAI GPT-4 model, and I'm seeking some assistance. My requirement involves sending an image through the REST API to the GPT-4 model for analysis. However, I'm receiving an error response stating, "Invalid content type. Image URL is only supported by certain models."

Interestingly, I have successfully accomplished the same task using OpenAI directly, but it seems to be problematic when using Azure. I would greatly appreciate any insights or suggestions on how to resolve this issue.

Here are the details of the problem:

• Objective: Analyzing an image using Azure OpenAI GPT-4 model via REST API.
• Error: Invalid content type. Image URL is only supported by certain models.
• Expected Outcome: Successful analysis of the provided image using Azure OpenAI GPT-4 model.

I have thoroughly reviewed the documentation, but I couldn't find any specific guidance regarding this error or limitations related to image URL support in Azure's GPT-4 model.

If anyone has encountered a similar issue or has knowledge about the compatibility of image URLs with Azure OpenAI GPT-4 model, I would greatly appreciate your insights and suggestions for resolving this problem.

Thank you in advance for your time and assistance!

Best regards,
Qi

Answer 1

柒 龙 Greetings!

I'm encountering an issue while using the Azure OpenAI GPT-4 model, and I'm seeking some assistance. My requirement involves sending an image through the REST API to the GPT-4 model for analysis. However, I'm receiving an error response stating, "Invalid content type. Image URL is only supported by certain models."

It seems like you are trying to send an image through the REST API to the GPT-4 model for analysis, but you are receiving an error response stating, "Invalid content type. Image URL is only supported by certain models." This error message indicates that the GPT-4 model does not support image URLs as input.

The GPT-4 model is a language model that generates text based on the input prompt. It does not have the capability to analyze images. Please see Azure OpenAI Service frequently asked questions for more details.

But, as mentioned in the blogpost, GPT-4 Turbo with Vision on Azure OpenAI service is coming soon to public preview.

When integrated with Azure AI Vision, GPT-4V will enhance experiences by allowing the inclusion of images or videos along with text for generating text output, benefiting from Azure AI Vision enhancement like video analysis.

Unfortunately, We don't have any information regarding the ETA to share with you at this moment.

Once new models are available, What's new in Azure OpenAI Service and Azure OpenAI Service models page will be updated accordingly with more details.

I would suggest you, keep an eye on the above for more updates. I will also update here once models are included.

Alternatively, If you want to analyze images, you may want to consider using a computer vision model such as Azure AI Vision.

Hope this helps. If you have any other questions, please let me know.

---

If the response helped, please do click Accept Answer and Yes for was this answer helpful.

Doing so would help other community members with similar issue identify the solution. I highly appreciate your contribution to the community.