Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
4,081 questions
Does Azure OpenAI offer embeddings for datatypes other than text?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 47%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EW%3C/text%3E%3C/svg%3E)
Will
0
Reputation points
I know that it is possible to use an embedding model to map text to a high-dimensional vector space that can be queried using a vectorstore retrieval (or equivalent) in Azure. This allows appropriate context to be provided to an LLM when executing a query on a written document.
My question is: Does Azure offer any options to do similar embeddings for non-text data: images, for example?
Azure OpenAI Service
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(6.4, 61%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
santoshkc 15,325 Reputation points Microsoft External Staff Moderator2023-09-20T08:39:28.4866667+00:00 Hi @Will
Thank you for reaching out to the Microsoft Q&A forum.
Yes, it is possible, Azure offers embeddings for non-text data such as images.
Image Retrieval Vectorize Image API(Preview) supports vectorization of image content. We recommend this API for generating embeddings for images. They convert images to coordinates in a multi-dimensional vector space. This allows the user to search a set of images using text, without the need to use image tags or other metadata. Please refer the below hyperlink for the implementation details:
Image Retrieval Vectorize Image API(Preview)
I hope this information helps! Let me know if you have any further questions.
-
-
Will 0 Reputation points
2023-09-21T16:13:20.7233333+00:00 Hi @santoshkc .
Thanks for your prompt feedback. It was helpful. Are there other embedding methods that Microsoft is implementing for other file types (audio, video, CAD files, 3D models, etc.)?
-
Will 0 Reputation points
2023-09-21T16:15:09.71+00:00 Hi @Santoshkc,
Thanks for your prompt reply; it was helpful. Do you know if Microsoft is working to develop embedding methods for other file types? (audio, video, CAD, 3D models, etc.)
-
santoshkc 15,325 Reputation points Microsoft External Staff Moderator
2023-09-22T11:56:08.7+00:00 Hi @Will ,
Thank you for responding.
Microsoft is constantly working to improve its Azure services and add new features to meet the evolving needs of its customers. While I don't have any specific information about embedding methods for file types other than text and images, Microsoft is always exploring new ways to enhance its services. I recommend keeping an eye on the Azure updates and announcements page for any news related to this topic. Additionally, you can submit a feature request to Microsoft Azure's feedback forum to suggest new features or improvements to existing services.
-
Sign in to comment
Sign in to answer