Azure OpenAI: Can Azure OpenAI Assistant read unlimited files uploaded via On Your Data?

Peter 25 Reputation points
2024-02-22T07:11:43.6533333+00:00

Hi,

I was using OpenAI's Assistant API to achieve knowledge retrieval from my own uploaded file, which can answer question based on those files I uploaded to Assistant. Now I want to switch the platform to Azure. I found that there are two services: Azure OpenAI Assistant and Azure On Your Data that can perform this same functionality.

However, Azure OpenAI only open to specific company users so I can not try these services myself.

The problem for me is that Assistant (and Azure OpenAI Assistant) has a limit on the maximum number of files that can be uploaded (20 files as far as I know), but there is not limit on how many files (not listed in the quota and limit section) can be uploaded to On Your Data.

So the question is: Is it possible to let Assistant to use all the files uploaded to On Your Data service, or the only way to have unlimited files (like, tens of thousands of small text files) being used by GPT model is through On Your Data service? It would be great if my Assistant can search from more than just 20 files.

Thanks!

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
4,081 questions
0 comments No comments
{count} vote

Accepted answer
  1. AshokPeddakotla-MSFT 35,971 Reputation points Moderator
    2024-02-22T11:28:28.2766667+00:00

    Peter Greetings!

    I found that there are two services: Azure OpenAI Assistant and Azure On Your Data that can perform this same functionality.> However, Azure OpenAI only open to specific company users so I can not try these services myself.

    Your understanding is correct. Access is granted based on the application form at https://aka.ms/oai/access.

    The problem for me is that Assistant (and Azure OpenAI Assistant) has a limit on the maximum number of files that can be uploaded (20 files as far as I know), but there is not limit on how many files (not listed in the quota and limit section) can be uploaded to On Your Data.

    Yes, You can upload up to 20 files, with a max file size of 512 MB to use with tools. For Azure OpenAI on own data, there's an upload limit, and there are some caveats about document structure

    So my question is: Is it possible to let Assistant to use all the files uploaded to On Your Data service, or the only way to have unlimited files (like, tens of thousands of small text files) being used by GPT model is through On Your Data service? It would be great if my Assistant can search from more than just 20 files.

    Azure OpenAI Assistant and Azure On Your Data are both great services for knowledge retrieval, but they have different use cases and limitations.

    Azure OpenAI Assistant is designed for companies that want to build conversational AI experiences for their customers. It provides pre-built conversational models that can be customized to fit specific use cases. However, as you mentioned, it is currently only available to a limited set of users.

    Azure On Your Data, on the other hand, is a more general-purpose service that allows you to build your own models using your own data. It provides more flexibility in terms of the number of files you can upload and use for training your models.

    The problem for me is that Assistant (and Azure OpenAI Assistant) has a limit on the maximum number of files that can be uploaded (20 files as far as I know), but there is not limit on how many files (not listed in the quota and limit section) can be uploaded to On Your Data.

    To answer your question, current limitations still apply. You can train your own models using Azure On Your Data and then integrate them with Azure OpenAI Assistant to provide more accurate and relevant responses to user queries.

    Do let me know if that helps or have any further queries.

    If the response helped, please do click Accept Answer and Yes for was this answer helpful.

    Doing so would help other community members with similar issue identify the solution. I highly appreciate your contribution to the community.

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.