How to increase index file size limit?

Question

Hi,

When creating an index using my own documents I saw that the maximum size of file is 16MB. Is there a way to create index from larger files? Or what is the work-around here?

Answer 1

Hi @Matej Jakubčík,

The maximum size for each document when creating an index in Azure AI Search is approximately 16 megabytes. Unfortunately, there is no way to increase this limit directly. However, a common workaround is to split larger files into smaller chunks, each under the 16 MB limit, and then index those smaller documents individually. This way, you can effectively work with larger datasets by breaking them down into manageable sizes.

Store your large files in Azure Blob Storage. Azure AI Search can index the files directly from Blob Storage, with larger sizes supported based on your service tier. For instance, the S1 tier has a file size limit of 128 MB, with higher tiers supporting larger files. More information about these limits is available in the Service limits in Azure AI Search documentation.​

Create an indexer to retrieve content from Blob Storage. This approach allows for the indexing of large files without having to manually split them.

Kindly refer to the below links for better understanding:
https://learn.microsoft.com/en-us/answers/questions/1853350/large-files-()16-mb)-in-azure-ai-search-in-azure-ai-search)
https://learn.microsoft.com/en-us/azure/search/search-indexer-overview

If the answer is helpful, please click Accept Answer and kindly upvote it so that other people who faces similar issue may get benefitted from it.

Let me know if you have any further Queries.