AzureOpenAI doesn't support parameter chunking_strategy while creating vector store.

Question

OpenAI recently added a new feature to their library, which says we can customize the chunking strategy used to split and store files in vector stores using the new parameter "chunking_strategy" to be used while creating a vector store.

If I try creating a new vector store mentioning the custom chunking strategy using the OpenAI client, I am able to successfully create one.

But, if I try creating a new vector store mentioning the custom chunking strategy using the AzureOpenAI client, I get BadRequestError which says unknown parameter: chunking_strategy.

I have tried upgrading the openai python library, but that doesn't solve the issue. I request AzureOpenAI to update their module as per the changes done by openai library.

Answer 1

Hi @Daksh Kalucha,

Thank you for reaching out to Microsoft Q&A forum!

I understand that the issue you are facing while creating a vector store using the AzureOpenAI client. After analyzing your query, it seems that the AzureOpenAI client does not support the custom chunking_strategy parameter while creating a vector store. Might be the AzureOpenAI client is not updated with the latest changes made by OpenAI library.

We recommend waiting for an update from AzureOpenAI that includes support for the "chunking_strategy" parameter. However, you can keep an eye on the Azure OpenAI Service release notes for updates on What's new in Azure OpenAI Service page will be updated accordingly with more details.

I hope you understand! Thank you.