AzureOpenAI doesn't support parameter chunking_strategy while creating vector store.

Daksh Kalucha 0 Reputation points
2024-06-18T09:38:09.53+00:00

OpenAI recently added a new feature to their library, which says we can customize the chunking strategy used to split and store files in vector stores using the new parameter "chunking_strategy" to be used while creating a vector store.

thumbnail image 1 of blog post titled  AzureOpenAI doesn't support parameter chunking_strategy while creating vector store.

If I try creating a new vector store mentioning the custom chunking strategy using the OpenAI client, I am able to successfully create one.

thumbnail image 2 of blog post titled  AzureOpenAI doesn't support parameter chunking_strategy while creating vector store.

But, if I try creating a new vector store mentioning the custom chunking strategy using the AzureOpenAI client, I get BadRequestError which says unknown parameter: chunking_strategy.

thumbnail image 3 of blog post titled  AzureOpenAI doesn't support parameter chunking_strategy while creating vector store.

thumbnail image 4 of blog post titled  AzureOpenAI doesn't support parameter chunking_strategy while creating vector store.

I have tried upgrading the openai python library, but that doesn't solve the issue. I request AzureOpenAI to update their module as per the changes done by openai library.

Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
2,607 questions
{count} votes

2 answers

Sort by: Most helpful
  1. santoshkc 6,710 Reputation points Microsoft Vendor
    2024-06-18T12:06:52.1766667+00:00

    Hi @Daksh Kalucha,

    Thank you for reaching out to Microsoft Q&A forum!

    I understand that the issue you are facing while creating a vector store using the AzureOpenAI client. After analyzing your query, it seems that the AzureOpenAI client does not support the custom chunking_strategy parameter while creating a vector store. Might be the AzureOpenAI client is not updated with the latest changes made by OpenAI library.

    We recommend waiting for an update from AzureOpenAI that includes support for the "chunking_strategy" parameter. However, you can keep an eye on the Azure OpenAI Service release notes for updates on What's new in Azure OpenAI Service page will be updated accordingly with more details.

    I hope you understand! Thank you.

    1 person found this answer helpful.
    0 comments No comments

  2. Daksh Kalucha 0 Reputation points
    2024-07-03T08:55:08.6833333+00:00

    I tried creating a vector store with mentioning custom chunking_strategy. Now, it is working. Yet, there is no official announcement for this on What's new in AzureOpenAI. User's image

    0 comments No comments