AzureOpenAI doesn't support parameter chunking_strategy while creating vector store.

Question

AzureOpenAI doesn't support parameter chunking_strategy while creating vector store.

Daksh Kalucha 25

OpenAI recently added a new feature to their library, which says we can customize the chunking strategy used to split and store files in vector stores using the new parameter "chunking_strategy" to be used while creating a vector store.

thumbnail image 1 of blog post titled AzureOpenAI doesn't support parameter chunking_strategy while creating vector store.

If I try creating a new vector store mentioning the custom chunking strategy using the OpenAI client, I am able to successfully create one.

thumbnail image 2 of blog post titled AzureOpenAI doesn't support parameter chunking_strategy while creating vector store.

But, if I try creating a new vector store mentioning the custom chunking strategy using the AzureOpenAI client, I get BadRequestError which says unknown parameter: chunking_strategy.

thumbnail image 3 of blog post titled AzureOpenAI doesn't support parameter chunking_strategy while creating vector store.

thumbnail image 4 of blog post titled AzureOpenAI doesn't support parameter chunking_strategy while creating vector store.

I have tried upgrading the openai python library, but that doesn't solve the issue. I request AzureOpenAI to update their module as per the changes done by openai library.

Daksh Kalucha 25 Reputation points

2024-06-18T14:05:55.54+00:00

Thank you for your reply. I saw a June update on this page, but still no updates on chunking_strategy parameter. Looks like the wait is longer.
santoshkc 15,615 Reputation points Microsoft External Staff Moderator

2024-06-19T07:35:22.88+00:00

Hi @Daksh Kalucha,

I understand your concern. As of now, there is no update on chunking_strategy and we will provide you with more information about this update in the future.

I have converted the earlier response into an answer, which might be beneficial to other community members reading this thread as solution. Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others ", so I'll convert the previous response to an answer in case you'd like to accept the answer. This will help other users who may have a similar query find the solution more easily. If you have any further questions or concerns, please don't hesitate to ask. We're always here to help.

Thank you.
santoshkc 15,615 Reputation points Microsoft External Staff Moderator

2024-06-20T08:02:01.7+00:00

Hi @Daksh Kalucha,

Did you got any chance to check my recent response?

Answer accepted by question author

santoshkc 15,615 Microsoft External Staff Moderator

Hi @Daksh Kalucha,

Thank you for reaching out to Microsoft Q&A forum!

I understand that the issue you are facing while creating a vector store using the AzureOpenAI client. After analyzing your query, it seems that the AzureOpenAI client does not support the custom chunking_strategy parameter while creating a vector store. Might be the AzureOpenAI client is not updated with the latest changes made by OpenAI library.

We recommend waiting for an update from AzureOpenAI that includes support for the "chunking_strategy" parameter. However, you can keep an eye on the Azure OpenAI Service release notes for updates on What's new in Azure OpenAI Service page will be updated accordingly with more details.

I hope you understand! Thank you.

0 comments

1 additional answer

Your answer

Daksh Kalucha 25 Reputation points

2024-06-18T14:05:55.54+00:00

Thank you for your reply. I saw a June update on this page, but still no updates on chunking_strategy parameter. Looks like the wait is longer.
santoshkc 15,615 Reputation points Microsoft External Staff Moderator

2024-06-19T07:35:22.88+00:00

Hi @Daksh Kalucha,

I understand your concern. As of now, there is no update on chunking_strategy and we will provide you with more information about this update in the future.

I have converted the earlier response into an answer, which might be beneficial to other community members reading this thread as solution. Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others ", so I'll convert the previous response to an answer in case you'd like to accept the answer. This will help other users who may have a similar query find the solution more easily. If you have any further questions or concerns, please don't hesitate to ask. We're always here to help.

Thank you.
santoshkc 15,615 Reputation points Microsoft External Staff Moderator

2024-06-20T08:02:01.7+00:00

Hi @Daksh Kalucha,

Did you got any chance to check my recent response?

Answer 1

Daksh Kalucha 25

I tried creating a vector store with mentioning custom chunking_strategy. Now, it is working. Yet, there is no official announcement for this on What's new in AzureOpenAI. User's image

0 comments