Creating vector store using Azure OpenAI

Question

Creating vector store using Azure OpenAI

AJAY RAWAT 45 Microsoft Employee

I am using Azure OpenAI assistants. I am able to create assistants and threads but not the vector stores.

Running client.beta.vector_stores.create(name="Placeholder") as per this document to create vector stores throws following error:

BadRequestError: Error code: 400 - {'error': {'code': 'API operation not supported for token authentication', 'message': 'ApiId openai-api-2024-05-01-preview OperationId create_vector_store not supported for CheckAccess.'}}

I am using from azure.identity import DefaultAzureCredential, get_bearer_token_provider for authentication instead of api-key. Even after assigning myself these 3 roles, I am facing the same issue:

Cognitive Services Contributor
Cognitive Services OpenAI Contributor
Cognitive Services User

I found a similar question but with no help.

Ask:

If this issue is related to permissions, which roles should I assign to grant proper permissions?
If not, please share the fix / documentation.
Please share Azure OpenAI team's support email / DL

Vahid Ghafarpour 23,385 Reputation points Volunteer Moderator

2024-06-18T04:59:17.1233333+00:00

Thanks for posting your question in the Microsoft Q&A forum.

As mentioned in the error message and similar question you can not use Token Authentication and you should use api-key for the Authorization.

I think it related to Open AI platform and unfortunately there is no chance to use it at this time.

https://platform.openai.com/docs/api-reference/vector-stores/create

** Please don't forget to close up the thread here by upvoting and accept it as an answer if it is helpful **
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-06-18T07:12:21.16+00:00

@AJAY RAWAT Welcome to Microsoft Q&A Forum, Thank you for posting your query here!

.

Could you please check if you encounter the same error with api-version 2024-03-01-preview ?

.

Awaiting your reply.

AJAY RAWAT 45 Microsoft Employee

With api_version="2024-03-01-preview", I get a different error:

NotFoundError: Error code: 404 - {'error': {'code': '404', 'message': 'Resource not found'}}

However, in both the cases, this portion of traceback is same:

File ~\Miniconda3\lib\site-packages\openai\_base_client.py:921, in SyncAPIClient.request(self, cast_to, options, remaining_retries, stream, stream_cls)
    912 def request(
    913     self,
    914     cast_to: Type[ResponseT],
   (...)
    919     stream_cls: type[_StreamT] | None = None,
    920 ) -> ResponseT | _StreamT:
--> 921     return self._request(
    922         cast_to=cast_to,
    923         options=options,
    924         stream=stream,
    925         stream_cls=stream_cls,
    926         remaining_retries=remaining_retries,
    927     )

File ~\Miniconda3\lib\site-packages\openai\_base_client.py:1020, in SyncAPIClient._request(self, cast_to, options, remaining_retries, stream, stream_cls)
   1017         err.response.read()
   1019     log.debug("Re-raising status error")
-> 1020     raise self._make_status_error_from_response(err.response) from None
   1022 return self._process_response(
   1023     cast_to=cast_to,
   1024     options=options,
   (...)
   1027     stream_cls=stream_cls,
   1028 )

The only difference is that 2024-03-01-preview throws: NotFoundError: Error code: 404 - {'error': {'code': '404', 'message': 'Resource not found'}}

whereas 2024-05-01-preview throws: BadRequestError: Error code: 400 - {'error': {'code': 'API operation not supported for token authentication', 'message': 'ApiId openai-api-2024-05-01-preview OperationId list_vector_stores not supported for CheckAccess.'}}

navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-06-18T10:21:11.7366667+00:00

@AJAY RAWAT Thanks for the details. I am looking into this further. I will get back to you once I have an update on this.
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-06-20T13:13:22.77+00:00

@AJAY RAWAT I have involved the product owners to look into this.

In the meantime, Could you please check if you can use the Keys (api-keys) instead of the oauth token and check if that unblocks you?
.
Since you are internal to Microsoft, I am checking internally if this issue is part of the recent Security Wave 1. I will check and keep you posted about the progress.

Accepted answer

0 additional answers

Your answer

Vahid Ghafarpour 23,385 Reputation points Volunteer Moderator

2024-06-18T04:59:17.1233333+00:00

Thanks for posting your question in the Microsoft Q&A forum.

As mentioned in the error message and similar question you can not use Token Authentication and you should use api-key for the Authorization.

I think it related to Open AI platform and unfortunately there is no chance to use it at this time.

https://platform.openai.com/docs/api-reference/vector-stores/create

** Please don't forget to close up the thread here by upvoting and accept it as an answer if it is helpful **
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-06-18T07:12:21.16+00:00

@AJAY RAWAT Welcome to Microsoft Q&A Forum, Thank you for posting your query here!

.

Could you please check if you encounter the same error with api-version 2024-03-01-preview ?

.

Awaiting your reply.
AJAY RAWAT 45 Reputation points Microsoft Employee

2024-06-18T10:09:27.19+00:00

With api_version="2024-03-01-preview", I get a different error:

NotFoundError: Error code: 404 - {'error': {'code': '404', 'message': 'Resource not found'}}

However, in both the cases, this portion of traceback is same:

File ~\Miniconda3\lib\site-packages\openai\_base_client.py:921, in SyncAPIClient.request(self, cast_to, options, remaining_retries, stream, stream_cls) 912 def request( 913 self, 914 cast_to: Type[ResponseT], (...) 919 stream_cls: type[_StreamT] | None = None, 920 ) -> ResponseT | _StreamT: --> 921 return self._request( 922 cast_to=cast_to, 923 options=options, 924 stream=stream, 925 stream_cls=stream_cls, 926 remaining_retries=remaining_retries, 927 ) File ~\Miniconda3\lib\site-packages\openai\_base_client.py:1020, in SyncAPIClient._request(self, cast_to, options, remaining_retries, stream, stream_cls) 1017 err.response.read() 1019 log.debug("Re-raising status error") -> 1020 raise self._make_status_error_from_response(err.response) from None 1022 return self._process_response( 1023 cast_to=cast_to, 1024 options=options, (...) 1027 stream_cls=stream_cls, 1028 )

The only difference is that 2024-03-01-preview throws: NotFoundError: Error code: 404 - {'error': {'code': '404', 'message': 'Resource not found'}}

whereas 2024-05-01-preview throws: BadRequestError: Error code: 400 - {'error': {'code': 'API operation not supported for token authentication', 'message': 'ApiId openai-api-2024-05-01-preview OperationId list_vector_stores not supported for CheckAccess.'}}
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-06-18T10:21:11.7366667+00:00

@AJAY RAWAT Thanks for the details. I am looking into this further. I will get back to you once I have an update on this.
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-06-20T13:13:22.77+00:00

@AJAY RAWAT I have involved the product owners to look into this.

In the meantime, Could you please check if you can use the Keys (api-keys) instead of the oauth token and check if that unblocks you?
.
Since you are internal to Microsoft, I am checking internally if this issue is part of the recent Security Wave 1. I will check and keep you posted about the progress.

Answer 1

navba-MSFT 27,540 Microsoft Employee Moderator

@AJAY RAWAT Apologies for the delay in getting to the root of this problem. I appreciate your patience on this.
.

We had a look at the backend internal logs to identify the cause of this issue.

.

The fix for this issue is now merged.

.

Update as of 9th July 2024
The fix has been deployed to all regions.

.

**

Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.

Hemnaath Renganathan 0 Reputation points

2024-09-12T13:48:06.1633333+00:00

Hello, has the fix been rolled out to the regions? We are trying to use managed identity too and this is stopping us.
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-09-13T02:41:29.8166667+00:00

@Hemnaath Renganathan Update as of 9th July 2024 The fix has been deployed to all regions.

Share via

Creating vector store using Azure OpenAI

0 additional answers

Your answer