automatically rotate azure openai api key

Question

automatically rotate azure openai api key

Rajnish Soni 60

We have our openai instances deployed on azure. We want to rotate the openai api key using python or terraform. do we have such mechanism implemented. please guide.

Ramr-msft 17,826 Reputation points

2023-11-15T12:29:26.4+00:00

@Rajnish Soni Thanks for the details, Are you using the Azure Open AI SDK?

Customer-managed keys (CMK), also known as Bring your own key (BYOK), offer greater flexibility to create, rotate, disable, and revoke access controls. You can also audit the encryption keys used to protect your data.

Here is the Document you can encrypt fine-tuned model with CMK.

We generally recommend use of MSI over API Keys. Here is the document for managed identities in open ai.
Rajnish Soni 60 Reputation points

2023-11-15T14:57:56.6166667+00:00

We are using terraform to create the openAI models. We generally use gpt-35-turbo. we are using API keys for auth.
Rajnish Soni 60 Reputation points

2023-11-16T05:08:57.08+00:00

we already have the design implemented for api key. is it possible to rotate the keys using python code or az cli.

Accepted answer

0 additional answers

Your answer

Ramr-msft 17,826 Reputation points

2023-11-15T12:29:26.4+00:00

@Rajnish Soni Thanks for the details, Are you using the Azure Open AI SDK?

Customer-managed keys (CMK), also known as Bring your own key (BYOK), offer greater flexibility to create, rotate, disable, and revoke access controls. You can also audit the encryption keys used to protect your data.

Here is the Document you can encrypt fine-tuned model with CMK.

We generally recommend use of MSI over API Keys. Here is the document for managed identities in open ai.
Rajnish Soni 60 Reputation points

2023-11-15T14:57:56.6166667+00:00

We are using terraform to create the openAI models. We generally use gpt-35-turbo. we are using API keys for auth.
Rajnish Soni 60 Reputation points

2023-11-16T05:08:57.08+00:00

we already have the design implemented for api key. is it possible to rotate the keys using python code or az cli.

Answer 1

Rajnish Soni Thanks for the details, In Azure Open AI key and Endpoint section have regenerate the keys in the case of compromise or to comply with organization’s key rotation process. Two keys are provided to allow for continued access to the service while other key is being rotated.

Here simple bit of code using the OpenAI Python SDK. In the code provide a prompt to the model and ask it to complete it for me and use one of the API keys to authenticate to it.

https://journeyofthegeek.com/2023/04/02/authentication-in-azure-openai-service/

But you can utilise AAD-based tokens as well, as AOAI is based on the Azure Cognitive-aligned platform. So, if you will generate a Bearer token in Azure AD and pass it over to the same Azure OpenAI endpoint, but using slightly different header's key "Authorization", then you would be able to retrieve the same data.

Rajnish Soni 60 Reputation points

2023-11-21T15:20:45.3633333+00:00

Hello, i have gone through the openai python document and the page but it does not says about key rotation methods or key rotation example. it explain the authentication process. If you could share the example of key rotation, that would be great.

Share via

automatically rotate azure openai api key

0 additional answers

Your answer