How to validate Azure Open AI configuration triplet - endpoint, API key, and deployment name

Question

I have an Azure Open AI endpoint, API key, and deployment name, and I want to validate their configuration. The Get Deployment REST API seems to be the easiest way to validate, but it does not test the Open AI endpoint, so it is not helpful. Is there a way to validate the triplet without having elevated access to Azure resources? I need to validate this configuration to create a dedicated endpoint that checks the connection between the service and Open AI.

Answer 1

Thanks for the question, with basic permissions on Azure, you could find the deployment type using deployment GET or list.

There are several options:

• calling the deployed models directly, but here it will depend on the model type: making a call to an embedding model vs a DALL-E model vs a GPT model is not the same payload
• doing it in several steps by using the management APIs: one to check the validity of the endpoint + deployment name by calling the "Deployments - Get" API you mentioned, and checking the "Account - List keys" API to check the API key. For those 2 calls, you will need to permissions on the Azure OpenAI resource