Ability to make mock API calls to Azure OpenAI services?

Question

Ability to make mock API calls to Azure OpenAI services?

Ian Arawjo 5

Hi there, I am a developer of a tool to help people query LLMs. I'm trying to debug API calls to Azure OpenAI for our users, but it’s impossible to test and verify the code without actually being able to complete an API request. Is it possible to have a mock API call/request, or a mock endpoint? Or is there equivalent code that you could provide which simulates an Azure OpenAI API call?

I want to support Azure OpenAI services for our users, but it's hard to continue support if I can't test API calls to Azure as the developer. (And as an academic, I’m not enterprise, so according to the policy I can’t get access, even if I submit a request.)

Any help would be appreciated.

Konstantinos Passadis 19,586 Reputation points MVP

2023-07-04T17:38:18.0466667+00:00

Hello @Ian Arawjo !

Do you have any feedback or is your question answered?

In case any answer helped kindly mark it as Accepted and upvote so others can benefit as well!

Regards
AshokPeddakotla-MSFT 35,971 Reputation points Moderator

2023-07-18T15:32:28.8033333+00:00

Ian Arawjo Just checking if we are still connected on this discussion? Please let us know if you need further help.

If the response is helpful, please click "Accept Answer" and Click 'Yes'. So that we can close this thread.
Eric Deandrea 0 Reputation points

2023-09-25T17:56:39.4766667+00:00

Hello. I have the same concern. I would like to provide this integration within an application to my users but I can't do so unless I can write a unit/integration test which tests the connection.

In my case I am trying to use WireMock to mock the API call to the Azure OpenAI service, but I don't seem to be able to because of the requirement on https and not having a proper key/keystore.

Using WireMock should be possible because it can simply serve an http response.

1 answer

Your answer

Konstantinos Passadis 19,586 Reputation points MVP

2023-07-04T17:38:18.0466667+00:00

Hello @Ian Arawjo !

Do you have any feedback or is your question answered?

In case any answer helped kindly mark it as Accepted and upvote so others can benefit as well!

Regards
AshokPeddakotla-MSFT 35,971 Reputation points Moderator

2023-07-18T15:32:28.8033333+00:00

Ian Arawjo Just checking if we are still connected on this discussion? Please let us know if you need further help.

If the response is helpful, please click "Accept Answer" and Click 'Yes'. So that we can close this thread.
Eric Deandrea 0 Reputation points

2023-09-25T17:56:39.4766667+00:00

Hello. I have the same concern. I would like to provide this integration within an application to my users but I can't do so unless I can write a unit/integration test which tests the connection.

In my case I am trying to use WireMock to mock the API call to the Azure OpenAI service, but I don't seem to be able to because of the requirement on https and not having a proper key/keystore.

Using WireMock should be possible because it can simply serve an http response.

Answer 1

Konstantinos Passadis 19,586 MVP

Hello @Ian Arawjo !

I understand your issue to support your users

I am not aware of mock endpoints however , but you can create a Free Azure Subscription to utilize as you wish

Ths links prvide info

https://learn.microsoft.com/en-us/azure/cognitive-services/openai/tutorials/embeddings?tabs=command-line

https://learn.microsoft.com/en-us/azure/cognitive-services/openai/reference

I hope this helps!

Kindly mark the answer as Accepted and Upvote in case it helped!

Regards

Ian Arawjo 5 Reputation points

2023-07-03T21:28:56.2333333+00:00
Hi there, according to this reference I cannot access the OpenAI API in particular:

'Access granted to Azure OpenAI in the desired Azure subscription' Currently, access to this service is granted only by application. You can apply for access to Azure OpenAI by completing the form at https://aka.ms/oai/access. Open an issue on this repo to contact us if you have an issue.

The application form mentions that only enterprise users --not trial users --will be accepted. Any exceptions that can be made for this case would be appreciated.
Konstantinos Passadis 19,586 Reputation points MVP

2023-07-03T23:12:47.77+00:00
Hello @Ian Arawjo !

Yes it is true , my subscription is created via the Organization it is an MSDN , and Free Trials do not offer OpenAI , only Azure Cognitive Services

However you can access the Subscription if an Administrator provides the Endpoint and a Key for you and you can use the deployents via code or API Calls

Other solutions :

You can utilize Cognitive Services , and a lot of AI Services but not OpenAI , i do not know if this covers you

To sum it up

An Organization must provide access to you via a Subscription ( MSDN are Accepted )

An Organization could provide the Endpoint and the Key so you can use your own Code and utilize the resource

Create a Free Trial , but only Cognitive Services are available , ( Language, Speech , Vision , QnA etc) but not OpenAI

https://learn.microsoft.com/en-us/azure/cognitive-services/what-are-cognitive-services

I hope this helps!

Kindly mark the answer as Accepted and Upvote in case it helped!

Regards

Konstantinos Passadis 19,586 MVP

Hello @Ian Arawjo !

I found this https://github.com/Azure-Samples/azure-search-openai-demo/

If you read ahead you will find the section here :

Getting Started

**IMPORTANT: In order to deploy and run this example, you'll need an Azure subscription with access enabled for the Azure OpenAI service. You can request access [here](https://aka.ms/oaiapply). You can also visit [here](https://azure.microsoft.com/free/cognitive-search/) to get some free Azure credits to get you started.**

**AZURE RESOURCE COSTS by default this sample will create Azure App Service and Azure Cognitive Search resources that have a monthly cost, as well as Form Recognizer resource that has cost per document page. You can switch them to free versions of each of them if you want to avoid this cost by changing the parameters file under the infra folder (though there are some limits to consider; for example, you can have up to 1 free Cognitive Search resource per subscription, and the free Form Recognizer resource only analyzes the first 2 pages of each document.)**

Probably you can create an Azure Subscription with Cognitive Services abd be able to request OpenAI Access!!!

Worth trying!

The Link is from the Youtube Channel Microsoft Mechanics

https://youtu.be/tW2EA4aZ_YQ

I hope this helps!

Kindly mark the answer as Accepted and Upvote in case it helped!

Regards

Eric Deandrea 0 Reputation points

2023-09-25T18:20:06.19+00:00

Hello. I have the same concern. I would like to provide this integration within an application to my users but I can't do so unless I can write a unit/integration test which tests the connection.

In my case I am trying to use WireMock to mock the API call to the Azure OpenAI service, but I don't seem to be able to because of the requirement on https and not having a proper key/keystore.

Using WireMock should be possible because it can simply serve an http response.

Share via

Ability to make mock API calls to Azure OpenAI services?

1 answer

Your answer