Open ai in the enterprise

Question

Open ai in the enterprise

Johnson, Howard 0

Hello,

we are trying to determine the best approach for using openai in our enterprise. We will have a lot of different business and users wanting to use it and already have a ton of requests. What is the best way to set up the models? Large share models per subscription so that we get the best performance? If so how would we secure it and how can we do a charge back to the correct application/team so that the correct business/department gets charged for the models consumption?

JimmySalian-2011 42,511 Reputation points

2023-07-05T05:22:54.89+00:00

Hi Johnson,

As per Microsoft the status is Azure OpenAI Service is now generally available, but the service still currently requires registration, and Microsoft may limit access based on availability and eligibility criteria and Pricing is based on a pay-as-you-go consumption model with a price per unit for each model.

Azure OpenAI Service provides access to GPT-3, Codex, and Embeddings models. Dall·E 2 is available to invited customers.

If you have Microsoft relationship manager or Contact you can get in touch for more details, however I will suggest you fill up this form for the access - https://customervoice.microsoft.com/Pages/ResponsePage.aspx?id=v4j5cvGGr0GRqy180BHbR7en2Ais5pxKtso_Pz4b1_xUOFA5Qk1UWDRBMjg0WFhPMkIzTzhKQ1dWNyQlQCN0PWcu

More info over here - https://azure.microsoft.com/en-gb/products/cognitive-services/openai-service#resources

Hope this helps.

JS

==

Please accept as answer and do a Thumbs-up to upvote this response if you are satisfied with the community help. Your upvote will be beneficial for the community users facing similar issues.
romungi-MSFT 48,911 Reputation points Microsoft Employee Moderator

2023-07-11T08:08:42.09+00:00

@Johnson, Howard Currently, the billing is based on the resource that is created in an subscription. All models that are deployed under a resource are billed under this resource, so, you will be charged cumulatively for the usage. If you are looking to chargeback your individual departments, you can create separate resource for each department and bill them accordingly instead of using one resource and breaking down the individual model usage. Thanks!!
Johnson, Howard 0 Reputation points

2023-07-11T12:38:02.65+00:00

Thank you, the problem with that approach is that it start to reduce the performance in the subscription since you have a set amount of quota. By creating multiple models, you are actually just recreating the same identical model and. Reducing the quota count for all
romungi-MSFT 48,911 Reputation points Microsoft Employee Moderator

2023-07-12T11:53:59.7933333+00:00

@Johnson, Howard Yes, I understand your problem. Currently, I think Azure OpenAI does not provide billing for a single deployment or endpoint. We will relay this feedback internally and check if something similar is planned. Thanks!!

Your answer

JimmySalian-2011 42,511 Reputation points

2023-07-05T05:22:54.89+00:00

Hi Johnson,

As per Microsoft the status is Azure OpenAI Service is now generally available, but the service still currently requires registration, and Microsoft may limit access based on availability and eligibility criteria and Pricing is based on a pay-as-you-go consumption model with a price per unit for each model.

Azure OpenAI Service provides access to GPT-3, Codex, and Embeddings models. Dall·E 2 is available to invited customers.

If you have Microsoft relationship manager or Contact you can get in touch for more details, however I will suggest you fill up this form for the access - https://customervoice.microsoft.com/Pages/ResponsePage.aspx?id=v4j5cvGGr0GRqy180BHbR7en2Ais5pxKtso_Pz4b1_xUOFA5Qk1UWDRBMjg0WFhPMkIzTzhKQ1dWNyQlQCN0PWcu

More info over here - https://azure.microsoft.com/en-gb/products/cognitive-services/openai-service#resources

Hope this helps.

JS

==

Please accept as answer and do a Thumbs-up to upvote this response if you are satisfied with the community help. Your upvote will be beneficial for the community users facing similar issues.
romungi-MSFT 48,911 Reputation points Microsoft Employee Moderator

2023-07-11T08:08:42.09+00:00

@Johnson, Howard Currently, the billing is based on the resource that is created in an subscription. All models that are deployed under a resource are billed under this resource, so, you will be charged cumulatively for the usage. If you are looking to chargeback your individual departments, you can create separate resource for each department and bill them accordingly instead of using one resource and breaking down the individual model usage. Thanks!!
Johnson, Howard 0 Reputation points

2023-07-11T12:38:02.65+00:00

Thank you, the problem with that approach is that it start to reduce the performance in the subscription since you have a set amount of quota. By creating multiple models, you are actually just recreating the same identical model and. Reducing the quota count for all
romungi-MSFT 48,911 Reputation points Microsoft Employee Moderator

2023-07-12T11:53:59.7933333+00:00

@Johnson, Howard Yes, I understand your problem. Currently, I think Azure OpenAI does not provide billing for a single deployment or endpoint. We will relay this feedback internally and check if something similar is planned. Thanks!!

Share via

Open ai in the enterprise

Your answer