3,254 questions with Azure OpenAI Service tags

Sort by: Updated
1 answer

Azure OpenAI - Prompt Caching does not improve latency

I tested prompt caching with Azure OpenAI using several models, including GPT-4o, GPT-4o-mini, and o1-preview. For these tests, I used a range of input sizes, from 10k to 100k tokens per request. However, repeating the same user request multiple times…

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,254 questions
asked 2024-10-24T11:36:56.78+00:00
Vitcu, Marvin 5 Reputation points
commented 2024-11-13T03:51:30.0466667+00:00
kevin tan 10 Reputation points
0 answers

Recommended pattern to reopen historic conversations in Bot Framework (NodeJS) with WebChat?

Solutions like ChatGPT, Perplexity and Copilot all offer ways for users to reopen older conversations. Last year I built a RAG-type chatbot for internal use for a company using Bot Framework v4 and webchat as the agent. I am currently using…

Azure AI Bot Service
Azure AI Bot Service
An Azure service that provides an integrated environment for bot development.
845 questions
Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,254 questions
asked 2024-11-12T14:20:47.2933333+00:00
Hessel Wellema 226 Reputation points
commented 2024-11-13T00:43:59.14+00:00
VasaviLankipalle-MSFT 17,646 Reputation points
1 answer

GPT Models in Azure OpenAI Not Responding

I have been successfully deploying and testing GPT models in Azure OpenAI, but since yesterday, they have stopped working. Even when I try to call them from the playground, none of the models seem to be responding. I would like to know what the issue…

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,254 questions
asked 2024-11-12T00:27:14.7766667+00:00
Sam 10 Reputation points
commented 2024-11-13T00:37:59.6566667+00:00
Saideep Anchuri 240 Reputation points Microsoft Vendor
2 answers

Are Azure OpenAI Service Rate Limits Shared Between Deployments?

I have two Azure OpenAI services, one called dev and the other prod, both using the GPT-4 model deployed on UKS with different versions. The prod service has a TPM of 35k and the dev service has a TPM of 10k. While testing, I encountered rate limit…

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,254 questions
asked 2024-11-05T17:28:20.1633333+00:00
Arik Levy 0 Reputation points
commented 2024-11-13T00:21:50.0966667+00:00
kothapally Snigdha 260 Reputation points Microsoft Vendor
0 answers

"start compute session" fails with no reason

hi, in AI Studio i have a prompt flow when i start compute session it eventually fails :-( after a long time it is running. in the diagnostic log i have this: 2024-11-10 19:55:38 +0 Information Try to Install session with config:…

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,254 questions
asked 2024-11-12T06:39:21.22+00:00
Eliah Ninyo 20 Reputation points
commented 2024-11-12T20:01:24.9266667+00:00
Yagel Alfasi 0 Reputation points
0 answers

Unable to Download the output file using Batch Job on Azure OpenAI UI

I am trying to download my completed batch using Azure OpenAI Batch Jobs UI. My lot is completed. When I am trying to download the output file, it keeps loading then gives me timeout error Need help downloading my output JSONL file

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,254 questions
asked 2024-11-08T09:53:26.9566667+00:00
Sanskar Shah 0 Reputation points
commented 2024-11-12T19:38:37.6666667+00:00
VasaviLankipalle-MSFT 17,646 Reputation points
1 answer One of the answers was accepted by the question author.

Scope of attached files to Azure OpenAI Assistants on message and thread level

Hi, May i ask what's the scope of attaching File ID to message / thread level, are there equavalent? The playground tooltip mentions that files attached on message level are scoped only on Message level. But the API docs does not mention anything about…

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,254 questions
asked 2024-11-12T18:38:27.5766667+00:00
Mohamed Hussein 110 Reputation points
accepted 2024-11-12T19:12:49.4133333+00:00
Mohamed Hussein 110 Reputation points
1 answer

Extracting an image from PDF using Azure OpenAI assistants GPT 4o

Hi, I was trying to fetch an image from a PDF file (attached) using the assistants playground When i used file search option, it failed. But when i used code interpreter it succeeds My question is when using assistants APIs, if used uploads a PDF file…

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,254 questions
asked 2024-11-12T18:10:43.09+00:00
Mohamed Hussein 110 Reputation points
answered 2024-11-12T19:04:32.9166667+00:00
Pavankumar Purilla 995 Reputation points Microsoft Vendor
0 answers

How long does the Founder Hub credits last?

Hello! I wanted to know when the Founders Hub credits expire and if it is possible to extend that limit. We received our credits in May, and now we are able to use them because we had severe issues with Microsoft and Azure Open AI that were impeding the…

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,254 questions
asked 2024-11-12T16:46:23.3433333+00:00
Clara Thays 0 Reputation points
commented 2024-11-12T17:58:33.7+00:00
YutongTie-MSFT 52,956 Reputation points
1 answer

Azure OpenAI Studio -> add your data: cannot select text-embedding-3-large

I have deployed the text-embedding-3-large model, and the provisioning state shows as Succeeded. In Azure Search, I can select text-embedding-3-large for vectorizing text when using the "import and vectorize data" feature. However, in Azure…

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,254 questions
asked 2024-11-12T12:41:53.6133333+00:00
answered 2024-11-12T17:41:49.9866667+00:00
Sina Salam 12,011 Reputation points
1 answer

Without logic app, how to set up automated notification to remind the OpenAI model's retirement dates

I asked a similar question two weeks ago, and the solution you provided is using python, Azure API, and Logic App, which is good. However, for some reasons, the Logic App is not available for us. We are wondering if you can recommend 1-2 different…

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,254 questions
asked 2024-11-07T20:51:16.8366667+00:00
Zhai, Jim 40 Reputation points
commented 2024-11-12T16:27:23.53+00:00
Zhai, Jim 40 Reputation points
0 answers

I get an error when deployinh chat gpt4o

Error during deployment: Deployment Error Details: InvalidTemplateDeployment: The template deployment 'openai' is not valid according to the validation procedure. The tracking id is '8b9cac20-6fe9-432e-939d-05974bda6d89'. See inner errors for…

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,254 questions
asked 2024-11-07T15:52:28.2833333+00:00
Oscar Barradas 0 Reputation points
commented 2024-11-12T15:50:54.3033333+00:00
kothapally Snigdha 260 Reputation points Microsoft Vendor
0 answers

Copilot Studio Generative AI Returns No Results

I've setup an Azure AI Search index and can use OpenAI Studio to ask it questions via the "chat playground". However, no matter whether I try to deploy it via "Deploy via Copilot Studio" or create one in Copilot Studio from scratch…

Azure AI Search
Azure AI Search
An Azure search service with built-in artificial intelligence capabilities that enrich information to help identify and explore relevant content at scale.
1,068 questions
Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,254 questions
Microsoft Copilot
Microsoft Copilot
Microsoft terminology for a universal copilot interface.
359 questions
asked 2024-11-07T22:56:37.2733333+00:00
D Brown 0 Reputation points
commented 2024-11-12T15:04:29.0966667+00:00
SriLakshmi C 590 Reputation points Microsoft Vendor
2 answers

Fine-tuning Azure OpenAI Model GPT-3.5 for Custom Query Language

I want to fine-tune a model for converting text to a custom query language and am facing the following challenges: I am considering using GPT-3.5 Turbo, but are there better alternatives? I have a limited input dataset of 50 samples for each fields…

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,254 questions
asked 2024-11-12T13:05:25.08+00:00
Dhaval Kansagra 0 Reputation points
answered 2024-11-12T15:02:07.7533333+00:00
santoshkc 9,485 Reputation points Microsoft Vendor
1 answer

{"detail":"Extra parameters ['safe_prompt'] are not allowed when extra-parameters is not set or set to be 'error'. Set extra-parameters to 'pass-through' to pass to the model."}

Hi, I have a working code, it suddenly getting following exception: httpx.HTTPStatusError: Error response 400 while fetching https://mistral-nemo-iggff.swedencentral.models.ai.azure.com/chat/completions: {"detail":"Extra parameters…

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,254 questions
asked 2024-10-30T10:36:07+00:00
Prasenjit 30 Reputation points
answered 2024-11-12T14:43:47.1433333+00:00
Michael Jaumann 5 Reputation points
0 answers

How does Azure OpenAI Studio Chat Playground handle images in tokens?

In the Azure OpenAI Chat Playground, images are being uploaded for GPT-4o to generate descriptions. According to the OpenAI Vision documentation, images are processed in either "low" or "high" resolution mode: Low resolution mode…

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,254 questions
asked 2024-11-12T12:04:24.1833333+00:00
Oechslein, Marius 0 Reputation points
commented 2024-11-12T13:48:30.4766667+00:00
AshokPeddakotla-MSFT 34,706 Reputation points
1 answer

Is there a workaround to index SharePoint site pages in Azure AI Search?

We are currently developing a chatbot using Azure Open AI, and we plan to use SharePoint as a data source. We have pages containing the data that we want the chatbot to reference. However, according to the documentation SharePoint Online indexer…

Azure AI Search
Azure AI Search
An Azure search service with built-in artificial intelligence capabilities that enrich information to help identify and explore relevant content at scale.
1,068 questions
SharePoint
SharePoint
A group of Microsoft Products and technologies used for sharing and managing content, knowledge, and applications.
10,837 questions
Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,254 questions
asked 2024-11-04T00:23:14.2066667+00:00
Irene Gunning 0 Reputation points
commented 2024-11-12T12:38:09.6766667+00:00
Irene Gunning 0 Reputation points
0 answers

How can I get the endpoint to communicate to the OpenAI service, without `APIConnectionError`?

Hello Microsoft community, I have followed step 1, 2 and 3 of the Build a custom chat app with the prompt flow SDK tutorial. ✅ Part 1: Set up resources ✅ Part 2: Add data retrieval to a chat app ❓Part 3: Evaluate and deploy a chat app I…

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,254 questions
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
2,908 questions
asked 2024-11-02T20:07:33.34+00:00
ali 0 Reputation points
commented 2024-11-12T11:49:13.3+00:00
AshokPeddakotla-MSFT 34,706 Reputation points
1 answer One of the answers was accepted by the question author.

json_schema is not available in Azure Open AI gpt-4o-mini 2024-07-18

Noticed that gpt-4o-mini 2024-07-18 can support the structured json output. But If I set the response_format to "json_schema" type, it will get below BadRequestError. Is this new feature available in Azure OpenAI models? If yes, how to solve…

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,254 questions
asked 2024-08-26T01:54:52.7733333+00:00
Li, Lillian 35 Reputation points
commented 2024-11-12T10:00:13.08+00:00
Jeroen Koning 1 Reputation point
1 answer

Deployment OpenAI with model gpt4 using ARM template

I am trying to launch an openAI resource and when it finishes launching a gpt-4 template, but I get the following error: The 'properties' field is invalid, error: 'Error converting value "gpt-4" to type…

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,254 questions
asked 2024-11-08T11:40:41.7033333+00:00
Javier Ávarez De Celis 10 Reputation points
answered 2024-11-12T09:37:58.9466667+00:00
Javier Ávarez De Celis 10 Reputation points