Azure OpenAI - Prompt Caching does not improve latency
I tested prompt caching with Azure OpenAI using several models, including GPT-4o, GPT-4o-mini, and o1-preview. For these tests, I used a range of input sizes, from 10k to 100k tokens per request. However, repeating the same user request multiple times…
Recommended pattern to reopen historic conversations in Bot Framework (NodeJS) with WebChat?
Solutions like ChatGPT, Perplexity and Copilot all offer ways for users to reopen older conversations. Last year I built a RAG-type chatbot for internal use for a company using Bot Framework v4 and webchat as the agent. I am currently using…
GPT Models in Azure OpenAI Not Responding
I have been successfully deploying and testing GPT models in Azure OpenAI, but since yesterday, they have stopped working. Even when I try to call them from the playground, none of the models seem to be responding. I would like to know what the issue…
Are Azure OpenAI Service Rate Limits Shared Between Deployments?
I have two Azure OpenAI services, one called dev and the other prod, both using the GPT-4 model deployed on UKS with different versions. The prod service has a TPM of 35k and the dev service has a TPM of 10k. While testing, I encountered rate limit…
"start compute session" fails with no reason
hi, in AI Studio i have a prompt flow when i start compute session it eventually fails :-( after a long time it is running. in the diagnostic log i have this: 2024-11-10 19:55:38 +0 Information Try to Install session with config:…
Unable to Download the output file using Batch Job on Azure OpenAI UI
I am trying to download my completed batch using Azure OpenAI Batch Jobs UI. My lot is completed. When I am trying to download the output file, it keeps loading then gives me timeout error Need help downloading my output JSONL file
Scope of attached files to Azure OpenAI Assistants on message and thread level
Hi, May i ask what's the scope of attaching File ID to message / thread level, are there equavalent? The playground tooltip mentions that files attached on message level are scoped only on Message level. But the API docs does not mention anything about…
Extracting an image from PDF using Azure OpenAI assistants GPT 4o
Hi, I was trying to fetch an image from a PDF file (attached) using the assistants playground When i used file search option, it failed. But when i used code interpreter it succeeds My question is when using assistants APIs, if used uploads a PDF file…
How long does the Founder Hub credits last?
Hello! I wanted to know when the Founders Hub credits expire and if it is possible to extend that limit. We received our credits in May, and now we are able to use them because we had severe issues with Microsoft and Azure Open AI that were impeding the…
Azure OpenAI Studio -> add your data: cannot select text-embedding-3-large
I have deployed the text-embedding-3-large model, and the provisioning state shows as Succeeded. In Azure Search, I can select text-embedding-3-large for vectorizing text when using the "import and vectorize data" feature. However, in Azure…
Without logic app, how to set up automated notification to remind the OpenAI model's retirement dates
I asked a similar question two weeks ago, and the solution you provided is using python, Azure API, and Logic App, which is good. However, for some reasons, the Logic App is not available for us. We are wondering if you can recommend 1-2 different…
I get an error when deployinh chat gpt4o
Error during deployment: Deployment Error Details: InvalidTemplateDeployment: The template deployment 'openai' is not valid according to the validation procedure. The tracking id is '8b9cac20-6fe9-432e-939d-05974bda6d89'. See inner errors for…
Copilot Studio Generative AI Returns No Results
I've setup an Azure AI Search index and can use OpenAI Studio to ask it questions via the "chat playground". However, no matter whether I try to deploy it via "Deploy via Copilot Studio" or create one in Copilot Studio from scratch…
Fine-tuning Azure OpenAI Model GPT-3.5 for Custom Query Language
I want to fine-tune a model for converting text to a custom query language and am facing the following challenges: I am considering using GPT-3.5 Turbo, but are there better alternatives? I have a limited input dataset of 50 samples for each fields…
{"detail":"Extra parameters ['safe_prompt'] are not allowed when extra-parameters is not set or set to be 'error'. Set extra-parameters to 'pass-through' to pass to the model."}
Hi, I have a working code, it suddenly getting following exception: httpx.HTTPStatusError: Error response 400 while fetching https://mistral-nemo-iggff.swedencentral.models.ai.azure.com/chat/completions: {"detail":"Extra parameters…
How does Azure OpenAI Studio Chat Playground handle images in tokens?
In the Azure OpenAI Chat Playground, images are being uploaded for GPT-4o to generate descriptions. According to the OpenAI Vision documentation, images are processed in either "low" or "high" resolution mode: Low resolution mode…
Is there a workaround to index SharePoint site pages in Azure AI Search?
We are currently developing a chatbot using Azure Open AI, and we plan to use SharePoint as a data source. We have pages containing the data that we want the chatbot to reference. However, according to the documentation SharePoint Online indexer…
How can I get the endpoint to communicate to the OpenAI service, without `APIConnectionError`?
Hello Microsoft community, I have followed step 1, 2 and 3 of the Build a custom chat app with the prompt flow SDK tutorial. ✅ Part 1: Set up resources ✅ Part 2: Add data retrieval to a chat app ❓Part 3: Evaluate and deploy a chat app I…
json_schema is not available in Azure Open AI gpt-4o-mini 2024-07-18
Noticed that gpt-4o-mini 2024-07-18 can support the structured json output. But If I set the response_format to "json_schema" type, it will get below BadRequestError. Is this new feature available in Azure OpenAI models? If yes, how to solve…
Deployment OpenAI with model gpt4 using ARM template
I am trying to launch an openAI resource and when it finishes launching a gpt-4 template, but I get the following error: The 'properties' field is invalid, error: 'Error converting value "gpt-4" to type…