Azure AI Search
An Azure search service with built-in artificial intelligence capabilities that enrich information to help identify and explore relevant content at scale.
1,339 questions
Integrating Search Functionality with OpenAI Models on Azure AI Platform
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(217.60000000000002, 20%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EIA%3C/text%3E%3C/svg%3E)
Isuan Agarwal
0
Reputation points
What are the steps to implement a search feature similar to ChatGPT that uses an internet search function to gather data and inform the responses based on the model's knowledge?
Azure AI Search
{count} votes
-
Prashanth Veeragoni 4,930 Reputation points Microsoft External Staff Moderator2025-05-09T08:56:36.9966667+00:00 Hi Isuan Agarwal,
Integrating a search functionality with Azure OpenAI models to mimic how ChatGPT Browsing works involves building a Retrieval-Augmented Generation (RAG) pipeline. This process allows your AI to fetch fresh information from the web or internal data and generate informed responses. Here’s a step-by-step implementation guide tailored to Azure:
Step-by-Step Implementation:
Step1: Set Up Azure OpenAI
· Create an Azure OpenAI resource from Azure Portal.
· Deploy a model like gpt-4, gpt-35-turbo, etc.
· Get endpoint and API key for calling the model.
Step2: Set Up the Search Functionality
Option A: Web Search (Live Internet Data)
· Use Bing Search API (via Azure Cognitive Services).
o Get your subscription key and endpoint.
Option B: Internal Document Search
· Use Azure AI Search or OpenSearch:
o Index your own documents (PDFs, Word, text).
o Use vector search and semantic search to find relevant content.
Step3: Create a RAG (Retrieval-Augmented Generation) Pipeline
User Query → Search Engine (Bing or Azure Search) → Fetch Results (top 3) → Combine with Prompt → Send to Azure OpenAI → Return ResponseStep4: Code the Flow (Example with Bing + Azure OpenAI in Python)
· Search with Bing API
import requests def bing_search(query, subscription_key, endpoint): headers = {"Ocp-Apim-Subscription-Key": subscription_key} params = {"q": query, "textDecorations": True, "textFormat": "HTML", "count": 3} response = requests.get(endpoint, headers=headers, params=params) return [res['snippet'] for res in response.json()['webPages']['value']]· Combine with Prompt and Call OpenAI
import openai def generate_answer(prompt, model, openai_endpoint, api_key): openai.api_base = openai_endpoint openai.api_key = api_key response = openai.ChatCompletion.create( model=model, messages=[{"role": "system", "content": "You're a helpful assistant."}, {"role": "user", "content": prompt}] ) return response['choices'][0]['message']['content']· Full Pipeline
def ask_question_with_search(query): search_results = bing_search(query, bing_key, bing_endpoint) context = "\n".join(search_results) prompt = f"Answer the following based on the web results:\n\n{context}\n\nQuestion: {query}" return generate_answer(prompt, model, openai_endpoint, openai_key)Step5: Host the Application
· Use FastAPI or Flask for API endpoints.
· Optionally deploy on Azure App Service or Azure Container Apps.
Hope this helps. Do let us know if you any further queries.
If this answers your query, do click
Accept AnswerandYesfor was this answer helpful. And, if you have any further query do let us know.Thank you!
-
Prashanth Veeragoni 4,930 Reputation points Microsoft External Staff Moderator
2025-05-12T00:57:02.31+00:00 Hi Isuan Agarwal,,
Following up to see if the above answer was helpful. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let me know.
Thank You.
-
Prashanth Veeragoni 4,930 Reputation points Microsoft External Staff Moderator
2025-05-13T01:33:44.0033333+00:00 Just checking in to see if you have got a chance to see my response to your question in resolving the issue.
If you are still facing any further issues, please don't hesitate to reach out to us. We are happy to assist you.
Looking forward to your response and appreciate your time on this.
If you feel that your quires have been resolved, please accept the answer by clicking the "Upvote" and "Accept Answer" on the post.
Thank you!
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(124.80000000000001, 57.99999999999999%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ELH%3C/text%3E%3C/svg%3E)
Lukas Heinzmann 0 Reputation points2025-05-13T07:31:37.1766667+00:00 Seems that Bing Search has been deprecated now. The recommended alternative is Grounding with Bing Search for LLMs, however, this is only available via the (deprecated) assistants/agent API.
It seems that OpenAI will discontinue the assistant/agent APIs in favor of responses API, so is it planned to support WebSearch in Azure Responses API before Bing is discontinued in August?
-
Prashanth Veeragoni 4,930 Reputation points Microsoft External Staff Moderator
2025-05-13T08:51:35.51+00:00 Hi Lukas Heinzmann,
Since both Bing Web Search and Assistants API are being deprecated, and Responses API doesn’t currently support web search:
The best solution is to implement your own web search grounding layer (via SerpAPI, Brave, etc.) and inject results into the prompt sent to Azure OpenAI.
This ensures continuity, control, and compatibility with the future Responses API model.
No official public confirmation has been made by Microsoft or OpenAI that WebSearch (like Bing grounding) will be supported in the Azure OpenAI Responses API before August 2025.
What’s Known is:
- Bing Web Search v7
· Officially being deprecated by Microsoft in August 2025 (source: Microsoft announcement).
- OpenAI Assistants API
· Deprecated in favor of the /v1/responses API.
· Grounding tools like web-search were only available here.
- Azure OpenAI Responses API
· No built-in support yet for live WebSearch grounding.
· Microsoft has not publicly committed to adding this before August.
Hope this helps.
Thank you!
-
Prashanth Veeragoni 4,930 Reputation points Microsoft External Staff Moderator
2025-05-14T08:21:19.53+00:00 Checking back to see if the above suggestion was helpful, if you have any queries do let me know.
Thank you!
-
Prashanth Veeragoni 4,930 Reputation points Microsoft External Staff Moderator
2025-05-15T07:58:37.02+00:00 Hi Lukas Heinzmann,
Did you get a chance to see my last response, if that helps do let me know.
Thank you!
Sign in to comment
1 answer
Sort by: Most helpful
-
Deleted
This answer has been deleted due to a violation of our Code of Conduct. The answer was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.
Comments have been turned off. Learn more