How to index nested JSON arrays with Azure AI Search?
Hi all, I have a question relating to Azure AI Search and Azure OpenAI. I've pasted below a simple json data structure containing nested arrays. I am having trouble setting this up so that the nested 'interests' arrays are indexed/searchable. The name…
Ingesting documents into Search AI using upload wizard vs Document Intelligence
I have a collection of pdfs (2.5k documents, about 50 pages each) that I would like to retrieve information from. I have an Azure OpenAI resource as well as an Azure AI Search resource configured. In the Azure OpenAI Studio I can directly upload my…
Does gpt-4-1106-preview support logprobs?
I am using the openai Python package to import AzureOpenAI, and I have created a client for my gpt-4 deployment (1106-preview) with API version 2024-02-01. I am using Azure AI Search to perform RAG using the extra_body parameter, with a data source…
Intermittent Trigger Issues with Event Grid for Blob Upload and Deletion in Azure Function
I am using an Event Grid subscription to trigger an Azure Function for handling blob uploads and deletions in Azure Blob Storage. However, I'm encountering intermittent issues with the triggers not firing consistently. Setup: Storage Account (Event…
Azure AI Search on a private connection to a Azure SQL
I am currently setting up an Azure AI Search to establish a connection with Azure SQL on a private network. However, I am encountering a connection error while attempting to create a data source on Azure AI Search. I would greatly appreciate any advice…
RAG - How can I define orderby/sort in a chat completions create command with data source?
This is how I define my chat completions create when I add my own data source from an Azure Search Index. My question is simple. I would like to order the results from the search based on specific index fields. This is possible when I interact with Azure…
Automatically update Azure AI search indexes from BLOB storage for use in Azure AI studio - RAG pattern queries
Hello, I'm currently using Azure AI studio to upload PDF files to a BLOB store, create an index, and then query this data using Chat GPT 3.5 and the RAG pattern without any coding. It is working great! However, I'm trying to set up the architecture to…
Creating a Recommendation Engine
Hi all; Sorry, this is a giant question asking about everything around this. But if I'm on the right track here, and you all can help me with these questions, then I think I'll have it. Use Case I have written an app that manages events for political…
How do I read the original pdf file in the associated blob data source in a custom WebApiSkill after enabling "Allow Skillset to read file data" in the indexer
I see the following under my indexer settings: When hovering over it I see the following: True means the original file data obtained from your blob data source is preserved. This allows passing the original file to a custom skill, or to the Document…
How we can index blobs based on last modified date of blob in Azure AI search
We have around 20 million blobs in our blob container for the years 2021, 2022, 2023, and 2024. We only want to index blobs from 2023 and 2024, which will be approximately 5 million in number. Essentially, we want to include only the files from the last…
Error in Azure Cognitive Search Service when storing document page associated to each chunk extracted from PDF in a custom WebApiSkill
I have the following custom WebApiSkill: @app.route(route="CustomSplitSkill", auth_level=func.AuthLevel.FUNCTION) def CustomSplit&PageSkill(req: func.HttpRequest) -> func.HttpResponse: logging.info('Python HTTP trigger function…
How can I prevent the Azure OpenAI chat from adding unnecessary details to its responses when asking questions on my documents?
I'm using the azure openai chat playground on my documents and I'm doing test questions, I notice that when I ask a question on a document the chat answers me correctly but adds other details of the document that are not necessary to the question asked,…
Azure AI Studio Chat Ground issue with configuring Azure AI Search Index Data Source
I've set up an Azure AI search index data source in Azure AI Studio Chat Ground using the "Add your data" option. The Azure AI search index contains valid documents sourced from Blob storage and the search functionality is working fine.…
Document not deleted when Blob is removed using Indexers Automatically generated from Azure OpenAI Data Studio
I am testing an Azure OpenAI on your data solution. I have set up an Azure Open AI resource and walked through the 'Add your data' workflow with Azure Blob Storage and the backing data source, as discussed here this generates two indexers in the…
How do I enable multi language support in single column in Azure Cognitive Search?
How can I handle indexing customer information in English, Arabic, Russian, Chinese, Thai, and Japanese languages using a single analyzer in Azure Cognitive Search? What is the best analyzer which handle multiple languages? For Example: English,…
Got error " We couldn't connect your data" when connecting chat playgroup's own data source
Hi MSFT team, I was using chat playground in azure openai studio. I add the data source using files (only 2 small HTML files with less than 100kb) saved in a blob storage container. I have all the open ai and ai search resources set up correctly. But i…
Handling Search Queries in Azure AI Search
Hello, I'm working on a project where we've implemented a document processing RAG like pipeline using Azure AI Search service. Here's a brief overview of our setup: We extract text from a PDF and store it in a .txt file inside Azure Blob Storage. …
Azure OpenAi Web App return name of files in citation references
I setup an AI Search with an AI Multi Service & Azure Open AI resource and deployed the default web app template. I was able to query the gpt3-turbo model and return document names in the citations references in the free tier of AI search…
Is Azure Open AI Private Link to Azure AI Search supported in infrastructure as code
I have an Azure Open AI resource as well as an Azure AI Search resources. I have followed the guidelines in "Disable public network access" and filled out the form required to have the private endpoint provisioned. However, I am curious if…
Azure.Search.Documents vector search successful, but response is null
I am currently performing vector search according to the code guide that can be found here:…