Azure AI Search Chat Extension multiple indexes with different schema

Question

Azure AI Search Chat Extension multiple indexes with different schema

Suresh Rajamani 20

Hi Team,

I am trying to build a gen AI chat bot for a web portal. Bot can help portal users to search or query against Technical Support Faq, User Manual Faq, search for some business data like recommendations.So data structures are different in each model and different source.

Can I search all models using a single AI search if not can you suggest some solution to achieve this feature.

Kindly Advise.

Thanks,

Suresh Rajamani

2 answers

Your answer

Answer 1

Thanks for posting your question in the Microsoft Q&A forum.
For sure, you can use a single Azure AI Search with a range of search capabilities, including generative AI search, workplace search, SaaS search, and website search.

I would try vector search as a complementary solution.

https://techcommunity.microsoft.com/t5/ai-azure-ai-services-blog/azure-cognitive-search-outperforming-vector-search-with-hybrid/ba-p/3929167

** Please don't forget to close up the thread here by upvoting and accept it as an answer if it is helpful **

Answer 2

brtrach-MSFT 17,741 Microsoft Employee Moderator

@Suresh Rajamani I wanted to expand upon the great answer provided by @Vahid Ghafarpour to provide you with a sample.

Yes, you can search all models using a single Azure Cognitive Search service. You can create multiple indexes, each with its own schema, and then search across all of them using a single search query.

To achieve this, you can create a search index for each of your data sources with its own schema. Then, you can use the Azure Cognitive Search REST API to issue a search query that searches across all of your indexes. You can also use the Azure Search .NET SDK to issue search queries programmatically.

Here is an example of how you can search across multiple indexes using the REST API:

POST https://[service name].search.windows.net/indexes/*/docs/search?api-version=[api-version]
Content-Type: application/json
api-key: [admin key]

{
    "search": "your search query",
    "searchFields": "field1,field2,field3",
    "queryType": "full",
    "count": true,
    "skip": 0,
    "top": 10
}

In this example, you would replace [service name] with the name of your Azure Cognitive Search service, [api-version] with the version of the REST API you are using, and [admin key] with your Azure Cognitive Search admin key. You would also replace field1, field2, and field3 with the names of the fields you want to search across.

Suresh Rajamani 20 Reputation points

2024-01-02T11:48:53.6+00:00

Hi brtrach,

Thanks for the response. But i am using Azure Chat Extension Api to search from index. Chat completion extension api is not allowing to provide * in the place of index name.

Thanks,

Suresh Rajamani

brtrach-MSFT 17,741 Microsoft Employee Moderator

@Suresh Rajamani You can use the Azure Search .NET SDK to search across multiple indexes with different schemas. Here is an example of how you can do this:

using Microsoft.Azure.Search;
using Microsoft.Azure.Search.Models;
using System.Collections.Generic;

// Create a SearchIndexClient for each index you want to search across
SearchIndexClient index1Client = new SearchIndexClient("", "", new SearchCredentials(""));
SearchIndexClient index2Client = new SearchIndexClient("", "", new SearchCredentials(""));

// Create a list of SearchIndexClient objects
List indexClients = new List();
indexClients.Add(index1Client);
indexClients.Add(index2Client);

// Create a SearchIndexClient that searches across all indexes
SearchIndexClient searchClient = new SearchIndexClient("", new SearchCredentials(""));
searchClient.Indexes = indexClients;

// Create a SearchParameters object with your search parameters
SearchParameters parameters = new SearchParameters();
parameters.SearchFields = new[] { "field1", "field2", "field3" };
parameters.QueryType = QueryType.Full;
parameters.Top = 10;

// Issue a search query against all indexes
DocumentSearchResult results = searchClient.Documents.Search("your search query", parameters);

You would replace <search service name> with the name of your Azure Cognitive Search service, <index 1 name> and <index 2 name> with the names of your indexes, and <api key> with your Azure Cognitive Search admin key. You would also replace "field1", "field2", and "field3" with the names of the fields you want to search across, and MyIndexClass with the name of your index class.

JacekTokarczyk-2135 0

That will be not working:

{
    "error": {
        "code": "InvalidName",
        "message": "Index name must only contain lowercase letters, digits or dashes, cannot start or end with dashes and is limited to 128 characters.",
        "details": [
            {
                "code": "InvalidIndexName",
                "message": "Index name must only contain lowercase letters, digits or dashes, cannot start or end with dashes and is limited to 128 characters."
            }
        ]
    }
}

Share via

Azure AI Search Chat Extension multiple indexes with different schema

2 answers

Your answer