Chat Playground not retrieving all the information from the Azure AI Search Index

Question

Hi everyone,

I am using Azure AI Search Index to chat with my SQL Server database. I followed this tutorial: https://devblogs.microsoft.com/azure-sql/chat-with-your-data-azure-sql-database/ to set up my index and chat playground.

I am currently facing this issue: If I ask my bot to return unique values or all the values from one my rows for a specific date or any other column value, it does not return all the results from the table. When I search for the same query on my SQL Server or even on my index, one to five values are always missing. My prompt describes the table in detail and specifies to only retrieve the relevant information.

My database is also very large. Is it an issue with the large database and should I use another method for my SQL database. I am using gpt-4o as well.

Any help would be appreciated.

Answer 1

Fatima Masood , Apologies for the delayed response.

Based on my understanding of your issue, kindly check the query payloads in the browser to ensure they match exactly what is displayed in the AOAI playground.

As outlined in this doc - How to index data from Azure SQL in Azure AI Search - Use a view if you need to consolidate data from multiple tables. Large views aren't ideal for SQL indexer. A workaround is to create a new table just for ingestion into your Azure AI Search index. You'll be able to use SQL integrated change tracking, which is easier to implement than High Water Mark.

Just to isolate, if you are using chunked documents, ensure that the indexing process is correctly set up. There was a case where chunked documents were not reindexed properly when a document was deleted.

Kindly let us know how it goes I'll follow-up with you further.

---

If the answer helped (pointed you in the right direction) > please click Accept Answer.