I have a blob storage with around 1500 accounting documents indexed using Cognitive Search, with OCR skills integration. Although the index seems fine, the model's query results seem inaccurate. For example, when performing the query "Tell me everything about the document where the date is 20.09.2023" in the playground, the model responds "The requested information is not found in the retrieved data." To understand why this happens mostly, I set up a log analytics workspace and found the following log when filtering for the query executed by the model: "..search=Everything about document with date 20.09.2023...". The query is just a snippet of the question, without understanding the question itself. As a result, this query doesn't lead to any useful information. This problem occurs with almost every question, and I was wondering whether there is a way to make the chat perform better queries?
The model used is GPT 3.5 Turbo 0301. Both semantic and keyword search did have a problem with formulating accurate prompts,