How to show citations?

Aftab Farooqi, PhD 0 Reputation points

We are using Azure Cognitive Services, and our goal is to use RAG with PDF documents to answer technical questions. We are facing difficulties with getting citations to work as intended. When using the Azure extensions with cognitive services, we get back 5 "citations". These citations are not single sentences or even relevant paragraphs, but the entire chunk in the database. we wish to highlight only the relevant information in the document, which we have in a side pane next to the chat.

our current solution is to provide the User's chat message, the answer, and hand back the previously attached citation chunk and then request the LLM extract the most relevant sentence. This works around 70% of the time, but it seems like the LLM is unable to find the same information, from the same referenced chunk a second time around 30%.

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,419 questions
{count} votes