Azure AI Search
An Azure search service with built-in artificial intelligence capabilities that enrich information to help identify and explore relevant content at scale.
1,066 questions
How to properly re-embed a vector database? or provide document context to AI?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(118.4, 11%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ED%3C/text%3E%3C/svg%3E)
dan
0
Reputation points
I'm trying to build as AI-assisted document editor. One component would be an AI chat that references the updated content of the editor. I've done some research and believe using a vector db is the best industry standard solution for this, but am stuck on how I would re-embed or update the vectors to reference the most recent state of the editor? Is there another method that is simpler that can achieve this same result. I essentially do not want to constantly need to provide the full document content every time I make a query and only update the changes but make sure it has full context of the document similar to ChatGPT. Thanks.
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(89.60000000000001, 78%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ED%3C/text%3E%3C/svg%3E)
dupammi 8,535 Reputation points Microsoft Vendor2024-07-29T09:17:37.7166667+00:00 Hi @dan
Thank you for your question.
To update or re-embed a vector database for your AI-assisted document editor, start by tracking changes in your document through a version control system or change log. Update vectors either incrementally by recalculating embeddings for modified sections or by re-embedding the entire document if changes are frequent. Remove outdated vectors from the database and insert the updated ones to maintain consistency with the current document state. Alternatively, use a sliding context window to manage relevance without frequent re-embedding, or store document versions and segments in a database for efficient retrieval. Combining vector embeddings with metadata storage can also be effective, using a vector database for similarity searches and a metadata store for document tracking. Ensure that your vector database is scalable and maintains alignment between document content and vector representations. Tools like Azure AI Search can manage and query vector data, while Azure OpenAI Service can integrate AI capabilities. Configure your Azure AI Search index with appropriate vector fields and profiles to ensure proper integration. By implementing these strategies, you can keep your AI chat contextually relevant and responsive to the latest document updates.
Please refer set-up-embedding-models, to see if it helps in your use case. Thank you.
-
Sign in to comment
Sign in to answer