Using vector search Q&A AI chatbots in Teams?

Question

Hi everyone,

I am tasked with creating Q&A bots that will interact with internal staff with knowledge from uploaded documents. I have access to OAI service and tested my setup in the playground, and found that using vector search with the ada embedding model yields much better results than keywords/semantic search.

I also would like to deploy the bots to Power Virtual Agents for easy integration with MS Teams, however PVA only allows deployment of non vector search based chat bots. This doesn't work for me unfortunately as the keyword/semantic search models are just performing way worse compared to vector search.

If my end goal is to have vector search enabled chat bots in Teams, is there another way using MS resources to accomplish this, either low code or not, or can it only be done through other means? And what would those be?

Answer 1

Hi Aowei Xu,

Thanks for the intresting question. I would certainly recommend you to follow the below steps to check if there are any of the below reasons are applicable.

There are ways that you can try using the LangChain library installed (you can do so via pip install langchain) in python with the chatbot been developed and connect that with the Azure OpenAI and connect it. It supports the vector search and will allow you to have the customized chatbot aswell.

Beside this, Azure also has an capability of Azure Cognitive search aka Azure Vector Search which can be integrated with the OpenAI and from there you can train the model. Azure Cognitive Search is a cloud-based search service that can be used to build sophisticated search capabilities, including vector search, into your applications. You can use this service to index and search the content of your uploaded documents. While it may require some development work, you can integrate the results into your chatbot for use in Microsoft Teams.

Please try out these steps and check if there any solution to it. Hope this answer helps you with solution! Please comment below if you need any assistance on the same. Happy to help!

Regards,

Chakravarthi Rangarajan Bhargavi

-Please kindly accept the answer and vote 'Yes' if you feel helpful to support the community, thanks a lot.