Can we use Azure open AI service for private data usage and also for data from internet

Question

Can we use Azure open AI service for private data usage and also for data from internet

lakshmi 821

We have tried to integrate the Azure open ai service with the bot framework.

We were able to add private data in azure open ai and able to fetch answers from the data provided.

But after integrating the private data, we were not able to fetch the general data from the internet. We have changed the search options in the request as we need to include azure search credentials also. Can we use the same deployment model to fetch the answers from internet if the answer is not there in the private kb

lakshmi 821 Reputation points

2023-11-28T14:42:30.6833333+00:00

Thanks for the reply

1 answer

Your answer

lakshmi 821 Reputation points

2023-11-28T14:42:30.6833333+00:00

Thanks for the reply

Answer 1

Azar 31,450 MVP Volunteer Moderator

Hi lakshmi

If you're looking to fall back to fetching answers from the internet when the information is not available in the private knowledge base (KB), you can implement conditional logic in your integration.

You mentioned using Azure Search credentials, so you might integrate an Azure Search service to query for information on the internet.

Depending on the results from the private KB and internet search, you can conditionally determine which response to provide to the user.

Look at this sample code

# User Query
user_query = get_user_input()

# Check Private KB
private_kb_response = query_private_kb(user_query)

if private_kb_response is not None:
    # Return answer from private KB
    return private_kb_response
else:
    # Perform Internet Search using Azure Search
    internet_search_response = query_internet_search(user_query)

    if internet_search_response is not None:
        # Return answer from internet search
        return internet_search_response
    else:
        # Return a default response or inform the user that no answer was found
        return "I'm sorry, I couldn't find an answer to your question."

If you find this useful kindly accept the answer thanks much.

lakshmi 821 Reputation points

2023-11-28T14:50:04.8733333+00:00

Azar

Thank you for your reply.

OpenAI might generate a default response such as, "The requested information cannot be found in the retrieved data. Try a different question or topic" when there's no specific answer available. This response might vary depending on the query.

Can we set a predefined default message for cases where the AI doesn't produce a specific answer when there's no answer from the private data,
lakshmi 821 Reputation points

2023-11-28T14:53:27.19+00:00

Azar

Thank you for your reply.

OpenAI might generate a default response such as, "The requested information cannot be found in the retrieved data. Try a different question or topic" when there's no specific answer available.

This response might vary depending on the query.

Can we set a predefined default messages for cases where there's no answer from the private data
Azar 31,450 Reputation points MVP Volunteer Moderator

2023-11-28T15:55:39.2033333+00:00
Hi lakshmi, sorry for the delayed response

coming back to the question yes, Absolutely, you can set a predefined default message for cases where the AI doesn't produce a specific answer. In your integration with the Azure OpenAI service, you can check the response you receive from the model and, if it doesn't contain a specific answer, you can use your own default message.

Check this sample code

# User Query user_query = get_user_input() # Query Azure OpenAI for Private Data openai_response_private_data = query_openai_private_data(user_query) # Check if OpenAI provided a satisfactory answer if openai_response_private_data.is_satisfactory(): # Use the answer from Azure OpenAI return openai_response_private_data.answer else: # Use a predefined default message return "(you can put on a default text here)The requested information cannot be found. Please try a different question or topic."

Here, is_satisfactory() can be put for a condition that checks whether the response from Azure OpenAI contains a specific answer if not what message should be displayed as a default response.

If it helps kindly accept the answer thanks again.
lakshmi 821 Reputation points

2023-11-29T04:25:46.5733333+00:00

Azar

But the response might vary with query right. From Open ai response, we cant identify whether the answer is from the document or is it a no answer response.
Azar 31,450 Reputation points MVP Volunteer Moderator

2023-11-29T12:53:03.0466667+00:00

Hi lakshmi
yes, You're correct. In OpenAI's response, there is no specific indicator to distinguish between an answer obtained from the document and a "no answer" scenario. However, I think you can implement logic to handle this in your code.

When you receive a response from OpenAI, you can check the content of the answer. If it's a default message like "The requested information cannot be found in the retrieved data. Try a different question or topic," you can treat it as a "no answer" scenario. If the content is different, you can assume that it's an answer generated based on the document.

Share via

Can we use Azure open AI service for private data usage and also for data from internet

1 answer

Your answer