Copilot Studio Generative AI Returns No Results

Question

Copilot Studio Generative AI Returns No Results

D Brown 5

I've setup an Azure AI Search index and can use OpenAI Studio to ask it questions via the "chat playground". However, no matter whether I try to deploy it via "Deploy via Copilot Studio" or create one in Copilot Studio from scratch (this is of course the web version of Copilot Studio), no answers come back when questions are asked as part of the "Test Copilot" pane.I've followed all the tutorials I can find and. I've added a "File Share" graph connector as a "knowledge source". I've also added the model and index details to the "Conversational boosting" topic. Still, Copilot can't answer questions that the chat playground does.

I'm not sure what I'm missing as the "debug insights" are of little help. Is there a way to get more detailed debug traces? Or any deeper logging that shows what calls and results are being made? I've seen several other posts describing similar issues, but not real solutions.

Thanks in advance for any help.

SRILAKSHMI C 12,985 Reputation points Microsoft External Staff Moderator

2024-11-08T12:20:18.9933333+00:00
Hello D Brown,

Welcome to Microsoft Q&A! Thanks for posting the question.

As I understand that you are facing issue where Copilot Studio’s "Test Copilot" feature is not returning answers despite having an Azure AI Search index set up,

I tried to repro the scenario in my environment it worked fine for me. here are some steps for troubleshooting:

Ensure that you are accessing the Copilot has sufficient permissions on the data source. Missing permissions can prevent results from being returned.

Make sure that your data sources, such as the "File Share" graph connector, are correctly configured and accessible. Only documents in supported formats and within size limits (up to 3 MB for SharePoint sources) will be processed.

Enable debug mode in the test chat to get insights on why a response wasn't returned. This can provide clues about missing search results, permissions issues, or other configuration problems

Please refer this document for more info: Understand error codes.

Do let us know if you any further queries. Thank you!
D Brown 5 Reputation points

2024-11-08T17:58:55.02+00:00

Thanks for your response.

It would be more helpful if my exact configuration with the same data sources worked for you. Regardless, debug mode is enabled; however, the "insights" provided are unhelpful: It simply tells me to "Edit knowledge source", which I've done. In fact, I've set it up both for the overall Copilot and the specific topic.

My question is more along the lines of this: Is it possible to see more detailed debug information or logs? Having me "guess" at which permissions are creating problems is a bit like guessing what might be wrong with no actual data. And saying making sure it's "correctly configured" is also not helpful.

Your link to understanding error codes would be helpful--if I was receiving errors codes (or even any debug/log details) at all. Debug mode says it's turned on but I only see the "insight" I mentioned above--is there another location I should be checking?

I'm not the admin of the Azure resources I'm using, so having me go back and forth w/ the admins will also slow things down further, especially since I've already asked and they've checked permissions, etc.

Thank you again for your help and I apologize for any frustration in this response.
SRILAKSHMI C 12,985 Reputation points Microsoft External Staff Moderator

2024-11-12T15:04:29.0966667+00:00
Hi D Brown,

Here are a few steps and resources that might help you troubleshoot and get more detailed debug information:

Resource logs provide detailed information about operations performed by your Azure resources. Ensure that these logs are being collected and routed to a location where you can access them. You can set this up in the diagnostic settings.

The Azure activity log contains subscription-level events that track operations for each Azure resource. This can help you identify any issues related to resource creation, configuration changes, or other administrative actions.

If you still facing the issue I recommend reporting this issue to the Azure support team. They will be able to investigate the issue further and provide a more targeted solution. You can report the issue by following these steps:

Go to the Azure portal and navigate to your OpenAI Service resource.

Click on the "Support + troubleshooting" tab.

Fill out the required information, including a detailed description of the issue and any steps you have taken to troubleshoot it.

Submit the support request.

The Azure support team will review your request and provide assistance as soon as possible Azure support.

Thank you!
Marco Riezzo 20 Reputation points

2024-12-10T15:17:09.6233333+00:00

I also noticed that Azure AI Search is a Premium Connector and do you think this can cause the above mentioned issue (no gen AI answer even though the AI Search resource works as expected, including the tests inside the index)

PS: I am experiencing the same issue: I have a perfectly working index (at least in Azure) but once connected to Copilot Studio, the agent can not reply to any question about file contents
Jonathan Harrison 170 Reputation points

2024-12-11T04:24:35.6366667+00:00

Hi guy i have a quick question

. Have you put any activity's in yet? or any specific websites? also have you configured your resources in the solutions tab?

Your answer

SRILAKSHMI C 12,985 Reputation points Microsoft External Staff Moderator

2024-11-08T12:20:18.9933333+00:00

Hello D Brown,

Welcome to Microsoft Q&A! Thanks for posting the question.

As I understand that you are facing issue where Copilot Studio’s "Test Copilot" feature is not returning answers despite having an Azure AI Search index set up,

I tried to repro the scenario in my environment it worked fine for me. here are some steps for troubleshooting:

Ensure that you are accessing the Copilot has sufficient permissions on the data source. Missing permissions can prevent results from being returned.

Make sure that your data sources, such as the "File Share" graph connector, are correctly configured and accessible. Only documents in supported formats and within size limits (up to 3 MB for SharePoint sources) will be processed.

Enable debug mode in the test chat to get insights on why a response wasn't returned. This can provide clues about missing search results, permissions issues, or other configuration problems

Please refer this document for more info: Understand error codes.

Do let us know if you any further queries. Thank you!
D Brown 5 Reputation points

2024-11-08T17:58:55.02+00:00

Thanks for your response.

It would be more helpful if my exact configuration with the same data sources worked for you. Regardless, debug mode is enabled; however, the "insights" provided are unhelpful: It simply tells me to "Edit knowledge source", which I've done. In fact, I've set it up both for the overall Copilot and the specific topic.

My question is more along the lines of this: Is it possible to see more detailed debug information or logs? Having me "guess" at which permissions are creating problems is a bit like guessing what might be wrong with no actual data. And saying making sure it's "correctly configured" is also not helpful.

Your link to understanding error codes would be helpful--if I was receiving errors codes (or even any debug/log details) at all. Debug mode says it's turned on but I only see the "insight" I mentioned above--is there another location I should be checking?

I'm not the admin of the Azure resources I'm using, so having me go back and forth w/ the admins will also slow things down further, especially since I've already asked and they've checked permissions, etc.

Thank you again for your help and I apologize for any frustration in this response.
SRILAKSHMI C 12,985 Reputation points Microsoft External Staff Moderator

2024-11-12T15:04:29.0966667+00:00

Hi D Brown,

Here are a few steps and resources that might help you troubleshoot and get more detailed debug information:

Resource logs provide detailed information about operations performed by your Azure resources. Ensure that these logs are being collected and routed to a location where you can access them. You can set this up in the diagnostic settings.

The Azure activity log contains subscription-level events that track operations for each Azure resource. This can help you identify any issues related to resource creation, configuration changes, or other administrative actions.

If you still facing the issue I recommend reporting this issue to the Azure support team. They will be able to investigate the issue further and provide a more targeted solution. You can report the issue by following these steps:

Go to the Azure portal and navigate to your OpenAI Service resource.

Click on the "Support + troubleshooting" tab.

Fill out the required information, including a detailed description of the issue and any steps you have taken to troubleshoot it.

Submit the support request.

The Azure support team will review your request and provide assistance as soon as possible Azure support.

Thank you!
Marco Riezzo 20 Reputation points

2024-12-10T15:17:09.6233333+00:00

I also noticed that Azure AI Search is a Premium Connector and do you think this can cause the above mentioned issue (no gen AI answer even though the AI Search resource works as expected, including the tests inside the index)

PS: I am experiencing the same issue: I have a perfectly working index (at least in Azure) but once connected to Copilot Studio, the agent can not reply to any question about file contents
Jonathan Harrison 170 Reputation points

2024-12-11T04:24:35.6366667+00:00

Hi guy i have a quick question

. Have you put any activity's in yet? or any specific websites? also have you configured your resources in the solutions tab?

Share via

Copilot Studio Generative AI Returns No Results

Your answer