Issue with Copilot Studio using Custom Search node in Topic

Question

I created a topic for my copilot agent where I have a "Custom search" node, to filter the agent's knowledge to a subset of documents based on some condition. When I query the agent I get this error:

Error Message: The output returned from the connector was too large to be handled by the agent. Try reducing its size by utilizing available connector filters or by limiting the number of configured action outputs. Error Code: AsyncResponsePayloadTooLarge

I want to empasize, I am not using a connector like in this thread, I am just trying to use the built-in custom search node over documents uploaded through Copilot Studio. I tried to act according to the error message, but found no options to filter the results or limit the number of outputs for this node type.

Answer 1

The error message you are encountering, AsyncResponsePayloadTooLarge, indicates that the output returned from the custom search node exceeds the size limit that the agent can handle. To address this issue, you can try the following steps:

1. Limit the Search Scope: When configuring the custom search tool, ensure that you are using the Search only selected sources toggle to limit the search to only the most relevant knowledge sources. This can help reduce the size of the output.
2. Add Knowledge Sources: If applicable, consider adding specific knowledge sources that are more targeted to your query. This can help in narrowing down the results.
3. Use Content Moderation: Configure the content moderation level to filter out unnecessary or irrelevant information that might be inflating the output size.
4. Review Output Variables: Ensure that you are selecting a variable to store only the necessary search results, rather than all available outputs.

If these options do not resolve the issue, you may need to consider restructuring your knowledge sources or the way you are querying them to ensure that the output remains within the acceptable size limits.