Confirmation needed - Copilot Studio custom agent - Vision of browser content via sidebar

Question

Can a Copilot Studio custom agent be invoked from Microsoft 365 Copilot Chat and receive the same Vision screen context available to the standard Copilot experience? I am seeking to use a custom agent, limited to using corporate sharepoint documentation, to respond to questions about an open browser window. I need to avoid generic responses and ensure corporate policies, contained in the sharepoint documents, are included in responses to questions.

In a 3rd party cloud application, we are seeking custom agent to respond to questions about filling out forms. For example, if user asks how to determine which account number to choose, agent would give direct answer from the reference sharepoint file. Or if user asks what is missing in form, custom agent could evalute entries and provide feedback based on sharepoint reference document.

Answer 1

Hello,

A Copilot Studio custom agent can be published to and invoked from Microsoft 365 Copilot Chat. However, current documentation does not indicate that the Edge sidebar’s browsing or page context is automatically passed to the selected custom agent.

This is a current product limitation/by-design behavior, rather than a bug.

For this scenario, consider explicitly passing the required form data to the agent through webpage context variables, a secured connector/API, or a user-provided screenshot. The agent can then use SharePoint as its grounded knowledge source. Review DLP and sensitive-data requirements before transferring form content.

A feature request can also be submitted for automatic forwarding of consented Edge page context to Copilot Studio agents.

References:

• Copilot Chat in Edge
• Extend Microsoft 365 Copilot with agents
• Pass webpage context variables to an agent
• Allow file and image input