A specific functionality or enhancement provided by Windows Copilot
Copilot experiences today are designed as cloud-based, conversational sessions that are not guaranteed to persist across sign-in changes, app restarts, or browser events. The behavior described aligns with several documented characteristics and limitations of Microsoft 365 Copilot and Copilot system design:
- Session behavior and data loss
- Copilot interactions are treated as conversations, not as durable documents. Prompts and responses are stored as Copilot activity history, but the UI session itself (the visible chat, uploads, and intermediate state) is not documented as a guaranteed, recoverable workspace.
- Microsoft 365 Copilot stores “the interaction in the user's Copilot chat history” so users can review and reuse previous prompts, and users can delete that history. There is no documented guarantee that an in-progress, unsigned-in, or partially authenticated session will survive a sign-in transition or other lifecycle events.
- Copilot is explicitly described as an orchestration layer over LLMs, Graph data, and Microsoft 365 apps, not as a file-based authoring surface with autosave semantics like Word or OneNote.
Given this design, signing in can effectively start a new authenticated context, and the product documentation does not claim that all transient UI state (including uploads and generated content not saved elsewhere) will be preserved.
- Safety, mitigations, and architectural priorities
The official materials emphasize:
- Responsible AI and safety mitigations (content classifiers, metaprompting, harmful-content blocking, prompt-injection protection) as core engineering priorities.
- Grounding in business data via Microsoft Graph, with strict adherence to existing permissions and role-based access controls.
- Phased release and continual evaluation, with red teaming and automated evaluations focused on harmful content, jailbreaks, ungrounded content, and similar risks.
These priorities mean that much of the engineering and evaluation effort is directed at safety, compliance, and access control rather than at long-lived conversational workspaces or autosave/recovery of chat content.
- Integration with Microsoft 365 data
- Microsoft 365 Copilot is designed to access organizational data through Microsoft Graph (emails, chats, documents) that the user is authorized to access. It does not claim to have arbitrary file-system or OneDrive-like behavior inside the chat itself.
- Copilot “only accesses data that an individual user is authorized to access” and cannot see data outside those permissions. This access model is enforced via existing Microsoft 365 controls (for example, Restricted SharePoint Search, SharePoint Advanced Management, Microsoft Purview).
- The documentation does not state that Copilot chat is a general-purpose file generator with guaranteed support for all formats (such as DXF) or that it will always produce perfectly structured, Word-ready output. Instead, it highlights that LLMs can generate ungrounded or inaccurate content and that users must review and verify outputs.
- Known limitations and ungrounded content
- Microsoft explicitly acknowledges that LLMs can generate ungrounded or incorrect content and that Copilot may include information not present in source materials.
- Users are advised to treat outputs as assistive, verify against sources, and use judgment. This applies equally to complex tasks (long documents, regulatory submissions, CAD-related content) where model limitations or token limits can require chunking or manual structuring.
- Risk management and product evolution
- Copilot and Microsoft 365 Copilot are under phased release plans and continual evaluation. Red teaming and automated evaluations are used to map, measure, and manage risks, and Microsoft states that mitigations and product behavior are updated iteratively.
- Mitigations include classifiers and system messages to reduce harmful or problematic content, and content filters that may block or alter responses.
- The documentation notes that generative models are probabilistic and can make mistakes, and that mitigations may occasionally fail.
- Data, privacy, and training
- For Microsoft 365 Copilot, prompts, responses, and data accessed through Microsoft Graph are not used to train foundation LLMs, including those used by Copilot.
- Copilot operates with protections such as blocking harmful content, detecting protected material, and blocking prompt injections.
- Image and biometric handling
- When users upload images with faces, Copilot requires explicit consent before biometric data is uploaded. Images are deleted within 30 days after the conversation ends. This illustrates that some aspects of the system are intentionally ephemeral for privacy and safety reasons.
- On UX issues, dark patterns, and compensation
- The provided documentation focuses on system behavior, safety, privacy, and architectural principles. It does not describe or endorse forced-consent patterns in registration flows, nor does it provide guidance on compensation or goodwill gestures for user-reported issues.
- It also does not specify UX guarantees around warnings before session resets, autosave of chat state, or workspace continuity across sign-in events.
- Practical implications for complex work
Within the documented design:
- Copilot chat should be treated as an assistive, conversational tool whose content needs to be exported or copied into durable storage (Word, OneDrive, local files) for any work that cannot be safely lost.
- For long or complex tasks (large documents, regulatory submissions, CAD workflows), it is necessary to account for model limitations, token limits, and the lack of guaranteed session persistence.
For changes such as mandatory warnings on sign-in, autosave/recovery of chat sessions, persistent workspaces, expanded file-format support, or UX changes to consent flows, the appropriate path is to submit product feedback through official Microsoft channels so it can be considered within the ongoing “phased release and continual evaluation” process described in the transparency and architecture documentation.
References: