Copilot states I asked it for certain information - however I never did

Den 0 Reputation points
2026-06-15T23:48:26.0166667+00:00

When I have accessed Copilot - I copy & paste the conversation to keep my own record. The last time I accessed Copilot - I asked if it remembered anything from our previous conversation. It indicated it did and listed the main points. One of the points was not correct. I asked it for more information about this specific issue (eg. time, date, exact words I wrote). It listed several things that it maintained I wrote. I explained to Copilot that it wasn't me who wrote this request & that I wasn't even awake at that specific time on that date. Copilot stated that it was me who wrote the request. Copilot said I could forward my concern to Microsoft, it also stated that it would delete that part of the conversation.

No one else uses my computer. My suspicion is that Copilot was hallucinating.

My questions here are:

Can I forward this concern to Microsoft?

Is Microsoft interested in any way about my concern?

Is there anything else I can do to address this concern?

Should I be concerned?

thanks,

Den

Microsoft Copilot | Other
0 comments No comments

1 answer

Sort by: Most helpful
  1. AI answer

    2026-06-15T23:48:55.92+00:00

    Concerns like this can be addressed in a few concrete ways:

    1. Review and manage what Copilot “remembers”
      Copilot can personalize responses by remembering key details from past conversations (called Memory or personalization). It may summarize or restate information in ways that feel unfamiliar or incorrect. To see and correct this:
      • Ask Copilot: “What do you know about me?” to see what it currently remembers.
      • If something is wrong, ask it to forget that item, for example: “Forget that I asked about X”.
      • To delete everything from memory, select the profile icon in Copilot, then Memory > Delete all Memory.
      • If desired, turn off personalization entirely using the Copilot privacy controls so Copilot no longer remembers details from conversations.
    2. Turn off or limit personalization based on chat history
      If using Microsoft 365 Copilot with a work or school account:
      • Go to Copilot Chat and open SettingsPersonalization.
      • In Chat history, turn the toggle Off. This stops Copilot from using previous chats to personalize responses and schedules existing inferences for deletion.
    3. Delete Copilot interaction history
      If there is concern about past interactions being stored:
      • Go to https://myaccount.microsoft.comSettings & PrivacyPrivacyCopilot interaction history.
      • Use the option to clear Copilot history. This removes Copilot interaction data across Microsoft 365 apps.
    4. Control what Copilot remembers and how it uses data
      Copilot provides privacy controls to:
      • See, change, or delete what it remembers.
      • Turn off personalization so Copilot no longer keeps memories of conversations.
        These options are available when signed in with a Microsoft account or supported work/school account.
    5. Provide feedback to Microsoft
      Microsoft is interested in feedback about incorrect, confusing, or concerning behavior:
      • In the Copilot experience, use the built-in feedback mechanism (thumbs down / feedback form) on the specific response that misrepresented what was said.
      • When submitting feedback, Microsoft may collect the generated response, relevant content samples (such as chat history used to produce the answer), and diagnostic logs to understand what happened. This data is only sent when feedback is submitted.
    6. Level of concern
      Generative AI systems can produce inaccurate or misleading content (“hallucinations”), including incorrect summaries of prior conversations. Microsoft explicitly advises reviewing, editing, and verifying Copilot’s output and provides controls to delete history and disable personalization. Using these controls, plus feedback on problematic responses, is generally sufficient; there is no indication from the described behavior alone that someone else accessed the account or device.

    For confidential or sensitive topics, avoid sharing data that should not be used as described in the Microsoft Privacy Statement, and rely on the privacy controls to manage what is stored and remembered.


    References:

    AI-generated content may be incorrect. Read our transparency notes for more information.

    Was this answer helpful?

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.