Currently, there is no specific information available in the provided context regarding how to remove the Copilot icon from the Outlook app on Android. It seems that the context primarily focuses on managing the Copilot app in Microsoft 365 and does not address mobile-specific issues or features. Therefore, I cannot provide a solution to your question based on the available information.
References: