@julien deroche,Thanks for posting in Q&A.
From your description, I know you want to know whether to test SSO on Android Managed Hoem Screen app because you have already configured SSO on Windows website.
For your problem, I have done some research, it showed that you need to configure your apps to use MSAL and shared device mode to participate in SSO. And we suggest that you do a test using a few users or devices first.
https://learn.microsoft.com/en-us/entra/identity-platform/msal-android-single-sign-on
Cause I am not familiar with SSO, and if you want to know more about SSO, it is suggested that you open an online case to get more help.
https://learn.microsoft.com/en-us/mem/get-support
Thanks for your kind understanding.
If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.