Hello @Sreerag Ss - Vendor , this is expected as Azure AD stores the session information in a session cookie which can last from 24 (non persistent) hours to 90 days (persistent trough the Keep me signed in option).
Please let me know if you need more help. If the answer was helpful to you, please accept it and, optionally, provide feedback so that other members in the community can benefit from it.