A cloud-based identity and access management service for securing user authentication and resource access
Hello, as you mention Azure AD Connect is intended for Hybrid scenarios. Azure AD SSO should work out of the box in browsers unless cookies are being blocked. This because Azure AD session is stored in cookies. Ensure the former is not the case.
There's no need to re-imaging a device for SSO to work.
Let us know if you need additional assistance. If the answer was helpful, please accept it and complete the quality survey so that others can find a solution.