Correct:
https://learn.microsoft.com/en-us/azure/active-directory/hybrid/reference-connect-health-faq
When you remove an agent from a server, the server is not automatically removed from the Azure AD Connect Health portal. If you manually remove an agent from a server or remove the server itself, you need to manually delete the server entry from the Azure AD Connect Health portal.