Hello @Meagan Longoria ,
Once signed in using Office 365 credentials, the connection takes place using the token issued by Microsoft identity platform. This connection will not expire even if you change the sign-in credentials. Please refer to the screenshot below from this document.
You can configure the token lifetime and set the refresh token as well, for more information please refer to Configurable token lifetimes in Microsoft identity platform.
Currently, if the token is revoked a manual sign-in is required to regenerate the token again and we cannot use secret stored in key-vault to sign in.
Please let me know if this resolves the issue faced, if not I will be glad to continue with our discussion.