Yes they can co-exist. But a user can only have one way to authenticate. You can achieve this with the Staged Rollout feature of Azure AD Connect. Your domain stays Federated, but you can pick Azure AD groups for which the member will use another method (such as PHS or PTA) without changing the UPN suffix of the user.
So you can have some users using AD FS, other using PTA. But you cannot have the same user using PTA in some cases and AD FS in other cases.