Hi!
Are there any error messages for those guests who do not have access to the Team?
We recommend you try to check the following link to make sure you have turned on and configure guest access in Microsoft Teams:
https://learn.microsoft.com/en-us/microsoftteams/guest-access-checklist
https://learn.microsoft.com/en-us/microsoftteams/teams-dependencies