Based on my knowledge, if the guest user could access Teams PowerShell to run the PowerShell normally, he can also access Teams admin center with no issue. From your description, we recommend you try to use InPrivate mode to login Teams admin center to see if this issue can be reproduced.
If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.
Yes. you're right! I did a test in our environment and guest indeed have no permission to access Teams admin center.