Honestly, I wouldn't worry about having the "correct" amount or "too many"
I would use this command and not focus on the servers themselves. Using "Server" as a filter is not valid in the current versions of Exchange.
Instead:
Set-AdServerSettings -ViewEntireForest $true
Get-Mailbox -Monitoring
That will show you all the mailboxes. You can count by measuring
Get-Mailbox -Monitoring | Measure
I have found that often there is more than you think simply from turn-over of databases, and/or CUs etc..
Exchange creates and uses what it needs. There may be some that arent being used, but they dont hurt anything.
You could always recreate them if you wanted, but not necessary unless you think there is a problem that needs solving.