It seems no direct way to exclude Polycom phone.
I checked the device platforms in AAD conditional access policy.
Polycom device is not in the scope.
It recommends you contact Polycom support engineer about whether Polycom phone could avoid MFA.
If the response is helpful, please click "Accept Answer" and upvote it.
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.