You may need to add the ip address of your new IIS SMTP relay server to the custom receive connector used for SMTP relay on your Exchange server.
Otherwise, the receive connector won't accepts messages from the new server.
Here is the Microsoft document on this topic for your reference: Allow anonymous relay on Exchange servers
If the response is helpful, please click "Accept Answer" and upvote it.
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.