Hello,
May I know if this is the first time you remote connect to the Client PC from Server?
Ensure first that the account you are using on Server has been added to the "Remote Desktop Users" group on your Client PC.
I hope this helps. Please let me know if you require further assistance or have any questions.
Best regards