Hi Lupinlicious,
You can achieve this by configuring the firewall to only allow specific IP Addresses over your RDP port:
Login to the server using RDP.
Click on Start >> Administrative tools >> Windows Firewall with Advanced Security.
Go to Inbound Rule >> New Rule
Click on Custom and on the next page select All Programmes.
You are now at Protocol & Ports wizard.
select the Specific Port option for the Remote Port and enter the port number and click Next.
Enter the RDP port for your server. Remote Desktop Protocol (RDP) is a Microsoft proprietary protocol that enables remote connections to other computers, typically over TCP port 3389.
You will need to enter the Remote IP Address by which you want to connect your port.
Click on the Add Button and enter the IP Address and click Ok and Next.
Select Allow the connection option and click Next.
On the Profile Page, select all three options. Domain, Private and Public.
Click Next Button.
In the final step, you need to provide the Name of this Rule. (eg. Remote Desktop - IP Restriction Rule)
Click on the Finish button.
This will allow RDP only from the specified IP address. You should then be able to create a rule like the one you have already to prevent all other connections, without blocking yourself via RDP.
I hope this answers your question.
--If the reply is helpful, please Upvote and Accept as answer--