Hi,
You need to go on your Network Interface, click on the panel "IP configurations", select the IP configuration that is linked to your Public IP and set the option "Public IP address" to disabled.
To clean everything you can also now delete the Public Ip resources.
James