An Azure relational database service.
Yes, you will have to keep on adding IP address in allowed IP addresses section whenever your machine IP address changes.
Another option is you can provide all the IP address range like 0.0.0. to 255.255.255.255 but note that this way your server allows communications from all resources inside the Azure boundary, that may or may not be part of your subscription.
Please don't forget to Accept Answer and Up-vote if the response helped -- Vaibhav