you indeed need to manually update the IP address in your DNS records
but for more details
you can check the following article to get details on how to migrate to stv2
https://www.codit.eu/blog/migrate-apim-to-compute-stv2/
https://learn.microsoft.com/en-us/azure/api-management/migrate-stv1-to-stv2-no-vnet