@Zhenlong Li You can whitelist the range of IPs based on the list published by Azure. The list can be downloaded from here.
The compute instance and the Azure ML workspace IP range list will differ from region to region so I would advise to lookup your existing IPs that are whitelisted in this list first and confirm if the IP matches within the range that is published. The range usually does not change so frequently so frequent whitelisting will not be required but having a mechanism or automation around validating the list regularly would help your team to pro-actively whitelist the required IPs to not break your existing applications. I hope this helps.
If an answer is helpful, please click on or upvote
which might help other community members reading this thread.