In general, you could edit caller ID policy in Microsoft Teams admin center > Voice. Modify “Replace the caller ID with” or “Replace the caller ID with this service number”. For more details, please refer to this article.
If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.