Hello @Jacey Chen , after my tests, I encountered the same problem as you, and finally I found that using AD powershell can be used as an alternative to achieve the same function. Here is the official document for your reference : https://learn.microsoft.com/en-us/powershell/module/azuread/remove-azureadgroupmember?view=azureadps-2.0
If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.