@RyanRodrigues-4545
Thank you for your post!
Unfortunately, you can't remove the Access Management toggle from AzureAD. However, since this option is only available to Global Administrators, it's recommended that you assign this role to fewer than five people in your organization. If you have more than five admins assigned to the Global Administrator role in your organization, you can refer to our roles and permissions documentation for some ways to reduce its use.
If you'd like a feature like this to be available, please feel free to leverage our User Voice forum so our engineering teams can review your feedback.
If you have any other questions, please let me know.
Thank you for your time and patience throughout this issue.
----------
Please remember to "Accept Answer" if any answer/reply helped, so that others in the community facing similar issues can easily find the solution.