Graph API Insufficient privileges to complete the operation.

Question

I'm currently writing a Blazor application as a re-write to an older web forms application as this is a web assembly application it will need to use delegated permission vs application permissions like on the older web forms app.

I seem to be having an issue that looks like a bug as per the permissions located here:

I have that permission granted on the app registration even add application permission after the fact to test it

When I decode the Token that I'm am given by the application the permission is there

However calling a delete or a post on this api endpoint still gives me an Insufficient Privilege error.

When done via Postman with the token:

When called inside the application:

If I log into the application with my global admin account then the delete or a post will work. Why will this not work with normal users that have the required api permission and scope on the token.