As far as I know, Using delegated permissions, the signed in user even if an admin can only access another users calendar if the user's calendar is delegated or shared with the admin user. To be able to access calendar of an other users regardless, that means having access to all user mailboxes.
You will be better off using application permissions which will allow the app to read calendar from all users. Checkout Client Credentials Flow.