As far as I know, Ms graph currently does not support access to customer mailboxes in the Self-hosted Exchange service. It currently only provides access to customer mailboxes in the Exchange Online cloud.
However, I found an interesting document about Exchange hybrid deployment, and I am not sure if it will help you.