@Djordje Novakovic Thank you for reaching out to Microsoft Q&A. Yes, you are correct. authentication-managed-identity policy can be used to authenticate backend service (i.e., Graph API in your case) and refer docs for more details including examples. This way you don't need to manage client secret.
Also, found a similar example for key vault and thought it might be helpful with your question. This example has screenshot to enable managed-identity and assigning the access policy. Feel free to add a comment if you have any other questions. We would be happy to assist you. Please 'Accept as answer' and ‘Upvote’ if it helped so that it can help others in the community.

