Hello @anil kumar and thanks for reaching out. Provided AWS IAM Identity Center follows requirements detailed in Use a SAML 2.0 Identity Provider (IdP) for Single Sign On, you should be able to add and use it as a SAML/WS-Fed identity providers for guest users. Take a look to the AWS documentation on how to integrate IAM Identity Center with Office 365, skip the Office 365 license assignment steps. Overall, it should be a good starting point. Once all is set you will be able to authenticate with your AWS users and assign RBAC roles to their Azure AD counterparts (The user accounts created in the Part B: IAM Identity Center Directory chapter. from the aforementioned AWS documentation.).
Let us know if you need additional assistance. If the answer was helpful, please accept it and complete the quality survey so that others can find a solution.