Hello @Sambhav Sharma ,
Thank you for reaching out to Microsoft QnA forum. I would like to confirm that this might not be possible due to service dependency. Since Microsoft Teams is bundle of services and is dependent on various downstream or upstram services like SharePoint, Planner, Exchange, Stream, etc.
As a best practice, you should set common policies across related apps and services whenever possible. Having a consistent security posture provides you with the best user experience. For example, setting a common policy across Exchange Online, SharePoint Online, and Microsoft Teams reduces prompts that might arise from different policies being applied to downstream services. A great way to accomplish a common policy with applications in Microsoft 365 is to use the Office 365 app instead of targeting individual applications.
For example, Microsoft Teams can provide access to resources in SharePoint Online. So, when you access Microsoft Teams, you're also subject to any policy that might be applying to any of dependent upstream or downstream service.
For more information, please review following article: https://learn.microsoft.com/en-us/entra/identity/conditional-access/service-dependencies
I hope this helps. I hope this helps and hence would request you to please "Accept the answer" if the information helped you. This will help us and others in the community as well.