Hi Tejaswai,
I hope you're doing well.
Have you tried blocking the apps from the Microsoft 365 Admin Center?
You can navigate to the Office 365 Admin Center and go to Settings > Integrated Apps > Available Apps to block the app.
Additionally, if the app is in Teams, you can remove it from the Teams Admin Center.
Please let me know if you need any assistance. I'd be happy to help!