Do you have the Microsoft Defender 365 (M365D) connector enabled?
AAD Identity Protection alerts are sent to M365D automatically.
There is also an AAD-IP Connector and related Microsoft Security rule. Having both enabled will lead to duplicate alerts.
I don't believe there is a similar feature to filter the M365D alerts. You might consider using an automation rule to auto-close instead.