@kazuki sakai - Thanks for reaching out.
It could be a probable cause that Automatically Resolve alerts may be enabled like the below eg -
Alert state is different and independent of the monitor condition. Alert state is set by the user. Monitor condition is set by the system. When an alert fires, the alert's monitor condition is set to 'fired', and when the underlying condition that caused the alert to fire clears, the monitor condition is set to 'resolved'. The alert state isn't changed until the user changes it.
Learn how to change the state of your alerts and smart groups.
if that is enabled, then try to uncheck the box and issue must be resolved.
Hope this helps.
If the above response helped, please feel free to "Accept as Answer" and "Upvote" the same, so it can be beneficial to the community.