@David Vanden Bussche, You are correct.
For the given scenario Azure Monitor's Alert Processing Rules will help you achieve the required outcome. To configure the alert processing rule, please follow the link - Configure an alert processing rule.
If you are looking for additional help related to the topic, please let us know. Else, if the answer helped, please click Accept answer so that it can help others in the community looking for help on similar topics.