@Poovarasan Annadurai Thank you for posting your question in Microsoft Q&A, apologize for any inconvenience caused on this.
I'm glad that you were able to resolve your issue and thank you for posting your solution so that others experiencing the same thing can easily reference this! Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others ", I'll repost your solution in case you'd like to "Accept " the answer.
Issue:
setup Azure App service(windows) Auto Heal Alerts
Solution:
Unfortunately, there is not default signal to configure the alerts for auto heal directly.
To achieve your requirement, as suggested in the blog post you need to configure the custom alerts by enabling the diagnostic settings of your app service to log analytics workspace and thereby writing some KQL queries based on your requirement.
Please remember to "Accept Answer" if any answer/reply helped, so that others in the community facing similar issues can easily find the solution.