If you are deleting and re-creating resources frequently, you should be using ARM templates --> https://learn.microsoft.com/azure/templates/
You can include alerts as part of your template definition.
This way when the app is being created by executing the corresponding template, you would also be creating all the necessary alerts.