Hello @Deshmukh, Vijit
Welcome to Microsoft Q&A Platform,
You can do it by creating a new "maintenance" slot or configuring it via application gateway, in case you use it. Please refer to the thread below:
https://stackoverflow.com/questions/48551848/azure-website-outage-maintenance-page
I hope this helps!
----------
Please don’t forget to "Accept the answer" and “up-vote” wherever the information provided helps you, this can be beneficial to other community members