azurewebsites.net domain indexed in google

Question

azurewebsites.net domain indexed in google

Wenyuan Ho 20

Hi,

We hosted Wordpress website via Azure with our own custom domain. However, when we tried to google search the website, it is shown as "**.azurewebsites.net" instead as ".customdomain".

Please kindly guide / advise us on how to prevent / remove the google indexing the azurewebsites.net. When others search our company, it will only display the custom domain on google search results.

ajkuma 28,036 Reputation points Microsoft Employee Moderator

2023-12-11T15:16:23.34+00:00

@Wenyuan Ho , If the answer helped (pointed, you in the right direction) > please click Accept Answer.

Accepted answer

0 additional answers

Your answer

ajkuma 28,036 Reputation points Microsoft Employee Moderator

2023-12-11T15:16:23.34+00:00

@Wenyuan Ho , If the answer helped (pointed, you in the right direction) > please click Accept Answer.

Answer 1

ajkuma 28,036 Microsoft Employee Moderator

@Wenyuan Ho ,

Firstly, App Service support HTTPS on *.azurewebsites.net domain name and the certificate is provided and owned by Azure.

I understand the requirement of removing the default domain, but there is no way disable it. You could instead accomplish this by adding a rewrite rule (Or Redirect rule).

A rule to detect if the user has accessed the website using the Azure default domain and issue a HTTP 301 or 403.

Also, ensure that you have changed the site address from mydomain.azurewebsites.net to mydomain.com. from the WordPress settings

Just to highlight, by default, http://yourdomain.azurewebsites.net works even with custom domain added, and the site admins aware about the URL can access, but typically end users would not access this URL directly (unless explicitly shared).

Reference on other approaches outlined in the similar discussion threads:

can-we-remove-disable-http-domain-azurewebsites-ne
prevent-azure-default-domains-being-indexed-search-engines-anton-pham
How to make sure that google doesn't index you Azure subdomain? - You may try adding a robot.txt file for Google indexing the site as mentioned by Peter on SO discussion thread.

Additionally,

Azure App Service on Linux images using PHP 8.x are now bundled with NGINX instead of Apache.
NGINX Rewrite Rules for Azure App Service Linux PHP 8.x

Wenyuan Ho 20 Reputation points

2023-11-30T03:22:04.6033333+00:00
Hi ajkuma,

Thanks for your quick response.

For the link you provided "NGINX Rewrite Rules for Azure App Service Linux PHP 8.x", I can't find the following path in the server,

/etc/nginx/sites-enabled/default

Should I update the "nginx.conf" in "/etc/nginx/" instead?

On the other hand, if the redirect rules are created, does it mean when others search the website via google search engine, it's no longer displayed as "https://xxx.azurewebsites.net"?
ajkuma 28,036 Reputation points Microsoft Employee Moderator

2023-11-30T09:30:24.3666667+00:00

Thanks for the follow-up and update.

You may follow the suggestions (approach) outlined (step-step) in the below guide walks through configuring IP access restrictions on wp-admin for the WordPress on App Service offering.

How to enable IP access restrictions on wp-admin for the WordPress on App Service offering

If it works fine, you may try adding a robot.txt file for Google indexing the site as mentioned by Peter on SO discussion thread: How to make sure that google doesn't index you Azure subdomain? -

However, as mentioned above, by default, http://yourdomain.azurewebsites.net works even with custom domain added, and the site admins aware about the URL can access, but typically end users would not access this URL directly (unless explicitly shared).

Kindly let us know, I'll follow-up with you further.
Wenyuan Ho 20 Reputation points

2023-12-04T02:38:38.4133333+00:00

Hi Ajkuma,

Appreciate for the details kindly provided.

From the steps of configuring IP access restrictions, step 2 - adding a location block, we need to allow our IP, right? If the mydomain.azurewebsites.net and mydomain.com are using the same IP right now, does it mean it will affect the mydomain.com as well?
ajkuma 28,036 Reputation points Microsoft Employee Moderator

2023-12-06T12:18:20.66+00:00

Apologies for the delay! Yes, you are correct.

So for the directory ‘/etc/nginx/sites-enabled/default’, this is for our blessed PHP 8.x images. If you are leveraging blessed WordPress image, there shouldn’t be any nginx settings that would need to be modified. However, that is located at ‘/etc/nginx/conf.d/default’.

WordPress: Redirecting to wrong URL!! ( wp-config.php config options) - Stopping the Redirection (and taking control of the site).

Having mentioned above, you may employ Redirects (301) approach. Else, if you wish you may try the other approach of adding a robot.txt file for Google indexing the site as mentioned on SO discussion thread.
Wenyuan Ho 20 Reputation points

2023-12-08T03:22:06.9033333+00:00

Wordpress: Redirecting to wrong URL!!We have done the steps in the earlier stage, updated the WordPressAddress (URL) and Site Address (URL). If I've not misunderstood your explanation, I assume there is no longer need for IP Access Restriction since both domains (xxx.azurewebsites.net and xxx.com) are using same IP address.

What I have tried is to update the 301 redirect in the conf.d file In fact, the website is down (unable access) when I included the redirection and IP Access Restriction. So I've reverted it back already.

According to this link, I included
server_name xxx.azurewebsites.net
return 301 $scheme://xxx.com$request_uri;

To clarify it further, the section above just did the redirection but for resolving the google indexing concern, I must follow the SO discussion thread. Is it correct?

Greatly appreciate for your reply
Wenyuan Ho 20 Reputation points

2023-12-08T03:26:55.65+00:00

Hi Ajkuma,

Just now I tried the solutions you suggested, the website was down and I reverted it back. Let me try it further first and update with you later. On the other hand, may I know how could I test it out whether it works after making changes? Is the result obviously or take time?

Thank you.
ajkuma 28,036 Reputation points Microsoft Employee Moderator

2023-12-08T07:31:33.8366667+00:00

Apologies for the inconvenience or any confusion. Both the URLs use the same IP. redirection and IP access Restriction was not needed. Glad to know that you have remedied the issue.

There could be propagation delays on google indexing approached shared on SO, which I have not tested.
However, as I had mentioned earlier, by default, http://yourdomain.azurewebsites.net works even with custom domain added, and the site admins aware about the URL can access, but typically end users would not access this URL directly (unless explicitly shared).
Wenyuan Ho 20 Reputation points

2023-12-15T06:51:41.5933333+00:00

Hi Ajkuma,

Thanks for your helps, just google search the website, it's no longer indexing with xxx.azurewebsites.net.

Have a great day.
ajkuma 28,036 Reputation points Microsoft Employee Moderator

2023-12-15T09:56:38.43+00:00

Wenyuan, Glad to know that the issue is resolved. Thanks for the follow-up and update.

Your feedback is much appreciated!

Share via

azurewebsites.net domain indexed in google

0 additional answers

Your answer