.NET and runs on IIS with Bing Index Search

Question

.NET and runs on IIS with Bing Index Search

Siriporn Kristensen 0

Why intranet is built using .NET and runs on IIS (Internet Information Services), Bing can be detecting indexed content from my internal web server and intranet file paths might appear in Bing search. Would like to know the reason or some technic of Bing catch up data.

Saideep Anchuri 7,040 Reputation points Microsoft External Staff Moderator

2025-05-11T14:43:03.6433333+00:00

Hi Siriporn Kristensen

Intranets built using .NET and hosted on IIS (Internet Information Services) can be indexed by Bing if they are accessible over the internet. Bing uses algorithms to crawl and index web pages, which means that if your intranet content is not properly secured or restricted, it may be detected and indexed by Bing. This can happen if the content is publicly accessible or if the appropriate settings in the web server allow for indexing.

To prevent sensitive or internal content from being indexed by Bing, it is essential to implement measures such as using a robots.txt file to disallow crawling, setting proper access controls, and ensuring that sensitive paths are not exposed to the public internet.

Bingbot, the crawler used by Bing, works to minimize its impact on websites while crawling billions of URLs daily. It prioritizes relevant pages that are not indexed yet and those that have been updated, which could include intranet pages if they are accessible.

kindly refer below link: https://learn.microsoft.com/en-us/microsoft-365-apps/deploy/microsoft-search-bing

Thank You.
Saideep Anchuri 7,040 Reputation points Microsoft External Staff Moderator

2025-05-12T01:07:33.7766667+00:00

Hi Siriporn Kristensen

Bingbot, the web crawler used by Microsoft Bing, operates using an algorithm that determines what to crawl and how often, aiming to minimize its impact on websites while crawling billions of URLs daily. The crawler prioritizes relevant known pages that are not yet indexed and those that have been detected as updated. This ensures that the crawling process is efficient and does not overwhelm websites.

As for the procedure for clearing indexed search history on Microsoft Bing, the context does not provide specific details on this process. Generally, users can manage their privacy settings and data retention through their Microsoft account settings, but specific steps for clearing indexed search history were not mentioned.

Kindly refer below link: https://learn.microsoft.com/en-us/microsoft-copilot-studio/guidance/generative-ai-public-websites#frequency-of-bing-web-crawling

Thank You.

1 answer

Your answer

Saideep Anchuri 7,040 Reputation points Microsoft External Staff Moderator

2025-05-11T14:43:03.6433333+00:00

Hi Siriporn Kristensen

Intranets built using .NET and hosted on IIS (Internet Information Services) can be indexed by Bing if they are accessible over the internet. Bing uses algorithms to crawl and index web pages, which means that if your intranet content is not properly secured or restricted, it may be detected and indexed by Bing. This can happen if the content is publicly accessible or if the appropriate settings in the web server allow for indexing.

To prevent sensitive or internal content from being indexed by Bing, it is essential to implement measures such as using a robots.txt file to disallow crawling, setting proper access controls, and ensuring that sensitive paths are not exposed to the public internet.

Bingbot, the crawler used by Bing, works to minimize its impact on websites while crawling billions of URLs daily. It prioritizes relevant pages that are not indexed yet and those that have been updated, which could include intranet pages if they are accessible.

kindly refer below link: https://learn.microsoft.com/en-us/microsoft-365-apps/deploy/microsoft-search-bing

Thank You.
Saideep Anchuri 7,040 Reputation points Microsoft External Staff Moderator

2025-05-12T01:07:33.7766667+00:00

Hi Siriporn Kristensen

Bingbot, the web crawler used by Microsoft Bing, operates using an algorithm that determines what to crawl and how often, aiming to minimize its impact on websites while crawling billions of URLs daily. The crawler prioritizes relevant known pages that are not yet indexed and those that have been detected as updated. This ensures that the crawling process is efficient and does not overwhelm websites.

As for the procedure for clearing indexed search history on Microsoft Bing, the context does not provide specific details on this process. Generally, users can manage their privacy settings and data retention through their Microsoft account settings, but specific steps for clearing indexed search history were not mentioned.

Kindly refer below link: https://learn.microsoft.com/en-us/microsoft-copilot-studio/guidance/generative-ai-public-websites#frequency-of-bing-web-crawling

Thank You.

Answer 1

Hi Saideep Anchuri
Thank you for your response. Could you kindly provide further information or address additional questions related to this matter?

We would like to inquire how long Bingbot, the web crawler utilized by Microsoft Bing, has been in operation, and what measures have been implemented to minimize its impact on websites while crawling billions of URLs daily. Additionally, if available, please provide the official reference or announcement related to this information.

What is the procedure for regularly clearing the indexed search history on Microsoft Bing, or for clearing it upon request if necessary?

Share via

.NET and runs on IIS with Bing Index Search

1 answer

Your answer