question

TanmoyDas-9282 avatar image
0 Votes"
TanmoyDas-9282 asked CaseyYangMSFT-4714 commented

User agent used by the crawler in SharePoint 2013

Hi,

I was wondering SP13 uses any user agent while crawling an internet site as an anonymous user.

Any idea?

Thanks

office-sharepoint-server-administration
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

CaseyYangMSFT-4714 avatar image
0 Votes"
CaseyYangMSFT-4714 answered CaseyYangMSFT-4714 commented

Hi anonymous user,

Per my research, i didn't find any Microsoft documentation about this problem. I only find this documentation: Agent for Microsoft SharePoint Server Guide for reference.
Note: Microsoft is providing this information as a convenience to you. The sites are not controlled by Microsoft. Microsoft cannot make any representations regarding the quality, safety, or suitability of any software or information found there. Please make sure that you completely understand the risk before retrieving any suggestions from the above link.


If an Answer is helpful, please click "Accept Answer" and upvote it.

Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.


· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

When I said useragent, I meant IE, chrome or edge and so on, I meant any browser

Thanks

0 Votes 0 ·

Hi anonymous user,

Per my research, it seems like you need user agent: MS Search 6.0 Robot.

For Reference: The right robots.txt settings for allowing SharePoint to crawl your site
Note: Microsoft is providing this information as a convenience to you. The sites are not controlled by Microsoft. Microsoft cannot make any representations regarding the quality, safety, or suitability of any software or information found there. Please make sure that you completely understand the risk before retrieving any suggestions from the above link.


0 Votes 0 ·