Access Denied when crawling an external web site on SharePoint 2019

Question

I created a content source using my non-sharepoint web site, then start a full crawl for the content source. After finishing, the crawl log show the following error:

“Access is denied. Verify that either the Default Content Access Account has access to this repository, or add a crawl rule to crawl this repository. If the repository being crawled is a SharePoint repository, verify that the account you are using has “Full Read” permissions on the SharePoint Web Application being crawled.”

How to fix it.

Answer 1

@Andy
This issue should be about content access account permissions, you should make sure your content access account have at least Read permission on your web site.

If your default content access account doesn't have permission on your web site, you can create a crawl rule for the web address that you use in your content source, and set a different content access account for it.

To check the default content access account, you can go to Search Administration, then find it at:

To Create a crawl rule, you can go to Crawl Rules under Crawling, then create it as the followings:

------------------

If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".

Answer 2

Hi @Andy ,
There are some solutions for your reference:

For more details, you can see here.

Thanks,
Yanli Jiang

===========================================

If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".

Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.