sharepoint search crawler get nothing from sharepoint local sites

Question

sharepoint search crawler get nothing from sharepoint local sites

Hardie 21

I have deployed one farm with 4 servers, two for front web , two for application and search service.
everything seems fine but the search things
1, no error neither from the administration interface nor from the service event viewer
2, it can crawl from other web sites or users(SPS3)

this is my sources

and what I set inside the local SharePoint sites are two web site(individual web application one for communication site and search center， another one is for my site)

now, as you can see, I got only two results of it ; (it blog is a WordPress site )

can anyone have any idea？

JoyZ 18,111 Reputation points

2020-08-19T06:42:35.837+00:00

Hi @Hardie-8943,

I am looking forward to your feedback if there is any update.
JoyZ 18,111 Reputation points

2020-08-24T02:58:09.313+00:00

Hi @Hardie-8943,

If you find any reply helpful to you, please remember to accept it as answer.

Thank you for your understanding.

Accepted answer

2 additional answers

Your answer

JoyZ 18,111 Reputation points

2020-08-19T06:42:35.837+00:00

Hi @Hardie-8943,

I am looking forward to your feedback if there is any update.
JoyZ 18,111 Reputation points

2020-08-24T02:58:09.313+00:00

Hi @Hardie-8943,

If you find any reply helpful to you, please remember to accept it as answer.

Thank you for your understanding.

Answer 1

Hi @Hardie-8943,

Thanks for posting in Q&A and congratulations on solving this issue .

Here I will provide a summary of this post for your information.

[sharepoint search crawler get nothing from sharepoint local sites]

Expectation:

Search crawl can't get content from sharepoint local sites content source.

Run a full crawl, no error messages, however the crawl log still shows few content.

Result:

After troubleshooting by the customer, it is because the crawler can not crawl through haproxy HA.

The final solution is to put the hosts file in both search server.

You could accept it as answer and it will do great help to those who meet the similar question in this forum.

Answer 2

JoyZ 18,111

It's necessary to run full crawl after creating or changing a content source.

Please run full crawl for the content source then compare the result.

More information for your reference:

https://learn.microsoft.com/en-us/sharepoint/search/plan-crawling-and-federation#reasons-to-do-a-full-crawl

Hardie 21 Reputation points

2020-08-14T04:08:28.57+00:00

already ran Full crawl many times and tried to recreate and configure the search service.
can't find any solution.
JoyZ 18,111 Reputation points

2020-08-14T10:53:52.447+00:00

From your screenshot, it's not related with crawl, since each crawl is successful.

Please reindex the site in the local SharePoint sites content source, then run full crawl again to check the result.

If the issue still exists, please check whether two sites have contents in it.

You could also create a new team site then add it to the content source, run full crawl to test again.
Hardie 21 Reputation points

2020-08-15T12:06:40.087+00:00

thank you
as you suggested I created a new web application, everything works fine
I compared everything, the only difference is UserPolicy,
the new web application has two search crawling account (DOMAIN\accountname, i:0#.w|domain\accontname)
and the other two web applications only got one account which is i:0#.w|cmtspace\sys.spsearch
I can add DOMAIN\accountname to it

here is the background:
the search account was created after the web application.

is that means I need to recreate web applications?
JoyZ 18,111 Reputation points

2020-08-17T08:51:52.48+00:00

Please go to search service application to check the Default content access account, and make sure the account has full read permission of two web applications.

Then run full crawl to test again.
Hardie 21 Reputation points

2020-08-24T08:33:07.073+00:00

Thank you

finally, I figured it out.
after reading lots of diagnostic logs, and recreated the application many times.
I found the key, it is because the crawler can not crawl through the haproxy HA.
so, the final solution is to put the hosts file in both search server.
I can't believe this has been frustrating me for more than 10 days

for the next step, I think I should explore more on haproxy

Answer 3

杨建宇 86 MVP

Please make sure that your AAM configuration is right~

Share via

sharepoint search crawler get nothing from sharepoint local sites

2 additional answers

Your answer