SharePoint 2016 Search - deleted by the gatherer

Question

Hi,

My users have noticed that some of their content is not being found when they use the search box to search for it. There is a list of information and they are doing audits and are missing items when they use the search. However, this same information can be found by filtering the list. I looked at the search crawl logs, and they are being delete by the gatherer - exact message is "Deleted by the gatherer ( This item was deleted because the crawler did not encounter it during the last full crawl. )"

In researching this.. what little I found , suggests that there could be crawls colliding. How do we find out if this is happening?

If an incremental crawl is running, will another start if the first one take too long?

And if a full crawl is running, what happens to the incremental crawls during this time? It can take 6-7 hours for a full crawl, so there are many incremental crawls.... doing what exactly?

This is another question on this: https://sharepoint.stackexchange.com/questions/76477/deleted-by-the-gatherer

The suggested fix is to reset the search index: https://learn.microsoft.com/en-us/sharepoint/search/reset-the-search-index#:~:text=When%20you%20reset%20the%20search,create%20a%20new%20search%20index.

I don't mind trying this, but would like more information about this issue.

Any ideas are welcome!!

Thanks,

Monty

Answer 1

Hi @Monty Evans ,

We cannot run multiple full crawls or multiple incremental crawls for the same content source at the same time. Only multiple continuous crawls can run at the same time. Please refer to this article: manage-continuous-crawls

So for the same content source, if an incremental crawl is running, another would not start untill the current incremental crawl completed.

And if a full crawl is running, the incremental crawls would not start. They will wait for the full crawl completed.

For this issue, you could refer to this article to troubleshoot it: troubleshoot-search-crawl-issues-best.html

---

If an Answer is helpful, please click "Accept Answer" and upvote it.
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.