I’ve been challenged with reducing the amount of time for our Full Crawls. We are crawling currently about 1.6 million docs. Our crawl rate is terrible. It’s anywhere from 18 to 21 hours. The incremental crawls however are MUCH faster.
I have a dedicated crawl server setup – 6 Procs – 16 GB of ram. Plus I am using the Application server (same specs) as a secondary crawl server.
It’s my understanding we should be hitting a crawl rate of around 45 docs per second. We are not even close to that.
What I’ve tried so far.. creating a new content source – Index Reset – Full Crawl.
Turning off – Offload Task and Chimney on SQL and Crawl servers. Disabled A\V checks during that time.
Looking for suggestions….
Thanks SP-C
First, make sure it is working like it’s supposed to. One issue that caught me recently was the IIS Response Headers…
http://www.egroup-us.com/2013/06/sharepoint-search-issues/
How many threads (docs at a time) is your search configured to use? How many content sources do you have and what is their Full/Incremental schedule?
How many PDFs do you have and which iFilter are you using?