I’ve been challenged with reducing the amount of time for our Full Crawls. Â We are crawling currently about 1.6 million docs. Our crawl rate is terrible. Â It’s anywhere from 18 to 21 hours. Â The incremental crawls however are MUCH faster.
I have a dedicated crawl server setup  – 6 Procs – 16 GB of ram. Plus I am using the Application server (same specs) as a secondary crawl server.
It’s my understanding we should be hitting a crawl rate of around 45 docs per second. We are not even close to that.
What I’ve tried so far.. Â creating a new content source – Index Reset – Full Crawl.
Turning off – Offload Task and Chimney on SQL and Crawl servers. Â Disabled A\V checks during that time.Â
Looking for suggestions….
Thanks SP-C
Add more crawl components and CPU. If needed, separate indexed databases on another SQL Server.