The search struggles continue (somewhat).
Does anyone out there have any experience crawling a ColdFusion site with a mysql backend? When SharePoint crawls the site, the mysql service chokes and kills the application.
I have verified that max user/network connections are set reasonably high. I’m not familiar with mysql, but after hours of hunting through logs, I can’t find anything that points to the source of the problem. Again, online search engines haven’t been overly helpful with this one.
If you have thoughts to share, please feel free.
After some time away from the office (and this problem, among others), I came back and sorted it out. Thought I’d share my solution and close this one off.
Instead of considering the target application (ColdFusion) as the problem, I turned my sights to SharePoint.
I figured the SharePoint crawl was hammering the ColdFusion mysql database and even though I tried to open up the mysql backend to take on unlimited requests/connections, I couldn’t sort the problem out over there.
Instead, I messed around with Crawler Impact Rules on the SharePoint Search Service Application. It took some trial and error, but eventually I found settings that allowed the ColdFusion site to be crawled without sending it down in a ball of flames.
Only drawback is that the crawl is double-dang slow! Oh well, not many deltas on that ColdFusion site, I’m guessing, so I likely won’t have to do a full crawl on there very often (hopefully never again – just incrementals should do from now on).
