How come that good search engines can crawl my sites in a decent manner, while some search engines are just wild hogs that use ANY available byte of remaining bandwidth and take down an entire site? The guys at SEARCHME.com did a wonderful job in wasting GB of GB in bandwidth trying to do WHAT on my servers? Are they retarded or what? Searchme does not identify itself properly as a bot (at least not in the logs I have reviewed) and has not manners in how to properly crawl a website. Googlebot used 500 megs to crawl my site, while searchme used almost 12 GB of bandwidth. If they would send me hundreds of visitors a day I would not mind, but there is nothing showing up at all. How stupid are these guys at searchme.com with their searchbot?
Searchme.com is one of the worst search engines ever and I just blocked an entire class C subnet on the firewall level. Freakin’ idiots ……. I should invoice them my loss of revenue.
If you want to block them, too – use this IP Range: 208.111.154.1 – 208.111.154.254
Update (5-21-2008): I was contacted twice by Searchme.com. The first email was a response to me having submitted a message through their contact form. The second response via email to apologize. Read the full update here.
Related posts:
{ 1 trackback }
{ 0 comments… add one now }