Today I had an unusual situation. A client's web server kept crashing due to out of memory issues. An examination showed that 3 specific Class C IPs were hammering the server with requests to:
I eventually blocked the offending IP space, but it was all coming from Baidu spider. And was apparently not paying full attention to robots.txt
Any ideas what might be going on?
Did someone submit to a Chinese search engine, some other page that randomly generates links to a specific site to force the search engine to inadvertently DOS a third party site while doing indexing? Or could this be a problem with Baidu or something else?
Anybody else had this happen?