How to deal with aggressive site crawler bots.

If you have a website that is being relentlessly attacked by bot farms. Try adding this line to the bottom of your site’s htaccess file. If you do not see the bot listed, then you can simply add on to this list.

BrowserMatchNoCase (libwww-perl|wget|LieBaoFast|Mb2345Browser|zh-CN|Kinza|Bytespider|Baiduspider|Sogou|Datanyze|AspiegelBot|adscanner|serpstatbot|spaziodat|undefined) bad_bot