Site issues and crashes - too many processes/bots/server timed out/503 error/etc

[mouse92im]

I have consumed too many hours trying to troubleshoot my site.  Looking for any help out there.  Called GoDaddy about a dozen times and each time they give me a different reason my site has been losing server connection.  They also try to claim its an SMF issue, not theirs - dogging SMF saying its not the best out there.  How do I block IPs and spam BEFORE hitting the forums and how is this an SMF issue??!   503 errors, 500 internal server error, etc.

So far, the only couple things that I can see causing this are the following:

*I cannot clear out all my system processes (consuming 2+gigs within minutes)
*According to my access logs, I'm getting thousands of bots/spiders trying to access the site.
*I cannot figure out what is causing these system processes to draw that much memory.  82mB on average per process. 2-15 per minute.


I have done the following with no results:

* added robots.txt file to root folder
* disabled my shoutbox
* disabled "viewable by guest" on the remaining couple public forums we had open to guests.  Both guest forums were "read only" to begin with.
* deleted my 2.0.6 betatest site (betatest.diecastaway.com) and database, which I think is what originally brought all these bugs/bots to my site.  My fault for not loading an "are you human" security mod. Folders/Files/dB all have been deleted.





http://www.diecastaway.com/
PHP 5.3
SMF 1.1.19


my robot.txt is set as:

User-agent: *
Disallow: /cgi-bin/
Disallow: /tmp/
Disallow: /



Thanks in advance for any help or suggestions.  I was planning to upgrade to 2.0 soon, but now I can't even get onto the site long enough without becoming frustrated with the lag and errors.

Ryan

[Kindred]

my suggestion - upgrade to 2.0.8
install the forum firewall mod

[mouse92im]

I still don't see how that will stop these spam bots from trying to access my site?  Do they ever give up? As far as I know, nothing is getting further than the main forum page.  If it is, the bots are requesting something they don't have access to or doesn't exist???



Here are a couple access logs (don't even know if this is worth sharing):


31.41.216.131 - - [17/Jun/2014:10:40:45 -0700] "GET www.diecastaway.com/~Mopher86/index.php??PHPSESSID=7r3ugsr9umr75teq4b2du7gfv5;www HTTP/1.0" 200 29644 "http://www.diecastaway.com/index.php?PHPSESSID=7r3ugsr9umr75teq4b2du7gfv5;www" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/32.0.1700.102 Safari/537.36" 0 "x-httpd-php" "/var/chroot/home/content/51/7034551/html/index.php" 1962594 7034551

37.58.100.162 - - [17/Jun/2014:10:40:46 -0700] "GET betatest.diecastaway.com/~Mopher86/DCAv2/index.php HTTP/1.1" 404 551 "-" "Mozilla/5.0 (compatible; AhrefsBot/5.0; +http://ahrefs.com/robot/)" 0 "-" "/var/chroot/home/content/51/7034551/html/DCAv2" 17396 7034551

73.54.232.148 - - [17/Jun/2014:19:13:30 -0700] "GET www.diecastaway.com/~Mopher86/index.php HTTP/1.1" 200 12142 "http://www.diecastaway.com/index.php?action=pm" "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.1; WOW64; Trident/6.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; InfoPath.3; .NET4.0C)" 0 "x-httpd-php" "/var/chroot/home/content/51/7034551/html/index.php" 109727 7034551

[Sir Osis of Liver]

Are you on a windows or linux server?

Probably just a typo, but it's robots.txt, not robot.txt.  The latter will not work, and the correct one will be ignored by spammers and malicious bots.

[mouse92im]

Yes. Typo. Sry.   robots.txt

Linux server I believe. I know it's not a windows server.  Can't find where to stop or kill these processes. Anytime I purge them, they come right back. I have my site on maintenance mode now and still has trouble reaching the server. Timing out or errors. How can I prove to godaddy that it's on their end?  Do I need some new certificate? Or add all the IPs to an htaccess page? 

Working on trying to get that firewall mod installed.

[Ninja ZX-10RR]

Well I was reading some random stuff about SMF 1.1 as I can't provide support for it (never ever used it, started with 2.0.7) but as regards htaccess stuff I can say now I know some stuff:
http://www.simplemachines.org/community/index.php?topic=523720.0
http://www.simplemachines.org/community/index.php?topic=523925.0
And also: http://www.simplemachines.org/community/index.php?topic=301568.msg3709524#msg3709524
I'm actually planning to rewrite that tips and tricks topic, I'm pretty sure that now I can do it, I studied hard on that .htaccess stuff from my first post about it.
*I'm gonna kill anyone who tries to steal me the idea xD*