Server downtime July 2nd

Compuart · July 02, 2009, 02:05:49 PM

July 2nd, between 11 am and 2 pm EST we've experienced server problems causing simplemachines.org to be unreachable. We are still looking into what happened, but suspect a power failure might have caused this issue.

The site has been checked for errors and should be working properly. If you find something out of the ordinary, please let us know.

We apologize for the inconvenience the outage might have caused.

N3RVE · July 02, 2009, 02:06:57 PM

Thanks

-[n3rve]

Drumstick · July 02, 2009, 02:19:39 PM

Ok, thanks for the info

!

kat · July 02, 2009, 02:26:07 PM

I got a 404, a few minutes back, but all's cool, now.

skyhintack · July 02, 2009, 02:27:01 PM

I'm able to connect to the site every few refreshes or so, but the server keeps resetting my connection. I'm not sure where that issue lies, but I'll type in simplemachines.org and it will almost load the site, but then I get the error.

Thanks

GravuTrad · July 02, 2009, 02:58:44 PM

derek will surely explain us the problem soon.

mirahalo · July 02, 2009, 03:02:11 PM

everything seems fine for me except for customize page: http://custom.simplemachines.org/

it gives me a 404 error

but besides that everything is normal

ReVoKe · July 02, 2009, 03:05:23 PM

everything works fine but the search

i get this when trying to search on a topic:

An Error Has Occurred!
Unable to access the search daemon

N3RVE · July 02, 2009, 03:07:49 PM

Quote from: 130860 on July 02, 2009, 03:02:11 PM
everything seems fine for me except for customize page: http://custom.simplemachines.org/

it gives me a 404 error

but besides that everything is normal

I don't get that, it loaded normally.

-[n3rve]

Chas Large · July 02, 2009, 03:09:48 PM

I'm seeing the Search Error too. 8pm UK Time, if that helps.

metallica48423 · July 02, 2009, 03:24:37 PM

I can now verify that the cause of this was a power failure. The datacenter was undergoing a routine UPS inspection when one of the UPS systems dropped load, causing power outages within the datacenter.

Here's the current status as far as I can tell:

- Email is down (the devel server is not fully up yet)
- Search is down (db02 is not fully up yet)

So notifications and search, as of this time, will not work. We're still working on this, however, getting the site accessible was the number one priority, first and foremost

Thanks

sAce · July 02, 2009, 03:25:40 PM

all k, except mods area

metallica48423 · July 02, 2009, 03:28:39 PM

The customize site should be working properly. I have had no problems with it and have downloaded some mods to test

Kill Em All · July 02, 2009, 03:39:41 PM

I get the search error to. Maybe a possible power surge screwed some things up?

mirahalo · July 02, 2009, 03:45:06 PM

Quote from: metallica48423 on July 02, 2009, 03:28:39 PM
The customize site should be working properly. I have had no problems with it and have downloaded some mods to test

OK, first, I tried with opera and it show me a 404, then I tried with IE8 and worked fine!

this is weird.... it supposedly be the other way around...

metallica48423 · July 02, 2009, 03:50:06 PM

Quote from: Kill Em All on July 02, 2009, 03:39:41 PM
I get the search error to. Maybe a possible power surge screwed some things up?

See my post above:

- Email is down (the devel server is not fully up yet)
- Search is down (db02 is not fully up yet)

Cassiel · July 02, 2009, 04:05:29 PM

Wow, that was back up quick. Awesome job.

SteveFJ · July 02, 2009, 04:05:46 PM

Oh I know what caused this problem.

I'm with o2, and they've been down nearly all day. Leakage from them - that's what it is.

Thanks for being on the case, and for returning to normal.

metallica48423 · July 02, 2009, 04:10:35 PM

Search and email should both be functional now

program5 · July 02, 2009, 04:59:40 PM

The only thing I saw was a blank page with nothin' in it.
Since I am a paranoid person, I immediately started making scenarios

Good to see You're back.

Yigal · July 02, 2009, 05:04:20 PM

Thanks for the heads up

rapvideosguy · July 02, 2009, 07:07:22 PM

thanks man for the heads up

Arantor · July 02, 2009, 07:11:58 PM

I seem to have missed the worst of it, as it only kicked in just as I was going out for the day...

[Core] · July 02, 2009, 09:22:26 PM

Works fine for me

JBlaze · July 02, 2009, 09:31:08 PM

Very nice job all. I fell asleep shortly after it went down, so I got to see metallica48423 in action so to speak lol.

zaclondon · July 03, 2009, 06:03:12 AM

I couldn't access the server for a good few hours yesterday afternoon UK time. I tried to find an alternative download source, including finding your mirrors in a Google cached page of your download page, but since they are under simplemachines.org domain they didn't work either!

Might it be worth having truly alternative download locations so this doesn't happen again?

SteveFJ · July 03, 2009, 06:46:24 AM

Quote from: zaclondon on July 03, 2009, 06:03:12 AM
Might it be worth having truly alternative download locations so this doesn't happen again?

I think what needs to be worked out there is frequency of occurrence vs the cost.

The downtime was a very short period really, the developers were on it pretty sharpish. That's their spare time for which they don't get paid as it's all free. For that they are applauded. Running back up sites elsewhere would mean more spare time out the window. For the amount of times this sort of thing happens, it might not be worth it. The SMF support is superior to many a paid system.

Stallyon · July 03, 2009, 06:59:12 AM

I keep getting the error "Get off that damn computer and help me!" oh ... wait ... that's my wife!

Norv · July 03, 2009, 05:52:25 PM

Ah! Nice job overall!

Funnily enough my ISP had a problem around the same time (leaving me with no internet connection). Shortly after the problem seemed solved, simplemachines.org was not loading... So while thinking to a few nice words for the same ISP, I turned to play some single-player RPG instead.

SleePy · July 03, 2009, 07:53:15 PM

Quote from: zaclondon on July 03, 2009, 06:03:12 AM
I couldn't access the server for a good few hours yesterday afternoon UK time. I tried to find an alternative download source, including finding your mirrors in a Google cached page of your download page, but since they are under simplemachines.org domain they didn't work either!

Might it be worth having truly alternative download locations so this doesn't happen again?

I do have a copy of our publically usable mirrors file setup on my site. It links to our download mirrors.
http://sleepycode.com/index.php/action,getsmf.html

KirkhamsEbooks · July 05, 2009, 02:43:56 PM

July 5 2009

I'm getting this right now is there something else going on?

Connection Problems
Sorry, SMF was unable to connect to the database. This may be caused by the server being busy. Please try again later.

JBlaze · July 05, 2009, 03:00:38 PM

Quote from: KirkhamsEbooks on July 05, 2009, 02:43:56 PM
July 5 2009

I'm getting this right now is there something else going on?

Connection Problems
Sorry, SMF was unable to connect to the database. This may be caused by the server being busy. Please try again later.

If you are getting this here on simplemachines.org, then please send an email to [email protected]

If this is happening on your forum, then please open a support topic.

Joe N · July 06, 2009, 09:39:17 AM

Works Fine

Shouldn't the backup site be closed now?

Peludo_08 · July 07, 2009, 12:08:36 AM

Quote from: Drumstick on July 02, 2009, 02:19:39 PM
Ok, thanks for the info !

Yigal · July 08, 2009, 03:48:38 PM

Quote from: Joe N on July 06, 2009, 09:39:17 AM
Works Fine

Shouldn't the backup site be closed now?

There's a back up site? o.o

ethankcvds · July 08, 2009, 03:55:05 PM

Quote from: Yigal on July 08, 2009, 03:48:38 PM
Quote from: Joe N on July 06, 2009, 09:39:17 AM
Works Fine

Shouldn't the backup site be closed now?

There's a back up site? o.o

Yes there is but it's only used when the main site has problems like the SQL database server going down.

Yigal · July 08, 2009, 04:04:55 PM

Oh, where can I find this link?

JBlaze · July 08, 2009, 04:06:57 PM

Quote from: Yigal on July 08, 2009, 04:04:55 PM
Oh, where can I find this link?

IIRC, http://www.simplemachinesforum.com or something like that.

metallica48423 · July 08, 2009, 04:53:52 PM

http://www.simplemachinesforum.org

Yigal · July 08, 2009, 04:58:27 PM

Quote from: metallica48423 on July 08, 2009, 04:53:52 PM
http://www.simplemachinesforum.org

Thank you. Just a question: Will we have to sign up again once it is re-opened?

SleePy · July 08, 2009, 05:06:25 PM

Yes, that is a off site location totally independent of our server setup.

Yigal · July 09, 2009, 10:59:18 PM

In that site, there is support available for users, correct?

IchBin™ · July 09, 2009, 11:02:47 PM

Only when this site is not available.

riker · July 17, 2009, 07:40:14 AM

Was the backup site not used then ?

Arantor · July 17, 2009, 07:59:14 AM

Yes, the backup site was in use while the main site was down two weeks ago.

rune-coders · July 17, 2009, 05:45:06 PM

Sorry to hear this

riker · July 18, 2009, 05:22:25 AM

Quote from: Arantor on July 17, 2009, 07:59:14 AM
Yes, the backup site was in use while the main site was down two weeks ago.

Thank you for highlighting it was two weeks ago but my question was still valid

Arantor · July 18, 2009, 06:06:34 AM

I know - and I answered your question.

riker · July 19, 2009, 03:52:13 AM

Quote from: Arantor on July 18, 2009, 06:06:34 AM
I know - and I answered your question.

Yes making sure you added the two weeks, suttle

News:

Server downtime July 2nd

kat

riker

riker

riker