News:

Join the Facebook Fan Page.

Main Menu

Server maintenance

Started by LiroyvH, October 24, 2011, 04:38:09 PM

Previous topic - Next topic

LiroyvH

Dear users,


We have planned required maintenance to our server infrastructure.
This maintenance causes us to have downtime several times, both short and a bit longer in time.
(Exact timeframe cannot be predicted)
We will of course do our utmost best to keep the interruptions as short as possible.

The maintenance is scheduled to start at:
Sunday, October 30 2011.
The first maintenance session will most likely be the one causing the longest interruption.
Other dates will be released when they are planned.


For more information, please see all details about this maintenance in the Team Blog article:
http://www.simplemachines.org/community/index.php?topic=457092


To be able to receive quick updates regarding the progress and status, please:
Follow us on Twitter
Add us on Facebook

If you require urgent support when our community is down, please visit our backup forum. Make sure to bookmark it!!
http://www.simplemachinesforum.org/
Please do not open support topics there unless it is really urgent and cant wait a few hours.


Thank you :)


Regards,
- Servers Team
Simple Machines
((U + C + I)x(10 − S)) / 20xAx1 / (1 − sin(F / 10))
President/CEO of Simple Machines - Server Manager
Please do not PM for support - anything else is usually OK.

Looking

Out of curiosity what kind of hosting setup runs this community?

LiroyvH

I will not go in to full details, but we have several servers that do different jobs such as virtual machine hosts, webservers, SQL servers, file servers, mail servers, etc.
All of them combined is what powers Simple Machines.

We own all hardware.
((U + C + I)x(10 − S)) / 20xAx1 / (1 − sin(F / 10))
President/CEO of Simple Machines - Server Manager
Please do not PM for support - anything else is usually OK.

Looking

Thanks for the reply, that must be quite a setup to maintain with updates and monitoring user activity here.

It also explains the below page stats staying on par:
QuotePage created in 0.077 seconds with 25 queries.
Page served by: 10.0.100.135 (10.0.100.135)

SleePy

It isn't always easy, but both of our primary server admins are very experience professionals in this :)
Jeremy D ~ Site Team / SMF Developer ~ GitHub Profile ~ Join us on IRC @ Libera.chat/#smf ~ Support the SMF Support team!

Robert.

Thanks for the news, glad to hear simplemachinesforum.org will still be available :) Good luck folks ;D

LiroyvH

Quick note:
Welcome back!

The upgrades didnt went as smoothly as they should have gone, as you may have noticed ;)
We will post more details later.

As some of you may have noticed: the MOD site currently replies with "access denied".
We apologise for the inconvenience, but we have to make some changes before opening that up again. This should not take too long.

Hang in there! :)
Thank you for your patience!
((U + C + I)x(10 − S)) / 20xAx1 / (1 − sin(F / 10))
President/CEO of Simple Machines - Server Manager
Please do not PM for support - anything else is usually OK.

Antes

Thanks for info.

I can access the mod site now.

LiroyvH

You mean customize?
You shouldnt be able to access the mods section :P
((U + C + I)x(10 − S)) / 20xAx1 / (1 − sin(F / 10))
President/CEO of Simple Machines - Server Manager
Please do not PM for support - anything else is usually OK.

Illori

Quote from: Antes on October 31, 2011, 02:21:48 PM
I can access the mod site now.

http://custom.simplemachines.org/mods/

no you cant
QuoteOops, what happened?
Sorry, but you're not allowed to access the file you requested.

Robert.

Good news and thanks all for your hard work :)

Antes

#11
edit : now mine gone too thank you Illori :P

SleePy

It should be fixed now.  But it may go off-line intermediately.
Jeremy D ~ Site Team / SMF Developer ~ GitHub Profile ~ Join us on IRC @ Libera.chat/#smf ~ Support the SMF Support team!

Herman's Mixen

* The Burglar! gives CoreISP and Derek a nice break after doing this maint everything is smooth again ;)
good work and keep it up :P
Met vriendelijke groet, The Burglar!

 House Mixes | Mixcloud | Any Intelligent fool can make things bigger, more complex, and more violent.
It takes a touch of genius - and a lot of courage - to move in the opposite direction. - Albert Einstein

Former Godfather of our dutch community ;)

gisfreak

Me fail English? That's unpossible.

LiroyvH

Thank you :)

So this has been quite a nightmare for us system administrators.
We will post a more detailed report later, but first of all I would like to thank:

- dschwab9 (Derek) for spending a significant ammount of time both in and out of the datacenter, patching configurations, comming up with workarounds, upgrading hardware, etc. :)
- SleePy for spending a lot of time looking through configs and helping where he could :)
- WireSix Technicians, for bearing with us on letting them run to our file server multiple times :)
  They have been a great help to allow us to continue doing remote jobs
- I guess myself (sounds so wrong :P) for spending tons of time on transferring files, udating configs, figure out temporary workarounds for our hardware issues, making patches and modifications, installing software and mitigating DDoS attacks, all to get us in a running state again and working with Derek with the datacenter jobs that had to be done.
- Anyone else that may have indirectly helped us

And thank you all for your patience in this matter!! :)

Happy forum-ing!!


- Liroy
((U + C + I)x(10 − S)) / 20xAx1 / (1 − sin(F / 10))
President/CEO of Simple Machines - Server Manager
Please do not PM for support - anything else is usually OK.

mashby

Thanks to all who got everything back up! Running nicely at the moment. :)
Always be a little kinder than necessary.
- James M. Barrie

SleePy

Well maybe I am under estimating myself.  But both Derek and Liroy deserve a good thanks for the lack of sleep from this all :D.  I just annoyed them and kept them thinking ;)
Jeremy D ~ Site Team / SMF Developer ~ GitHub Profile ~ Join us on IRC @ Libera.chat/#smf ~ Support the SMF Support team!

dschwab9

Just a heads up - the mail server and backend utility server that processes the mail queue are still down, so no emails are going out from the site.  We're currently working on recovering those.

Due to a hardware malfunction with the RAID controller in our NFS server, it's taking forever to migrate everything.

Oldiesmann

Thanks for the update Derek. Hopefully you'll have things back up and running like normal again soon.
Michael Eshom
Christian Metal Fans

Antes

That's why I'm staying in SMF... You guys doing something because you want to.

I salute you with all my respect and thank you for your all hard work :)

Dzonny

Thans Derek, Liroy and SleePy for the great job. :)

Angelina Belle

Thank you liroy, derek, and SleePy.  We look forward to hearing when the RAID controller is replaced, and everything can get back to normal.
Never attribute to malice that which is adequately explained by stupidity. -- Hanlon's Razor

Apllicmz




Deaks

wait mail servers are down?!?
~~~~
Former SMF Project Manager
Former SMF Customizer

"For as lang as hunner o us is in life, in nae wey
will we thole the Soothron tae owergang us. In truth it isna for glory, or wealth, or
honours that we fecht, but for freedom alane, that nae honest cheil gies up but wi life
itsel."

SleePy

Mail was down at the time of Dereks posting.  They are operational at this point.
Jeremy D ~ Site Team / SMF Developer ~ GitHub Profile ~ Join us on IRC @ Libera.chat/#smf ~ Support the SMF Support team!

Deaks

~~~~
Former SMF Project Manager
Former SMF Customizer

"For as lang as hunner o us is in life, in nae wey
will we thole the Soothron tae owergang us. In truth it isna for glory, or wealth, or
honours that we fecht, but for freedom alane, that nae honest cheil gies up but wi life
itsel."

Herman's Mixen

You know.. they work also behind the scene ;)
Met vriendelijke groet, The Burglar!

 House Mixes | Mixcloud | Any Intelligent fool can make things bigger, more complex, and more violent.
It takes a touch of genius - and a lot of courage - to move in the opposite direction. - Albert Einstein

Former Godfather of our dutch community ;)

dschwab9

Everything is fully functional at this point.  We will be repairing and rebuilding the file server with the hardware issue and ultimately moving the data back to that box, which has more disks and IP capacity than the file server we are currently on.

moguns

This is crazy.. you guys need to get the server stuff fixed. Making godaddy look good here

live627

Quote from: moguns on November 30, 2011, 10:00:21 PM
This is crazy.. you guys need to get the server stuff fixed. Making godaddy look good here
Yes, manually dealing with dedicated servers is crazy.

LiroyvH

Lol, someone has to do it :P


Anyway, we are going offline again tomorrow to proceed with the upgrades!
We do not have a estimate time as it depends on various factors. We can also not exactly predict how long it will be offline for, but please expect it to take a couple of hours.

In the meanwhile, you may always visit our backup board for urgent issues :)

Thank you


- Servers Team
((U + C + I)x(10 − S)) / 20xAx1 / (1 − sin(F / 10))
President/CEO of Simple Machines - Server Manager
Please do not PM for support - anything else is usually OK.

LiroyvH

Due to planning issues we unfortunately have to postpone the maintenance.

We will hopefully proceed tomorrow instead of today.
Sorry for the inconvenience!

We will keep you posted :)
((U + C + I)x(10 − S)) / 20xAx1 / (1 − sin(F / 10))
President/CEO of Simple Machines - Server Manager
Please do not PM for support - anything else is usually OK.

青山 素子

Quote from: moguns on November 30, 2011, 10:00:21 PM
This is crazy.. you guys need to get the server stuff fixed. Making godaddy look good here

When you can get GoDaddy to deal with your 4+ dedicated systems (with multiple virtual instances on nearly all boxes) with special internal networking configuration and over 4mbit of constant traffic, then you can say that. As it is, their hosting solutions can barely keep a small shared website operating.

simplemachines.org isn't some small website, you know. It's well into where you can throw around the word "enterprise" and not look like a total moron.
Motoko-chan
Director, Simple Machines

Note: Unless otherwise stated, my posts are not representative of any official position or opinion of Simple Machines.


sshahnawaz

GoDaddy is a web host, right?
How to Make Money Online - Urdu Description https://www.youtube.com/watch?v=0Deggh2ZxNE

sawz

Quote from: Mysterious_Stuff on December 24, 2011, 08:01:08 AM
GoDaddy is a web host, right?

they like to think so but i wouldn't consider them a serious host.
so don't use them to host your site, you'll regret it eventually.
keep smiling, they'll always wonder what your up too.....

LiroyvH

Please be advised we are planning on moving forward this Thurdsay.
Please keep in mind this is not definite, though it is approximately 90% sure we will be moving forward.

Simple Machines will be completely unreachable during the upgrades.
Updates will be posted to twitter and to some extent to Facebook.

Thank you for your ongoing patience in the matter :)
We want this fixed as much as all of you do ;)
((U + C + I)x(10 − S)) / 20xAx1 / (1 − sin(F / 10))
President/CEO of Simple Machines - Server Manager
Please do not PM for support - anything else is usually OK.

LiroyvH

After some trouble at the beginning, we are back online now :)
Powered by more servers and a new configuration.

Please be advised we are !not! 100% finished yet.
There's one big task left, though you should only notice a few minutes downtime from that, most likely tomorrow.

Thank you for your patience! :)

Thank you to:
- dscwhab9
- SleePy
- myself I guess :p
- Some help from WireSix with a hardware issue that popped up
((U + C + I)x(10 − S)) / 20xAx1 / (1 − sin(F / 10))
President/CEO of Simple Machines - Server Manager
Please do not PM for support - anything else is usually OK.

busterone

Thanks for the hard work.   :)

ApplianceJunk

Thanks dscwhab9, SleePy and CoreISP.

Deaks

hey where my thanks for pestering you on MSN keeping you sane :P

Seriously though cheers guys we all love ya :)
~~~~
Former SMF Project Manager
Former SMF Customizer

"For as lang as hunner o us is in life, in nae wey
will we thole the Soothron tae owergang us. In truth it isna for glory, or wealth, or
honours that we fecht, but for freedom alane, that nae honest cheil gies up but wi life
itsel."

Robert.


karlbenson


Herman's Mixen

Thanks guys, you all did a great job keep on going :P
Met vriendelijke groet, The Burglar!

 House Mixes | Mixcloud | Any Intelligent fool can make things bigger, more complex, and more violent.
It takes a touch of genius - and a lot of courage - to move in the opposite direction. - Albert Einstein

Former Godfather of our dutch community ;)

dschwab9

Hey guys, just a quick note that we will be performing some final configuration changes to complete this project today, 1/5/2012. We don't expect a lengthy outage, but might have a few minutes here and there of the site being unreachable or sluggish.

Joker™

Working awesome on my side. Great job team.
Github Profile
Android apps
Medium

How to enable Post Moderation

"For the wise man looks into space and he knows there is no limited dimensions." - Laozi

All support seeking PM's get microwaved

Robert.

I agree, working great here too. :) Great work and thanks to all involved! :D

Angelina Belle

Things are so much better now than they were in December. I'm hoping that's due to your work protecting us from the incessant  DDOS attacks.
Never attribute to malice that which is adequately explained by stupidity. -- Hanlon's Razor

Joshua Dickerson

It was dschwab9 and CoreISP's new year's resolution to make the servers stable :D Unlike everyone else, you are actually fulfilling that resolution!
Come work with me at Promenade Group



Need help? See the wiki. Want to help SMF? See the wiki!

Did you know you can help develop SMF? See us on Github.

How have you bettered the world today?

karlbenson


admirable

Nice dear all the team of SMF.... Rocks... :laugh:
My Website| JA Technologies
-----------------------------------------------------------------------
Do hard work, one day you will be awarded for that!
-----------------------------------------------------------------------

Advertisement: