Urgent: Connecting problem to database !

[hartiberlin]

Hi Christian,
yes on my main site:
www.overunity.com

I have around 5 to 10 Gbytes/day traffic,
depending on what new files were posted.

I am also running Tinyportal and I have about 19 to 35 queries
per page to the database, depending what the blocs on the page are...

So myhoster is servage.net, which is on a clustered server farm,
they have very nice conditions, but they said now several times, that
they can not allow more queries than 70.000 queries to the database per hour,
due to their SQL setup.

So, where do I find a host,
that allows me at least 500.000 queries per hour and where I also get around
200 Gbytes of disc space and around 300to 500 Gbytes traffic per month
andis less than 50 US$ per month ?`

Can I use a Virtual Private Server for this or do they also restrict the queries
per hour ?

Many thanks.

P.S: Yes, I am a German from Berlin, Germany.

Regards, Stefan.

[Christian A. Herrnboeck]

Hi Stefan,


Hosts normally shouldn't be limiting SQL queries. However, I am interested to know how you are using 200GBs of disk-space. That's more than the average server holds! Are you using that much right now, or is this what your current plan offers?

A VPS should suite you quite well, and I'd suggest that you post in Hosts & Hosting to get advice on a host, as we're not supposed to talk about them here

Best Regards,
Christian A. Herrnboeck

[hartiberlin]

Hi Christian,
I have about 3900 members in my overunity.com
forum and there are always around 50 to 70 users online
all the time and as every page makes about 20 to 35 queries
to the database, 70.000 queries to the database is too low...

Okay, the clustered host I am on now allows me to have 250 GB Disk space and
2.1 TerraByte traffic per month,
but as they limit the queries, that makes this otherwise outstanding hoster
now not good for my SMF hosting !

So I need a different solution now...
Many thanks.

Regards, Stefan.

[Joshua Dickerson]

reduce the number of recent posts! Go with something like 10.

[c2h5oh]

You can try vps at webperoni.de - I've got dedicated server there and I'm satisfied.

[hartiberlin]

reduce the number of recent posts! Go with something like 10.

It makes not much difference, if I display 10 or the last 300 postings,
as the queries to the database is just about 19 to 21 queries on this page...
at least this is displayed at the footer... can we trust the footer quotation ?

[Christian A. Herrnboeck]

The footer can be trusted, what's listed there is the number of calls to the DB query function in SMF, so unless you have an oustide script that's being called, then yes, you can trust it


Regards,
Christian A. Herrnboeck

[hartiberlin]

I now have again the problem,
but this time the error is:

Database Error: User 'hartiberlin1' has exceeded the 'max_updates' resource (current value: 30000)
File: /mounted-storage/home4/sub002/sc11940-GNVW/overunity/Sources/Subs.php
Line: 2536

The Techsupport guy writes:

Hello Stefan,

Mind you it is the max_updates where the limit is reached not the max_questions. It is not normal to have that many updates, even for that many pageviews. A busy website will normally only use many questions and only a few updates.

Please check your scripts again to see where the update queries are used.


Kind regards,
Allan, Servage Hosting

===============

I am now using SMF1.1.1 with TP 0.97 and Admod 1.1V2

What could generate this huge
'max_updates' value ?

When is this parameter being increased ?
Only if somebody posts a message in my forum
or what exactly is it ?

Could it be, that somebody tries to hack my
admin password with a brute force program ?

Please help.

Many thanks.

Regards, Stefan.

[hartiberlin]

Hi,
somebody from the TP site wrote me:

The only thing i can think of is if you have RSS feeds in an article or in a block, or some mod that update often, A javascript that keeps refreshing or some thing.



--------------------------------------------------------------------------------

and I answered:

Hmm,
I have RSS enabled, should I disable it in the admin area ?

Also I have a clock in a TP block at the side
and also Google adsense and Amazon skyscraper ads
in TP blocks at the side boarders of my forum
an a Kontera.com Content-add Javascript , that checks the site
for content words and double marks them and users
can then click these keywords for adds..

Hmm, my Techsupport writes:

Hello Stefan,

Sql updates are INSERT, UPDATE and REPLACE statements.

Sql questions are all statements.

So, what should I change ?

Could it just be a brute force attack from someone,
who tries to get the admin password ?

P.S: normally every page of my forum generates
about 19 to 35 queries to the database,
but what exactly makes accesses to this
'max_updates' value ?

How could I check this out, which Block
might increase this value, so I could disable it ?

Many thanks.

Regards, Stefan.

[SleePy]

If you open your Settings.php and below
$db_error_send = 1;

Enter this:

$db_show_debug = true;


This will show you on your forums what files are doing what, including mysql information.
Then you can find the ones that are using such commands or many of them.

[Ben_S]

SMF does quite a few updates to various tables such as sessions and log_online with each page view, you could reduce it a bit by disabling db driven sessions, but your best bet is to find a real host that doesn't impose pointless stupid limits like this.

[hartiberlin]

If you open your Settings.php and below
$db_error_send = 1;

Enter this:

$db_show_debug = true;


This will show you on your forums what files are doing what, including mysql information.
Then you can find the ones that are using such commands or many of them.

Many thanks for this info.

Where will I find then these debug informations ?

Inside the Error log inside Admin Panel in den Maintainance section ?

Many thanks.

[SleePy]

Will be displayed at the bottom of forum on every page. Click Show Queries..

[hartiberlin]

Hi All,

it seems the problem is caused by the AdMod with its reporting function.

The report writes each time, an ad is displayed at the page an
UPDATE to the database...

Unfortunately one can not turn off the reporting as far as I know.

Where could this reporting function be patched to be disabled ?

SMF does quite a few updates to various tables such as sessions and log_online with each page view, you could reduce it a bit by disabling db driven sessions, but your best bet is to find a real host that doesn't impose pointless stupid limits like this.

Where can I disable database driven sessions ?

Many thanks.

[jerm]

Installing the new version of the ad mod allows you to disable the reports.

[techbot]

I just found this thread...I'm having the EXACT same issue as Hartiberlin...and I'm on servage.net too.  May be time to go to a new host

I can't even access my forums anymore.  I either get that error message or I get a blank  page. No more forums!

[johnblackmore]

I just found this thread...I'm having the EXACT same issue as Hartiberlin...and I'm on servage.net too.  May be time to go to a new host

I can't even access my forums anymore.  I either get that error message or I get a blank  page. No more forums!

It would seem servage have pulled a fast one on all of us. I never used to have this problem and now all of a sudden there is a max_update setting of just 20,000! That works out at just 600 page views an hour on my site at www.club-306.com

Response from Servage: We don't care, we wont be increasing the setting.

[Joshua Dickerson]

Response from Servage: We don't care, we wont be increasing the setting.

Is that really what they said?

[hartiberlin]

Hi,
I have the same problem again.
Now Servage.net moved me to a new server
farm, which now has 100.000 queries and 100.000 updates
per hour and I also installed the
bot-trap.de
script, so nasty spiders can´t access my site no more...

But as my site is getting now pretty much known, I also get more
traffic and am now running between 12 and 20 GigaBytes per day
and now the 100.000 queries limit has hit again.

My pages have about 20 to 35 queries per page to the database.

I am looking now for a stats script I could include to show
me , which IP adress has made the most traffic per day.

Is there a plugin for SMF or TinyPortal, so I could see this.

Or do you know, where there is any online service that
has such a stats script I could use, which would show me the
traffic per IP address per day ?

Does Google analytics show this ?
Many thanks.

Regards, Stefan.

[青山 素子]

But as my site is getting now pretty much known, I also get more
traffic and am now running between 12 and 20 GigaBytes per day
and now the 100.000 queries limit has hit again.

If you are doing that much transfer a day, you should look at moving to a VPS or dedicated server.

I am looking now for a stats script I could include to show
me , which IP adress has made the most traffic per day.

Is there a plugin for SMF or TinyPortal, so I could see this.

Or do you know, where there is any online service that
has such a stats script I could use, which would show me the
traffic per IP address per day ?

Does Google analytics show this ?

Yes, Google Analytics shows this, but only hits, not transfer. If your host offers AWStats, that will show the info, including transfer, as well.