Database abnormally increases from 130 to 1400 MB

[Sono]

What do you think a deny does?  The attempted link returns a 403, that's appropriate.
...

A script kiddie is a lazy hacker who sends out queries for all known hacks,  whether or not you're running the software.
But these attempts are not going to pile on your bandwidth.

I am not an expert so I don't know how these things go with the ban. But in this case it can be normal that the bot is banned and the attempt is still noted in the log, if I understand correctly?

[Arantor]

it can be normal that the bot is banned and the attempt is still noted in the log

Yes, that's what we've been telling you. The log reports that the attempt was made, it was returned 403 Forbidden. Having a ban without logs just means you don't know if the ban is still necessary, which is why there are logs.

[Sesquipedalian]

If Google is making those requests, then the most likely explanation is that the URLs it is trying to ask for are links that exist on the pages of some external website. Google will check it several times for a while and then eventually blacklist it as an invalid URL. There's no need to ban site crawlers just because they make these queries.

If your host does not put a limit on your bandwidth, then you are worried about nothing. It would be a violation of their terms of service if they discontinued service to your account for bandwidth usage when they said that you have unlimited bandwidth. They would open themselves up to getting sued if they did that.

[Sono]

If Google is making those requests, then the most likely explanation is that the URLs it is trying to ask for are links that exist on the pages of some external website. Google will check it several times for a while and then eventually blacklist it as an invalid URL. There's no need to ban site crawlers just because they make these queries.

If your host does not put a limit on your bandwidth, then you are worried about nothing. It would be a violation of their terms of service if they discontinued service to your account for bandwidth usage when they said that you have unlimited bandwidth. They would open themselves up to getting sued if they did that.

So you mean the following IP range is better to be allowed than restricted?



It is okay that the host should respect the terms, yet I was worried if they notice that huge bandwidth growth they might restrict my account for abnormal traffic or something like that.

[Sesquipedalian]

You should not block GoogleBot unless you want to stop appearing in Google search results. The same applies for any other search engine's web crawler.

As for bandwidth, I repeat, you are worried about nothing. If your hosting provider was concerned about it, their automated systems would have done something about it already.

[Sono]

Well, I will leave the bandwidth problem as is now. Something happened meanwhile though, because since I banned a few ranges initially, including some from Alibaba could and Amazonaws, the bandwidth metering stopped. I wonder what happened, but these are not the hosting servers that I banned that is sure. There is metering info up until the 2nd of February, but after that the graph is empty. Anyway, in case I manage to find which ip is flooding the forum with requests, I will mention it in the forum, maybe it will be a useful info for the others. Another interesting thing is that since deleting Optimus, adding the anti bot code that I posted above and banning some servers, my bot registration count skyrocketed. I wonder if it is because they don't find Optimus any more and are attacking on the registration panel now...

On the other hand the database problem can be considered solved I think. No strange error logs since then, only 2 or 3 daily, reporting about legit problems a forum might have as usual. So deleting Optimus was a super advice, thank you very much!