Customizing SMF > Modifications and Packages
Forum Firewall
butchs:
Thank you for asking the question and not shooting first... Users like you are the reason I share some of my code...
MiY4Gi:
I dunno. That "duplicate installation" thing happened with one of the other mods on my forum. It's specifically a mod that I'm busy troubleshooting. The un-installer pretended to uninstall a mod, but it didn't undo all of the changes it made to the files, even though no un-installation problems were reported by the installer. So when I reinstalled the mod, some files ended up with duplicate code. I don't believe it was a mistake on my part.
In any case, this could be human error, but it could also be a problem with the SMF installer itself, or the mod package. It could even be cosmic radiation that confused your computer, no ******. However, who or what's to blame isn't really important here, unless the problem occurs frequently enough to warrant special attention.
Texan78:
--- Quote from: butchs on May 29, 2012, 07:58:40 PM ---To change the crawl rate:
1. On the Webmaster Tools Home page, click the site you want.
2. Under Configuration, click Settings.
3. In the Crawl rate section, select the option you want.
The new crawl rate will be valid for 90 days.
8)
--- End quote ---
I am revisiting this to make sure I have everything set correctly in all my mods for the launch. The only question I have is in my robots.txt the crawl rate is set to 10, but in Webmaster Tools the highest you can set it is 2.
So should I set it to 2 and then change it to 2 in the robots.txt? I believe I read the recommended setting was 10 but that can't be achieved in the webmaster tools so please correct me if I am wrong.
-Thanks
KRISHNA0007:
thanks for this extra layer security for my forum
butchs:
The setting on the mod is the "Trigger (#/sec) ". So if your have Google set to 2. It can hit you're site every 2 seconds. The mod counts the hits in your cache. So if you have your cache set to 20, Google can hit you 10 times. That will give Google a minimum Trigger of 10/20 = 0.5.
Google ignores robots.tst. So your setting there does not matter. In 20 seconds the bot will visit you 2 times. A minimum Trigger of 2/20 = 0.1.
If you have a crawl rate of .7, a bot will need to hit you 20 x .7 - 14 times to get blocked. This Trigger is a good starting point. I do not recommend going below it.
Set it to what you want. I suggest:
robots.tst 10
Google 2
Trigger .7
If you uninstall the mod and reinstall it, the mod will try to read your robots.tst file. Or just make your changes manually...
make sure you test before going live and start blocking.
Navigation
[0] Message Index
[#] Next page
[*] Previous page
Go to full version