Customizing SMF > Modifications and Packages
Forum Firewall
Texan78:
That is the same robots.txt file just two different screen shots. One of the top and one of the bottom so you can see they whole thing.
Here is the issue I am confused about. I use the SMF SEO Pro Mod which enables pretty action URLs. So that is why the links are like that at the top. If I remove those will that not mess up my SEO for bots crawling those links?
butchs:
I went to your website and I still see "http://www.weather-connection.com/index.php?action=search" so you should get rid of that extra stuff. If you do not have all your action urls then I would not use this feature.
Your "Robots.txt action's" should be like:
--- Code: ---action=activate|action=admin|action=arcade|action=calendar|action=collapse|action=deletemsg|action=editpoll|action=help|action=helpadmin|action=lock|action=login|action=logout|action=markasread|action=mergetopics|action=mlist|action=modifykarma|action=movetopic|action=notify|action=notifyboard|action=pm|action=post|action=profile|action=register|action=removetopic2|action=reporttm|action=search|action=sendtopic|action=splittopics|action=stats|action=sticky|action=trackip|action=unread|action=unreadreplies|action=who
--- End code ---
Your crawl delay is 10. The google crawl delay at googlewebmasters should be set too... I would make your "Trigger (#/sec) " .7.
Texan78:
--- Quote from: butchs on May 29, 2012, 09:09:38 AM ---I went to your website and I still see "http://www.weather-connection.com/index.php?action=search" so you should get rid of that extra stuff. If you do not have all your action urls then I would not use this feature.
--- End quote ---
Yes, currently I have that function disabled because I have two menu items that are not working correctly. Once I am able to get that issue resolved I will be enabling that function. I am thinking though if it is to much trouble just not enabling those action URLs back.
--- Quote from: butchs on May 29, 2012, 09:09:38 AM ---Your "Robots.txt action's" should be like:
--- Code: ---action=activate|action=admin|action=arcade|action=calendar|action=collapse|action=deletemsg|action=editpoll|action=help|action=helpadmin|action=lock|action=login|action=logout|action=markasread|action=mergetopics|action=mlist|action=modifykarma|action=movetopic|action=notify|action=notifyboard|action=pm|action=post|action=profile|action=register|action=removetopic2|action=reporttm|action=search|action=sendtopic|action=splittopics|action=stats|action=sticky|action=trackip|action=unread|action=unreadreplies|action=who
--- End code ---
--- End quote ---
So when I put this in the robots.txt file will it auto populate in the text box in the admin control panel for the FF or will I need to manually enter it in there too?
--- Quote from: butchs on May 29, 2012, 09:09:38 AM ---Your crawl delay is 10. The google crawl delay at googlewebmasters should be set too... I would make your "Trigger (#/sec) " .7.
--- End quote ---
I can't find in the google webmaster tools where to set this crawl rate. Where do I find this option when I am in the webmaster tools?
-Thanks
butchs:
--- Quote from: Texan78 on May 29, 2012, 03:23:42 PM ---So when I put this in the robots.txt file will it auto populate in the text box in the admin control panel for the FF or will I need to manually enter it in there too?
--- End quote ---
That information goes in the mods admin panel. If you uninstall and reinstall the mod it should automatically populate. Otherwise you have to manually enter it.
--- Quote from: Texan78 on May 29, 2012, 03:23:42 PM ---I can't find in the google webmaster tools where to set this crawl rate. Where do I find this option when I am in the webmaster tools?
--- End quote ---
As per. To change the crawl rate:
1. On the Webmaster Tools Home page, click the site you want.
2. Under Configuration, click Settings.
3. In the Crawl rate section, select the option you want.
The new crawl rate will be valid for 90 days.
8)
BubblePig:
I am one of the admins of an SMF site, even though my skills are almost nonexistent.
A member asked this question a while back:
--- Quote ---Why does the text on the bottom of the page
"Protected by: Forum Firewall © 2010-2011"
link to [eastcoastrollingthunder] ?
--- End quote ---
IIRC, when I first looked into it in late April of this year, the link on this site redirected there as well, but I may be mistaken. In any event, that link is the 5th entry when I google "forum firewall" . Also, the links "BH MOD © 2011" and "butchs" on the main page of that site recursively redirect to back the main page of that site.
I don't suppose anyone knows why that might be?
Navigation
[0] Message Index
[#] Next page
[*] Previous page
Go to full version