SMF Support > SMF 2.0.x Support
Looking for noindex mod or system
Kindred:
--- Quote from: maestrosite.ru on May 15, 2012, 07:36:17 AM ---3. Add to robots.txt:
--- Code: ---Disallow: /*action=
--- End code ---
--- End quote ---
really? disallow all ACTION urls? that's a bad idea....
maestrosite.ru:
--- Quote from: Kindred on May 15, 2012, 11:41:24 AM ---
--- Quote from: maestrosite.ru on May 15, 2012, 07:36:17 AM ---3. Add to robots.txt:
--- Code: ---Disallow: /*action=
--- End code ---
--- End quote ---
really? disallow all ACTION urls? that's a bad idea....
--- End quote ---
Can you show which "action"-pages should be allowed?
Of course in this case you can add specific "action" and "area", and don't disallow all actions
Kindred:
action=mlist, action=calendar, action=profile, action=gallery, action=downloads.... etc etc and so forth.
maestrosite.ru:
--- Quote from: Kindred on May 15, 2012, 12:13:06 PM ---action=mlist, action=calendar, action=profile, action=gallery, action=downloads.... etc etc and so forth.
--- End quote ---
If you really need, then:
--- Code: ---Allow: /*action=mlist
Allow: /*action=calendar
Allow: /*action=profile
Allow: /*action=gallery
Allow: /*action=downloads.... etc etc and so forth.
--- End code ---
But what information will be of interest to search engines, for example, on the pages: action=mlist, action=calendar, etc?
If you installed a mod that adds a new pages (new actions), of course, these pages do not need to lock.
upd For example:
--- Code: ---Allow: /*action=sitemap
--- End code ---
Kindred:
in other words... ban all actions in order to block a single one - and then re-allow each other action individually? that's just plain silly.
I certainly want the search engines to track my calendar/list of events.
tracking my memberslist (if it's available to the public) is also important, in case someone is searching for a user by name.
tracking users' profiles is also important (again, if its available to the public) for the same reason.
as I said... your idea of disallowing action is just silly.
and search engines will never, ever, get to the modify profile page anyway, so what is the point to adding a noindex to that function?
Navigation
[0] Message Index
[#] Next page
[*] Previous page
Go to full version