Looking for noindex mod or system

SMF Support > SMF 2.0.x Support

(1/7) > >>

wolverine09:
Hi everyone -

Is there a noindex mod for SMF? I'd like to be able to directly tell Google not to index pages. From what I understand this works better than a robots.txt command list (which I already have implemented).

karlbenson:
Robots.txt are CRAWLER directives NOT indexing directives.
(which means robots.txt only stops the spider from visiting your pages, it does NOT remove existing pages from Google, and the link may still be indexed in google as a url only [without ever being visited, so it will be a url without a title or description or cached version]).

SMF noindexes alot of duplicate content / junk pages by setting a $context['robots_no_index'] to true.
When this is set, smf the meta tag <meta name="robots" content="noindex" />

Note 1: if you block pages with robots.txt, search engines will never visit the page, and so if there is also a meta noindex, then the spider will never see it.
For this reason using <meta tag> (or the x-robots equivalent) is the BEST and ONLY way to keep duplicate content pages out of the search engines.

Note 2: SMF 2.x noindex alot more duplicate content pages than SMF 1.1.x. And SMF 2.0 RC2 when released will contain support for Canonical tag. (to pass pagerank from duplicate content pages to the preferred page)

Note 3: SMF does not noindex ;wap, ;wap2, and ;imode since those modes run through Wireless.template.php instead of index.template.php. If your wanting to noindex those pages.
Edit Themes/default/wireless.template.php
FIND 3 occurances of <head>
And add after each (before the closing </head> naturally)

--- Code: ---<meta name="robots" content="noindex" />
--- End code ---

---
Generally I'd recommend settings $context['robots_no_index'] = true; for pages that you don't want index.
Although you might want to post more specifics of what pages/where your attempting to noindex.

wolverine09:
Regular expression -

Thanks for the information.

bjraines:
In continuing this discussion is it possible to add this meta tag to paginated pages?

青山素子:
It's possible, but then only the first page of any topic would be indexed.

Navigation

[0] Message Index

[#] Next page

Go to full version