Uutiset:

Want to get involved in developing SMF, then why not lend a hand on our github!

Main Menu
Advertisement:

robots.txt

Aloittaja MegaS, tammikuu 18, 2005, 03:53:26 AP

« edellinen - seuraava »

MegaS

I don not want that search machines (such google and others) indexes some forum's pages (member's list, help, registration form, statistics). The search machine should index only main page, board index and messages. How can I do this?

[Unknown]

Just add it to your robots.txt as you said, disallowing the URLs you specified.

http://www.robotstxt.org/wc/robots.html

-[Unknown]

MegaS

Is it correct?


User-Agent: *
Disallow: /index.php?action=search
Disallow: /index.php?action=calendar
Disallow: /index.php?action=login
Disallow: /index.php?action=register
Disallow: /index.php?action=profile
Disallow: /index.php?action=stats

[Unknown]

Yes, assuming your forum is at:

http://www.example.com/

If it's not, you need to put robots.txt in /, and use /forum/index.php... etc.

-[Unknown]

Advertisement: