Customizing SMF > Building Your Community and other Forum Advice

Please Add your own rebot.txt

(1/1)

coregej:
 
--- Code: ---User-agent: Googlebot-Image
Disallow: /

User-agent: YandexImages
Disallow: /

User-agent: msnbot-MM
Disallow: /

User-agent: Googlebot-Mobile
Allow: /*wap
Disallow: /

User-agent: YandexImageResizer
Allow: /*wap
Disallow: /

User-agent: MediaPartners-Google
Allow: /

User-agent: *
Allow: /$
Allow: /*action=.xml
Disallow: /*action
Disallow: /*wap
Disallow: /*board=*wap
Disallow: /*topic=*wap
Disallow: /*topic=*.msg
Disallow: /*topic=*.new
Disallow: /*;
Disallow: /*PHPSESSID
Allow: /*board
Allow: /*topic
Disallow: /
Crawl-delay: 5
Clean-param: PHPSESSID /index.php
Host: topnichez.com
--- End code ---

i need more valuable rebot.txt of this to boost my SEO and reduce Spammers. i have seen many of them online here but i just don't understand them.

please i need help

K@:
Your best resource, for this, is probably HERE.

coregej:

--- Quote from: K@ on September 06, 2012, 09:50:02 AM ---Your best resource, for this, is probably HERE.

--- End quote ---
thanks alot but i don't want to make mistakes . i have seen some codes here and outside here but i don't just understand them. i need suggestions of robots please My Boss

K@:
It's a very difficult thing to quantify, really, because people's sites are like their computers.

Every single one is totally different.

For SEO stuff, which I believe to be almost totally worthless (Read THIS to see why), you can look at something like this:

http://tools.seobook.com/robots-txt

Navigation

[0] Message Index