Problem with robots.txt

Started by kingdarnakes, May 06, 2011, 04:09:39 PM

Previous topic - Next topic

kingdarnakes

hello, i recently have installed pretty urls, and added to robots.txt some modifications.
my robots.txt
QuoteUser-agent: *
Disallow: /*/?sort=*
Disallow: /*/*/?sort=*
Disallow: /*/?prev_next*
Disallow: /*/*/?prev_next=*
Disallow: /*/*/msg*
Disallow: /*/msg*
Disallow: /?PHPSESSID*
Disallow: /*/?PHPSESSID*
Disallow: /*/*/?PHPSESSID*
Disallow: /*/*/?action=*
Disallow: /*/?action=*
Disallow: /Sources
Disallow: /Smileys
Disallow: /Packages
Disallow: /avatars
Disallow: /attachments
Disallow: /Themes
Disallow: /profile/*
Disallow: /stats
Disallow: /recent
Disallow: /help
Disallow: /login
Disallow: /reminder
Disallow: /login2
Disallow: /credits
Disallow: /index.php?action=*

But in google webmaster appeared urls as myforum.com/index.php?topic=54.0 or myforum.com/index.php?board=4.0, then i added this to avoid that those urls not to indexed (I established 301 redirection)
QuoteAllow: /index.php?board=*
Allow: /index.php?topic=*
Allow: /index.php/topic,*.*.html

But i continued to have urls in google webmaster as not allow (?topic=4 or ?board)

Any solution?

Kermit

I guess if you don't want to make them visible for google bots,then you need to use Disallow instead of allow
My Mods
Please don't PM/mail me for support,unless i invite you
Formerly known as Duncan85
Quote
"Two things are infinite: the universe and human stupidity; and I'm not sure about the the universe."

A. Einstein

Advertisement: