Good quality Robots.txt

[cpvr]

Does anyone have an up-to-date file for the robots.txt - that's includes a lot of the pages that shouldn't be indexed by the spiders?

[Illori]

have you tried searching this forum? this topic has come up several times before.

[kat]

Here's an even better place to start...

http://www.robotstxt.org

[cpvr]

Here's an even better place to start...

hxxp:www.robotstxt.org [nonactive]

Not for me. I know all about robots.txt I'm looking for one that people use all the time. I've been using vBulletin for the past few years. That's why.

[Illori]

then did you take my advice and search this forum for one?