robots.txt directories

Started by hofmax, April 11, 2006, 07:49:06 AM

Previous topic - Next topic

hofmax

Hi,

I was wondering wether someone can tell me which sub-directories of smf I can disallow via robots.txt
without obstructing the search engine spiders?
For instance google was trying to go into images and encountered a problem. Surely images just eat up band width and don´t do anything useful in terms of SEO.

Cheers!

beemer

Hi try the search, there are several thread on robots knocking about
http://www.bmw7resource.co.uk
SMF 1.1 RC1
MKP 1.1 RC1
Helios Multi RC1
-------------------------------------------------------
http://www.thefishsheadnhorsesarse.co.uk
SMF 1.1 RC2
TinyPortal 0.8.6

Advertisement: