News:

Join the Facebook Fan Page.

Main Menu

robot.txt

Started by promonkey, April 09, 2012, 06:04:18 PM

Previous topic - Next topic
Print
Go Down Pages1
User actions

promonkey

April 09, 2012, 06:04:18 PM
Not to clued up on robot.txt files but could somone give me the basics in one ( like what to put in one )

Thanks
Checkout My Forum: www.TalkAppliance.Co.Uk

IchBin™

#1
April 09, 2012, 08:09:27 PM
Google is a better place to start really.
http://www.robotstxt.org/
IchBin™        TinyPortal

MrPhil

#2
April 09, 2012, 08:44:34 PM
The appropriate content for robots.txt for SMF has been discussed many times. Just do a search for it on this forum.
Print
Go Up Pages1
User actions
Advertisement: