Uutiset:

Bored?  Looking to kill some time?  Want to chat with other SMF users?  Join us in IRC chat or Discord

Main Menu
Advertisement:

robots.txt commands for blocking duplicate content indexing

Aloittaja wolverine09, maaliskuu 04, 2009, 02:06:54 IP

« edellinen - seuraava »

karlbenson

well I'd probably allow ?boards or ?topic
remember the * at the end is implied and unnecessary.

Remember the most efficient way for google to spider your site is with an xml sitemap.

Advertisement: