SMF Support > Bosanski/Hrvatski/Srpski (Bosnian/Croatian/Serbian)

Robot txt

(1/2) > >>

rambomambo:
interesuje me jeli ovaj robot text dobro konfigurisan i da neće pravit smetnje??


--- Code: ---User-agent: Googlebot-Image
Disallow: /

User-agent: YandexImages
Disallow: /

User-agent: msnbot-MM
Disallow: /

User-agent: Googlebot-Mobile
Allow: /*wap
Disallow: /

User-agent: YandexImageResizer
Allow: /*wap
Disallow: /

User-agent: MediaPartners-Google
Allow: /

User-agent: *
Allow: /$
Allow: /*action=.xml
Disallow: /*action
Disallow: /*wap
Disallow: /*board=*wap
Disallow: /*topic=*wap
Disallow: /*topic=*.msg
Disallow: /*topic=*.new
Disallow: /*;
Disallow: /*PHPSESSID
Allow: /*board
Allow: /*topic
Disallow: /
Crawl-delay: 5
Clean-param: PHPSESSID /index.php
Host: example.com

--- End code ---

steven80:
lose je konfigurisan.

Dado1986:
Ima google gotov kod koji samo copy/paste i sve radi kako treba, samo u trazilicu upisi robots.txt

rambomambo:
valja li ovaj ili ako neko zna neka postavi dobru konfiguraciju ako nije problem


--- Code: ---User-agent: *
Disallow: /Sources/
Disallow: /Themes/
Disallow: /Test/
Disallow: /smf/
Disallow: index.php?action=activate
Disallow: index.php?action=admin
Disallow: index.php?action=arcade
Disallow: index.php?action=calendar
Disallow: index.php?action=collapse
Disallow: index.php?action=deletemsg
Disallow: index.php?action=editpoll
Disallow: index.php?action=help
Disallow: index.php?action=helpadmin
Disallow: index.php?action=lock
Disallow: index.php?action=login
Disallow: index.php?action=logout
Disallow: index.php?action=markasread
Disallow: index.php?action=mergetopics
Disallow: index.php?action=mlist
Disallow: index.php?action=modifykarma
Disallow: index.php?action=movetopic
Disallow: index.php?action=notify
Disallow: index.php?action=notifyboard
Disallow: index.php?action=pm
Disallow: index.php?action=post
Disallow: index.php?action=profile
Disallow: index.php?action=printpage
Disallow: index.php?action=register
Disallow: index.php?action=removetopic2
Disallow: index.php?action=reporttm
Disallow: index.php?action=search
Disallow: index.php?action=sendtopic
Disallow: index.php?action=splittopics
Disallow: index.php?action=stats
Disallow: index.php?action=sticky
Disallow: index.php?action=trackip
Disallow: index.php?action=unread
Disallow: index.php?action=unreadreplies
Disallow: index.php?action=who
Disallow: index.php?PHPSESSID=*
Disallow: index.php?*rss*
Disallow: index.php?*wap*
Disallow: index.php?*wap2*
Disallow: index.php?*imode*
Disallow: index.php?wwwRedirect*
Disallow: *.msg
Disallow: *.new
Disallow: *sort
Disallow: *topicseen
Disallow: *prev_next*
Crawl-delay: 5
 
--- End code ---

Dado1986:
Ovo su mi poslali kad sam za sebe trazio


--- Code: ---User-agent: *
Disallow: index.php?action=search*
Disallow: index.php?action=calendar*
Disallow: index.php?action=login*
Disallow: index.php?action=register*
Disallow: index.php?action=profile*
Disallow: index.php?action=stats*
Disallow: index.php?action=arcade*
Disallow: index.php?action=printpage*
Disallow: index.php?PHPSESSID=*
Disallow: index.php?*rss*
Disallow: index.php?*wap*
Disallow: index.php?*wap2*
Disallow: index.php?*imode*
--- End code ---


a ovaj ja imam i nemam nikakvih problema:


--- Code: ---User-agent: *
Disallow: /Sources/
Disallow: /Themes/
Disallow: /Test/
Disallow: /smf/
Disallow: index.php?action=activate
Disallow: index.php?action=admin
Disallow: index.php?action=arcade
Disallow: index.php?action=calendar
Disallow: index.php?action=collapse
Disallow: index.php?action=deletemsg
Disallow: index.php?action=editpoll
Disallow: index.php?action=help
Disallow: index.php?action=helpadmin
Disallow: index.php?action=lock
Disallow: index.php?action=login
Disallow: index.php?action=logout
Disallow: index.php?action=markasread
Disallow: index.php?action=mergetopics
Disallow: index.php?action=mlist
Disallow: index.php?action=modifykarma
Disallow: index.php?action=movetopic
Disallow: index.php?action=notify
Disallow: index.php?action=notifyboard
Disallow: index.php?action=pm
Disallow: index.php?action=post
Disallow: index.php?action=profile
Disallow: index.php?action=printpage
Disallow: index.php?action=register
Disallow: index.php?action=removetopic2
Disallow: index.php?action=reporttm
Disallow: index.php?action=search
Disallow: index.php?action=sendtopic
Disallow: index.php?action=splittopics
Disallow: index.php?action=stats
Disallow: index.php?action=sticky
Disallow: index.php?action=trackip
Disallow: index.php?action=unread
Disallow: index.php?action=unreadreplies
Disallow: index.php?action=who
Disallow: index.php?PHPSESSID=*
Disallow: index.php?*rss*
Disallow: index.php?*wap*
Disallow: index.php?*wap2*
Disallow: index.php?*imode*
Disallow: index.php?wwwRedirect*
Disallow: *.msg
Disallow: *.new
Disallow: *sort
Disallow: *topicseen
Disallow: *prev_next*
Crawl-delay: 5
--- End code ---

Navigation

[0] Message Index

[#] Next page

Go to full version