Customizing SMF > Building Your Community and other Forum Advice
robot.txt affecting my alexa ranking
(1/1)
johnpaul2k2:
after adding and making changing on my robot.txt, 2 days ago i was dropped from 350,00 to 373,768. today is 391,234 WTF!!!
what will i do. here are the following codes i use
--- Code: ---User-agent: Googlebot-Image
Disallow: /
User-agent: YandexImages
Disallow: /
User-agent: msnbot-MM
Disallow: /
User-agent: Googlebot-Mobile
Allow: /*wap
Disallow: /
User-agent: YandexImageResizer
Allow: /*wap
Disallow: /
User-agent: MediaPartners-Google
Allow: /
User-agent: *
Disallow: /Sources/
Disallow: /Themes/
Disallow: index.php?action=activate
Disallow: index.php?action=admin
Disallow: index.php?action=arcade
Disallow: index.php?action=calendar
Disallow: index.php?action=collapse
Disallow: index.php?action=deletemsg
Disallow: index.php?action=editpoll
Disallow: index.php?action=help
Disallow: index.php?action=helpadmin
Disallow: index.php?action=lock
Disallow: index.php?action=login
Disallow: index.php?action=logout
Disallow: index.php?action=markasread
Disallow: index.php?action=mergetopics
Disallow: index.php?action=mlist
Disallow: index.php?action=modifykarma
Disallow: index.php?action=movetopic
Disallow: index.php?action=notify
Disallow: index.php?action=notifyboard
Disallow: index.php?action=pm
Disallow: index.php?action=post
Disallow: index.php?action=profile
Disallow: index.php?action=printpage
Disallow: index.php?action=register
Disallow: index.php?action=removetopic2
Disallow: index.php?action=reporttm
Disallow: index.php?action=search
Disallow: index.php?action=sendtopic
Disallow: index.php?action=splittopics
Disallow: index.php?action=stats
Disallow: index.php?action=sticky
Disallow: index.php?action=trackip
Disallow: index.php?action=unread
Disallow: index.php?action=unreadreplies
Disallow: index.php?action=who
Disallow: index.php?PHPSESSID=*
Disallow: index.php?*rss*
Disallow: index.php?*wap*
Disallow: index.php?*wap2*
Disallow: index.php?*imode*
Disallow: index.php?wwwRedirect*
Disallow: *.msg
Disallow: *.new
Disallow: *sort
Disallow: *topicseen
Disallow: *prev_next*
Crawl-delay: 5
Host: topnichez.com
--- End code ---
Kindred:
No one who knows anything actually cares about Alexa.
johnpaul2k2:
--- Quote from: Kindred on September 09, 2012, 10:55:22 AM ---No one who knows anything actually cares about Alexa.
--- End quote ---
thanks man, i will 4get about it, but hope my robot.txt is perfect, do i need to add anything???
K@:
It's difficult to say. Everyone's robots.txt is probably different, to achieve different things.
Navigation
[0] Message Index
Go to full version