Help robots.txt for my site

[!RFAN]

hey guys,

i was going to make a robots.txt file for my site.. but i was unable to decide which directories should i allow and which i should not. so please suggest me for better indexing.

here is my directory structure..

arcade
articles
attachments
avatars
bookmarks
cache
cms
games
getid3
mgl_data
music << files for subdomain site
packages
profile_pictures
sis
smileys
sources
talkbox  < a shoutbox
tempgames
themes
tp-downloads
tp-files
tp-images


and.. m not using any cms mod...i just tried it once.. but now m using tinyportal... should i delete "cms" folder?

THANKS

[!RFAN]

any suggestions?? :S

[Hassan_the best]

Could you please elaborate?

[gamesmad]

It's quite hard to suggest, and quite a few of those folders aren't part of SMF.  The way I think of it is, if I would rather somebody was actually on my site before they saw something (like a game or picture), I hide it from search engines.  If it's a duplicate version of something I hide it from search engines.