I want the crawlers to come to the site and hopefully build up our popularity with the topics we will be posting and the replies, etc.
However I also want privacy for our members as it is a closed group and so I want to disallow guests from all boards.
So my question is: will the crawlers still index our posts and replies and return us in search results if the boards are off-limits to guests? Probably not huh?
No guest-view=no bots.
ok.
It keeps the nasties out, too, though.