is there a way to have just 1 spider come though as registered and see the boards and posts that registered users see?
I have an rss link on 1 of my sites and hacked the site's rss fetcher so it gots a User-Agent and i added it to my Whos.template.php and it shows now in my spiders. but on the site it doesn't show any rss because guests can not browse the forum.
I think this mod will do what you want:
http://mods.simplemachines.org/index.php?mod=143
I think he means he wants google to be able to spider the forum as a guest when guests aren't allowed to browse. Or at least display the rss feeds to guests. Or both.
I have just set up a forum where guests are not allowed to browse, but in the Board Management I have unregistered users ticked to allow to view the boards. This seems to allow my ssi headlines to display for guests on the site pages, don't know if it works for the rss feed.
In case of wanting to do this for Google or Yahoo or any other search engine spider,
DON'T
Its in direct violation with all the major search engines ToS.
You cannot, and I repeat, CAN NOT, use tricks and schemes to include non-public content to the search indexes.
This is not only because its not fair to make people register to be able to read data google indexed. But its also something that could get google in trouble in case porn and other sites do it.
When google and other searchengines find you violate these rules, your site will be excluded from search indexes ASAP, any advertising accounts you might have will be suspended and so much more.
Next to that, its also opening a biggass hole because pritty much anyone who fakes the user agent will be able to browse your boards without ever registering.
1. i dont want google to be able to view my forums as registered.
2. its not a porn site. its a public site were everyones free to sign up and chat
3. the site that i want to allow to view the rss as registered user is my own site. since rss can't find out if the user is already logged in their so it can display the posts... stupid...
4. our forums is rc2.
would using ssi allow my site to get my cookies and find out if im logged in and display the last few posts?
im just trying to get the last few posts to display on another site on the same domain. but a subdomain though. but still same domain.
Lainaawould using ssi allow my site to get my cookies and find out if im logged in and display the last few posts?
Yes. And a lot more. :)
SSI FAQ's: http://www.simplemachines.org/community/index.php?topic=14906.0