Googlebot & Spiders

[Assistance]

seems be the same problem I have now too


with the Who is mod the spiders show as spider on that page (who is online)
but on bottom of index they still show as guest

have all the options 'ticked'

[icman]

thank

[Charles LePage]

Found it!

Sources/Subs.php and Themes/yourtheme/Who.template.php need to be both updated.

        array (
            'agent' => 'FeedBurner',
            'spidername' => 'Feedburner/1.0',
            'spider' => true,
        ),
        array (
            'agent' => 'Feedfetcher-Google',
            'spidername' => 'Feedfetcher-Google',
            'spider' => true,
        ),
        array (
            'agent' => 'OmniExplorer_Bot',
            'spidername' => 'OmniExplorer_Bot/6.68',
            'spider' => true,
        ),

[Assistance]

Found it!

that makes sense ;/

ty

[Vinspire]

Found it!

Sources/Subs.php and Themes/yourtheme/Who.template.php need to be both updated.

        array (
            'agent' => 'FeedBurner',
            'spidername' => 'Feedburner/1.0',
            'spider' => true,
        ),
        array (
            'agent' => 'Feedfetcher-Google',
            'spidername' => 'Feedfetcher-Google',
            'spider' => true,
        ),
        array (
            'agent' => 'OmniExplorer_Bot',
            'spidername' => 'OmniExplorer_Bot/6.68',
            'spider' => true,
        ),

did anyone tried this and work ?

[Charles LePage]

I tried it, and it does work.

[Vinspire]

I tried it, and it does work.

Thanks but it seems like there is a lot of spiders crawling around ... How to list out all of them 

[Assistance]

I tried it, and it does work.

Thanks but it seems like there is a lot of spiders crawling around ... How to list out all of them 

I'm currently working on a huge list that everyone can just copy paste it in
unless someone else posts there list, mine will be up this weekend

[Vinspire]

I'm currently working on a huge list that everyone can just copy paste it in
unless someone else posts there list, mine will be up this weekend

Awesome ! would wait for the list

[Charles LePage]

Here are some of the ones I added recently:

        array (
            'agent' => 'FeedBurner/1.0',
            'spidername' => 'Feedburner',
            'spider' => true,
        ),
        array (
            'agent' => 'Feedfetcher-Google',
            'spidername' => 'Feedfetcher-Google',
            'spider' => true,
        ),
        array (
            'agent' => 'OmniExplorer_Bot/6.68',
            'spidername' => 'OmniExplorer_Bot',
            'spider' => true,
        ),
        array (
            'agent' => 'http://www.relevantnoise.com',
            'spidername' => 'relevantNOISE',
            'spider' => true,
        ),
        array (
            'agent' => 'NewsGatorOnline/2.0',
            'spidername' => 'NewsGatorOnline/2.0',
            'spider' => true,
        ),
        array (
            'agent' => 'ping.blo.gs/2.0',
            'spidername' => 'ping.blo.gs/2.0',
            'spider' => true,
        ),
        array (
            'agent' => 'Jakarta Commons-HttpClient/3.0.1',
            'spidername' => 'Amazon',
            'spider' => true,
        ),
          array (
            'agent' => 'Jakarta Commons-HttpClient/3.0-rc2',
            'spidername' => 'Amazon',
            'spider' => true,
        ),

[deadpoeticstar]

is there an update for RC3 yet?

[Vinspire]

is there an update for RC3 yet?

I dont think so as RC3 had not been released for public yet and only the charted member could get SMF 1.1 RC 3.

[deadpoeticstar]

i understand that but some mods have been updated for charter members use

[Vinspire]

i understand that but some mods have been updated for charter members use

Yeap but i don't this mod have an update for RC 3 yet as it had not been stated in the mod page

[deadpoeticstar]

Cause your not a charter member thats why and plus RC3 hasn't ben released yet to the public

[MayorNewton]

OK, 'noobie' question here...sorry for the stupidity.  What's the scoop about spiders...like, does one want them on their board or not?  Do they use a lot of bandwidth and cause a host to be pissed off, or are they a good thing to have on your forum? 

Thanks in advance...

Newt

[Bigguy]

No they don`t use alot of bandwidth and without spiders crawling your forum it would be pretty hard to get indexed on all the search engines.

[MayorNewton]

Thanks.  So, what does installing this mod and the other one recommended do for you...just let you know they're there, or allows you to direct what they're seeing?  Again, sorry for the noobie questions on this...just never dealt with it before.

Newt

[Bigguy]

It just allows you to see them. You will also see them registering and going to places like the admin panel but thats ok cause all there doing is following links.They can`t actually register or anything.

[MayorNewton]

Thanks, guy.  Doesn't sound like a mod I really need, then...just a 'FYI' kinda thing, eh? 

Cheers!

Newt