Googlebot & Spiders

[Spoogs]

Any chance of a 2.0 RC3 port ?

You answer is here

curious if i can get something like this for 1.1.11

This works fine on 1.1.11.

Please, could you update to SMF 2.0 RC3? Thanks

2.0 has built in support to track spiders.

[MoreBloodWine]

Any chance of a 2.0 RC3 port ?

You answer is here

curious if i can get something like this for 1.1.11

This works fine on 1.1.11.

Please, could you update to SMF 2.0 RC3? Thanks

2.0 has built in support to track spiders.

This "built in" support would be anabled how ? Also, I would only find the built in support useful it it had the exact same options as this mod. So lets for arguments sake assume that it doesnt then this mod would still be useful to many people like me ;-)

[TheListener]

Features and options > members > search engines

[Spoogs]

1st
Admin -> Configuration -> Core Features -> Search Engine Tracking (turn in on and click save)

2. - Brack1 said
yoursite/index.php?action=admin;area=sengines

[MoreBloodWine]

1st
Admin -> Configuration -> Core Features -> Search Engine Tracking (turn in on and click save)

2. - Brack1 said
yoursite/index.php?action=admin;area=sengines

Found it thx, but I really prefer the way this mod shows them compared to

6 Guests, 1 User (1 Spider)

Users active in past 30 minutes:
MoreBloodWine, Yahoo!


With this mod spiders were in their own list and removed from the guest count so instead of the above we'd expect to see something like this...

5 Guests, 1 User, 1 Spider

Users active in past 30 minutes:
MoreBloodWine

Spiders active in past 30 minutes:
Yahoo!


Although most people could cae less about this I prefer this formatting better.

Edit: As far as this mod goes, how does it know what a spider is. I assume there's some sort of array that constantly needs updating like the grouped who file. The same goes for the SMF 2.0 thing, asuming there's a spider array how in the heck would you even update that since AFAIK there's no mod or editable array for it so when new spiders are found it looses effectiveness.

See, I love being able to track spiders and such but not being able to track them all due to non editable arrays when new spiders are found makes any spider system useless after a while. Even so, adding spider after spider when they're found would become an annoying task after a while. What I would LOVE to see is a mod like Stop Spammer but for spiders, so instead of checking a DB for spammer IP's and whatnot it checks a DB of spiders and then lists them accordingly on your site.

[Sheepy]

The standard way to detect spiders are by their agent string.  Usually an internet device will send an id, for example iPhone's Safari will say "Mozilla/5.0 (iPhone ... Safari/419.3" and Firefox will say "Mozilla/5.0 (Windows ... Firefox/3.6.8".

Spiders are the same. If you see "Googlebot/2.1 ..." you know it's google.  If you see "YahooSeeker/1.0 ..." you know it's Yahoo.

Before you ask, yes, this id can be faked.  And yes they will change, but there is usually a pretty stable part that you can use to identify them.  Like "googlebot" or "yahooseeker".

SMF 2.0 allows you to update your spider list.  But I'm not aware of a centralised spider agent database...

[lastminute]

Wow nice mod, will try to figure out this.

[Kat9119]

Ok, got this working on 1.1.11, but I'm curious if I can get the different bots names in different colors. I've seen this asked around here, but not answered.

Thanks!

Anyone? I think it would look better then being the same color as other people....

[Omar Bazavilvazo]

hmm... i find interesting ppl still like this mod

Any open issues? requests? recommendations?

[MoreBloodWine]

One request yes and some people wouldnt agree with me but 2.0 support.

YES, I know 2.0 has spider support but this mod manages and displays them so much better which is why I feel this mod should be updated to 2.0 standards.

[MoreBloodWine]

One request yes and some people wouldnt agree with me but 2.0 support.

YES, I know 2.0 has spider support but this mod manages and displays them so much better which is why I feel this mod should be updated to 2.0 standards.

Sorry if this sounds dumb but aside from the above quote of mine, how can I edit the aray of spiders to use the same aray that I use in my custom Who.template.php which you actually link to fro mthe mod page which BTW, Ty for that.

I ask because I noticed YandexBot/3.0 comes up in my seperated who list but not labeled as a spider in this mod... it shows as a guest. I figure I can just copy my entire Spider aray from my custom Who.template.php and overwrite the spider aray currently in this mod this way what the file labels as a spider then this mod will as well.

All that aside, I just wanted to restate that I really would love to see a copy of this mod made for 2.0. Wether or not you do it is up to you but I honestly like the way this mod handles and labels them compared to the SMF 2.0 settings for that. I would also assume it a safe bet that I'm not the only one who feels this way either.

[link3d]

Awesome mod.  Thanks!

[crustybum]

Sorry, which one works for RC3?

[moviespot]

Please, kindly update it to work for 2.0 RC4

[cschelin]

Another vote for upgrading to 2.0. I can see spiders in my logs but I liked seeing that Bing wasn't able to follow robots.txt instructions   I did just install 2.0 rc4 so I don't know yet if spiders and guests count towards the daily total. Last year we had a severe spike of guests and it turned out that it was Microsoft hammering the site to the point of making access slow for my regular members.

Thanks.

Carl

[Galaxy Computers]

Will this mod work on version 2.0 RC4?

[IchBin™]

Unless it's posted in this topic somewhere, it is not working for SMF2 at all.

[Galaxy Computers]

No,, and it is enable.

[steveraven]

Hi,

Tried installing this mod on SMF 1.1.13 using blackbox theme and didn't work.
So I installed the who.template.php file to my server, still didn't work.

But it IS working if I revert back to the SMF core default theme.

And when I went back to blackbox it had disappeared again.

If I have to install manually, I noticed that there's a bit at the bottom entitled 'CODE' - I can handle the files edits no problem, but what do I do with the 'CODE' snippets?

[valpo04]

I copied a template from another forum I run with this mod installed and then installed this mod on my new forum and now I have double of everything... double listing of the bots in the online list and the "Google visited last this page March 13, 2011, 12:15:11 PM " at the bottom of the page is listed twice.  Anyone know how to fix this?

(Also, any way to change that line to say "Google last visited..." instead of "Google visited last...")

Thanks!