SMF Support > SMF 2.0.x Support
Bot User Agents
movierchives:
The Whois says their Microsoft, I always check because I ban the ones which are no good to me like the Baidu ones
Arantor:
Hmm, it's been at least a year since I saw a legitimate MSN bot that identifies itself as MSN bot...
movierchives:
--- Quote from: Arantor on July 10, 2012, 05:20:27 PM ---Hmm, it's been at least a year since I saw a legitimate MSN bot that identifies itself as MSN bot...
--- End quote ---
Nope still get them too so MS are duplicating the indexing.
I've also noticed two new ones. One called brandwatch (magpie-crawler) and Majestic-12 (MJ12bot) which are hammering away
EDIT: Oh and facebook and amazon ips!
Arantor:
Magpie and MJ12 are both blocked by several blocking tools for being abusive engines.
But all the hits I've seen from 'MSN' on my sites for months have all bots pretending to be MSN.
butchs:
It is easy to spoof a bot IP address. If you want to confirm it is legit then one method (that is not perfect) is to check the "X-Forwarded-For" list of IP addresses.
--- Quote ---per Wiki:
The general format of the field is: X-Forwarded-For: client, proxy1, proxy2
where the value is a comma+space separated list of IP addresses, the left-most being the original client, and each successive proxy that passed the request adding the IP address where it received the request from. In this example, the request passed proxy1, proxy2 and proxy3 (proxy3 appears as remote address of the request).
--- End quote ---
Any IP address in the list can access the information seen another IP address in the list.
For example you may get "X-Forwarded-For: 68.35.128.190, 157.55.16.86". SMF sees "157.55.16.86" But "68.35.128.190" has a Project Honey-pot threat rating of 17 or worse...
Therefore, based on the information you provided one can only assume the ip address visiting your site is correct.
::)
Navigation
[0] Message Index
[#] Next page
[*] Previous page
Go to full version