SMF Support > SMF 2.0.x Support

Bot User Agents

<< < (4/4)

Arantor:
Something else I've noticed is that legitimate Google and MSN bots also send a 'From' header too, in case that's useful for tracking.

movierchives:
Does anyone know what the Facebook user agents are

I keep getting their bots, two examples
69.63.190.250
69.63.190.245

MrPhil:
Well, whois says those two IP addresses belong to Facebook, but they don't say anything about what they are. If there aren't any tools to look them up, you might temporarily add some code to index.php to log somewhere the $_SERVER['HTTP_USER_AGENT'] and $_SERVER['REMOTE_ADDR'] when the REMOTE_ADDR matches either of the two IP addresses. It could probably go into the error log, but you should check frequently so as not to fill up the log!

--- Code: ---include_once('Sources/Errors.php');
if ($_SERVER['REMOTE_ADDR'] == '69.63.190.250' || $_SERVER['REMOTE_ADDR'] == '69.63.190.245')
  log_error("IP: " . $_SERVER['REMOTE_ADDR'] . ", Agent: " . $_SERVER['HTTP_USER_AGENT']);
--- End code ---

This is not tested, so you may have to make some tweaks to it. Remove the code as soon as you get a hit on both addresses.

butchs:

--- Quote from: Arantor on July 10, 2012, 10:29:38 PM ---Something else I've noticed is that legitimate Google and MSN bots also send a 'From' header too, in case that's useful for tracking.

--- End quote ---

Interesting, I have not seen that in the US.

Igal-Incapsula:
Hi
You can verify Microsoft, FB and other user agents via Botopedia.org.
Once there, use Search to find out Bot details, including all user-agent data.
Also, on Bot Profile page you can cross-check the IP to find out if it's a legitimate one, for that specific Bot.

Here is a direct link to FB bot profile:

--- Code: ---www.botopedia.org/index.php?option=com_k2&view=item&id=313:facebook-external-hit
--- End code ---

Hope this helps.

Navigation

[0] Message Index

[*] Previous page