News:

Bored?  Looking to kill some time?  Want to chat with other SMF users?  Join us in IRC chat or Discord

Main Menu

Googlebot & Spiders

Started by Omar Bazavilvazo, June 06, 2005, 06:17:35 PM

Previous topic - Next topic

TrueSatan

Given those errors I doubt that the mod will work (haven't checked the code though) and, personally, I don't keep mods that give errors on my sites. It isn't the mod's fault in this case but all the same you don't benefit from a full error log. To be frank the keeping of a log of the visits of bots and spiders isn't a vital issue for most forum owners so it's not the biggest loss in the world.

gemigene

Quote from: TrueSatan on January 02, 2008, 07:15:14 PM
Given those errors I doubt that the mod will work (haven't checked the code though) and, personally, I don't keep mods that give errors on my sites. It isn't the mod's fault in this case but all the same you don't benefit from a full error log. To be frank the keeping of a log of the visits of bots and spiders isn't a vital issue for most forum owners so it's not the biggest loss in the world.

The only reason I installed it is that yesterday, I had 14 Yahoo Bots on my forum which were counted as visitors on my "Most Online" stats line and wanted a way to circumvent this from happening (Bots being counted as "guests").

Cheers,
Gene
"Religion is metaphysical statism. I will be ruled by no man on earth, nor by any god in heaven"

TrueSatan

This mod won't stop them but stopping them is easy to do...see the following link for details:

http://www.robotstxt.org/

gemigene

Quote from: TrueSatan on January 02, 2008, 07:37:12 PM
This mod won't stop them but stopping them is easy to do...see the following link for details:

http://www.robotstxt.org/

I do have a robots.txt file in my root directory and I don't want Google or any of the major search engines stop crawling my board (I do want to be indexed) but it's that darn counting Spiders as guests that I don't really care for.

Cheers,
Gene
"Religion is metaphysical statism. I will be ruled by no man on earth, nor by any god in heaven"


gemigene

Quote from: TrueSatan on December 31, 2007, 04:51:23 AM
@ MoreBloodWine

Personally I tend to have some stock answers handy for such situations and so it's not a lot of bother to just cut and paste them in the reply box...it also means that I can spend more time on the members who do read the past postings and do try to help themeselves...pasting in stock answers gives the people the information they need so nobody loses and your blood pressure stays managable.

LOL! Good stuff. There's a Mod for phpBB 2.0.22 for "canned responses", all you have to do is type the text in once for any usual question you answer and when you need it, pick it out from a drop-down box.

BTW, even though I had these errors, it's working. I was swarmed by Yahoo Bots and the Mod worked as expected except that it showed the Bots first (19 Spiders, 0 Guests, 1 User) instead of showing Spiders last.

Also installed that modded Who.template, works great!

Thanks for the help,
Gene
"Religion is metaphysical statism. I will be ruled by no man on earth, nor by any god in heaven"

gemigene

According to my previous post, I would like to show Spiders last (1 Guest, 1 User, 4 Spiders) and been playing around with this bit of code in Boardindex.template.php and I just can't get the commas and spaces in the right place.

Can anyone figure this out:
echo '
', $context['show_who'] ? '<a href="' . $scripturl . '?action=who">' : '', (empty($context['spiders']) ? '' : $context['num_spiders'] . ' ' . ($context['num_spiders'] == 1 ? $txt['ob_googlebot_spider'] : $txt['ob_googlebot_spiders']) . ', '), $context['num_guests'], ' ', $context['num_guests'] == 1 ? $txt['guest'] : $txt['guests'], ', ' . $context['num_users_online'], ' ', $context['num_users_online'] == 1 ? $txt['user'] : $txt['users'];



Thanks,
Gene
"Religion is metaphysical statism. I will be ruled by no man on earth, nor by any god in heaven"

Rabain

I installed the Googlebot & Spiders mod in the Core theme (this is the only theme I use across the site) and I installed the whois template for the spiders as well.

I can see the Spiders when i click the who's online button so I'm assuming the whois template worked.

However on the main forum page there is no difference...spiders and bots still show as Guests.  There are no options in the Admin control panel to show settings for the Googlebot & Spiders mod but the mod is a green light for installed succesfully.

What has gone wrong here?

gemigene

#1448
Did you activate it in the ACP?

ACP -> Features and Options -> Googlebot & Spiders?

You'll also have to set permissions for who gets to see them.

Cheers,
Gene

p.s. anyone want to help me with my previous post?
"Religion is metaphysical statism. I will be ruled by no man on earth, nor by any god in heaven"

Rabain

Thats what I mean...under Packages it says it is installed but there is nothing under Features and Options regarding Googlebot and Spiders.  Nothing at all!

From what I've read above it sounds like the same that happens if you have a custom theme...but I don't have a custom theme...I'm just using the core smf theme.

TrueSatan

@ Rabain

The likely reason is:

You need to go to ACP>Server Settings and set your forum language to English and not English utf8 and to ACP>Features and Options>Basic Settings and uncheck Enable user-selectable language support.

Rabain

Unfortunately for me both those options are already at the settings you mention.

By the way I do have the latest version of TP installed.

TrueSatan

TP shouldn't affect this mod...thanks for mentioning it though as it's always useful to have as much information as possible.

Please check modifications.english.php in you theme's language directory to see if you have the following strings in place in it:

// OB - Googlebot - Begin

// Boardindex Strings
$txt['ob_googlebot_modname'] = 'Googlebot & Spiders';
$txt['ob_googlebot_spider'] = 'Spider';
$txt['ob_googlebot_spiders'] = 'Spiders';
$txt['ob_googlebot_spiders_last_active'] = 'Spiders active in past ' . $modSettings['lastActive'] . ' minutes';

// ModSettings
$txt['ob_googlebot_count_all_instances'] = 'Count all instances of same spider';
$txt['ob_googlebot_display_all_instances'] = 'Display all instances of same spider <div class="smalltext">("' . $txt['ob_googlebot_count_all_instances'] . '" must be selected)</div>';
$txt['ob_googlebot_display_agent'] = 'Display agent instead of name';
$txt['ob_googlebot_display_own_list'] = 'Display spiders in its own list';
$txt['ob_googlebot_count_most_online'] = 'Count in "Most Online"';
$txt['ob_googlebot_redirect_phpsessid'] = 'Redirect PHPSESSID URLs';

// Stats
$txt['ob_googlebot_stats_lastvisit'] = 'Google visited last this page ';

// Permissions
$txt['permissiongroup_googlebot'] = $txt['ob_googlebot_modname'];
$txt['permissionname_googlebot_view'] = 'View Googlebot & Spiders';

// OB - Googlebot - End


If they aren't there please add them but their not being there would also make me want to have you check, by way of the process of a manual install, that all edits etc the mod seeks to make are in place as one being missing would make the rest in question.

Rabain

Those entries are in the file.

I have a feeling there is something basic I'm missing here.

TrueSatan

Firstly when you installed the mod were any failed files shown?

As a little housekeeping so as to get things right before we go further:

You need to go to ACP>Packages>Options>Installation Options and set the fields according to your hosting details then on the same page go to Cleanup Permissions and select All files Writeable and run the cleanup...check via ftp that CHMOD of all your files is now 777 or 775 according to the peculiarities of your hosting and if not recheck the settings you made in Installation Options and run the cleanup again...continue as needed until you get the right settings.

Following that you need to check the process of a manual install as I mentioned above:

Please read:

http://docs.simplemachines.org/index.php?topic=402.msg531#msg531

http://www.simplemachines.org/community/index.php?topic=34526.0

The following may also prove helpful:

http://modparser.dev.dansoftaustralia.net/

Mirror of the last link:

http://www.smfhacks.com/smf-package-parser.html


If your forum settings are as you say they are (not disbelieving you!) then there must be something missing in the rest of the installation and checking the files is the only way to make sure of that and to put it right.

Rabain

Thanks for the tips, there was an issue about permission when I first tried to install the mod...though when I manually Chmodded the folders and created a temp directory in the Packages folder it installed with no errors.

I will try your other suggestions.

TrueSatan

It's not common, but I've seen instances where the file ownership on a server is incorrect (can be fixed by the sysadmin using CHOWN) and the user setting CHMOD to 777/775 doesn't really give a 777/775 permission set...bit of a long shot I'll admit but that could be the problem you have.

jenkai

#1457
hi everybody,

i'm a french guy so sorry fo my poor english language.

I use SMF 1.1.4 with the "AA_new_damage" template, and i have some problems with GoogleBot 2.0.3

In a first time i had an error with the instalation:

i had this message
QuoteIncorrect table name `` in .../code.php

so i had make some modifications in this file like this:

<?php

db_query
("INSERT IGNORE INTO {$db_prefix}settings (`variable`, `value`) VALUES ('ob_googlebot_count_all_instances', '1')"__FILE____LINE__);
db_query("INSERT IGNORE INTO {$db_prefix}settings (`variable`, `value`) VALUES ('ob_googlebot_display_all_instances', '1')"__FILE____LINE__);
db_query("INSERT IGNORE INTO {$db_prefix}settings (`variable`, `value`) VALUES ('ob_googlebot_display_agent', '0')"__FILE____LINE__);
db_query("INSERT IGNORE INTO {$db_prefix}settings (`variable`, `value`) VALUES ('ob_googlebot_display_own_list', '0')"__FILE____LINE__);
db_query("INSERT IGNORE INTO {$db_prefix}settings (`variable`, `value`) VALUES ('ob_googlebot_count_most_online', '0')"__FILE____LINE__);
db_query("INSERT IGNORE INTO {$db_prefix}settings (`variable`, `value`) VALUES ('ob_googlebot_redirect_phpsessid', '1')"__FILE____LINE__);
db_query("INSERT IGNORE INTO {$db_prefix}settings (`variable`, `value`) VALUES ('ob_googlebot_stats', '1')"__FILE____LINE__);

db_query("
CREATE TABLE IF NOT EXISTS 
{$db_prefix}ob_googlebot_stats (
  `agent` varchar(40) NOT NULL default '',
  `board` varchar(20) NOT NULL default '',
  `topic` varchar(20) NOT NULL default '',
  `url` varchar(100) NOT NULL default '',
  `lastvisit` int(10) unsigned NOT NULL default '0',
  `frequency` int(10) unsigned NOT NULL default '0',
  `visits` int(10) unsigned NOT NULL default '0',
  `timestamp` timestamp(14) NOT NULL,
  KEY `agent` (`agent`),
  KEY `board` (`board`),
  KEY `topic` (`topic`),
  KEY `url` (`url`)
)"
__FILE____LINE__);

?>



and after it succefully instaled.

i've added "Modifications.french.php" in the "/theme/default" directory (my forum is in french).

and i added the Mod of "Who.template.php".

So i cannot see any spiders name in se home page when any of this is connected on the forum.

But when i clicking on "Who online" i see this name with the mod of "Who.template.php".

i have these otions:
Quote
   Count all instances of same spider     Actived
   Display all instances of same spider    Actived
   Display agent instead of name         Actived
   Display spiders in its own list     Not Actived
   Count in "Most Online"        Not Actived
   Redirect PHPSESSID URLs        Actived

Can you help me?

My forum is hxxp:www.32eme.net/joomla/forum_smf/ [nonactive]

EDIT: I also manualy modified "BoardIndex.php" and "Index.template.php" files of AA_New_dammage theme with the modification inclued in "Modifications.xml" for thes files.

these modifications:
<file name="$themedir/index.template.php">
<operation>
<search position="before"><![CDATA[
if ($context['show_load_time'])
echo '
<span class="smalltext">', $txt['smf301'], $context['load_time'], $txt['smf302'], $context['load_queries'], $txt['smf302b'], '</span>';]]></search>
<add><![CDATA[

if (isset($context['ob_googlebot_stats']))
echo '
<br /><br /><span class="smalltext">', $txt['ob_googlebot_stats_lastvisit'], timeformat($context['ob_googlebot_stats']['Googlebot']['lastvisit']), '</span>';]]></add>
</operation>
</file>


<file name="$themedir/BoardIndex.template.php">
<operation>
<search position="after"><![CDATA[$context['num_guests'], ' ', $context['num_guests'] == 1]]></search>
<add><![CDATA[(empty($context['spiders']) ? '' : $context['num_spiders'] . ' ' . ($context['num_spiders'] == 1 ? $txt['ob_googlebot_spider'] : $txt['ob_googlebot_spiders']) . ', '), ]]></add>
</operation>

<operation>
<search position="before"><![CDATA[', $txt[140], ':<br />', implode(', ', $context['list_users_online']);]]></search>
<add><![CDATA[

if (!empty($context['spiders']))
{
if ($modSettings['ob_googlebot_display_own_list'])
echo '
<br />
', $txt['ob_googlebot_spiders_last_active'], ':<br />';
else
{
if (empty($context['users_online']))
echo '
', $txt[140], ':<br />';
else
echo ', ';
}

echo implode(', ', $context['spiders']);
}]]></add>
</operation>
</file>


and it's not work  :(

khokon

Hi all,
i try to install GoogleBot 2.0.3 in my forum Powered by SMF 1.1.4 (defult theam)
i use flowing mod
1. Ad Revenue Sharing 1.2   
2. SMF 1.0.12 / 1.1.4 / 2.0 b1.1 Update 1.0
3. Hide SMF Version 1.0 4. Integrated Chat 2.9   
5. Invite 1.14   6. Google Talk Field 1.0.3   
7. Googlebot & Spiders Mod 2.0.3 

the below massege is show, when i try to install the mod.




!!Error in Package Installation

At least one error was encountered during a test installation of this package. It is strongly recommended that you do not continue with installation unless you know what you are doing, and have made a backup very recently. This error may be caused by a conflict between the package you're trying to install and another package you have already installed, an error in the package, a package which requires another package that you don't have installed yet, or a package designed for another version of SMF.
5. Execute Modification ./Sources/ModSettings.php Test failed


what can i do? plz help me.
Best forum for sharing adsense revenue so far in the world http://forum.alljobsbd.com [nofollow]

TrueSatan

Your error is a variant on the most common error of all those reported on these pages...it tells you that another mod you have installed has already edited the file(s) in question and that you thus need to do a manual installation of this mod. Please read:

http://docs.simplemachines.org/index.php?topic=402.msg531#msg531

http://www.simplemachines.org/community/index.php?topic=34526.0

The following may also prove helpful:

http://modparser.dev.dansoftaustralia.net/

Mirror of the last link:

http://www.smfhacks.com/smf-package-parser.html

Advertisement: