topicseen at the end of a URL

[stylusss]

Could some tell me how I could block google from crawling urls that end with topicseen?

[Kill Em All]

In your robots.txt file, include:

Code Select Expand


Disallow: *topicseen

[Oldiesmann]

Not sure how Google is even finding those links, as they shouldn't be displayed to guests, but this should take care of it.

Sources/Display.php

Find

Code Select Expand

// Find the previous or next topic.  Make a fuss if there are no more.

Add before that

Code Select Expand

if (isset($_REQUEST['topicseen']))
{
$context['robot_no_index'] = true;
}

[stylusss]

Does Kill Em All's suggestion work as well? I used his for the time being.

[stylusss]

Not sure how Google is even finding those links, as they shouldn't be displayed to guests, but this should take care of it.

Sources/Display.php

Find

Code Select Expand

// Find the previous or next topic.  Make a fuss if there are no more.

Add before that

Code Select Expand

if (isset($_REQUEST['topicseen']))
{
$context['robot_no_index'] = true;
}

I tried your suggestion, Oldiesmann, because I got an error from google, presumably because of Kill em all's suggestion.

[mrintech]

I tried your suggestion, Oldiesmann, because I got an error from google, presumably because of Kill em all's suggestion.

What error?

[stylusss]

I tried your suggestion, Oldiesmann, because I got an error from google, presumably because of Kill em all's suggestion.

What error?

My adsense said that over 1000 pages couldn't get crawled because of the "topicseen" restriction

[mrintech]

My adsense said that over 1000 pages couldn't get crawled because of the "topicseen" restriction

Just enter this line in robots.txt

User-agent: MediaPartners-Google
Allow: /

Above lines of code will not restrict AdSense bot from crawling any part of your forum

[stylusss]

True, but on the contrary, I don't want adsense crawling:

printpage, *wap*, *wap2*, and *imode*.

So that wouldn't work right?

[mrintech]

Then you need to use something like this:

User-agent: MediaPartners-Google
Allow: /
Disallow: /*wap2
Disallow: /*wap
Disallow: /*?action


........