Advertisement:

Author Topic: Do SMF posts appear in search engines? (Something to be concerned about)  (Read 139791 times)

Offline geezmo

  • Full Member
  • ***
  • Posts: 441
Re: Do SMF posts appear in search engines? (Something to be concerned about)
« Reply #20 on: September 14, 2006, 10:40:15 PM »
These are the links used in vB:

Look at this thread from vBulletin.com

http://www.vbulletin.com/forum/showthread.php?t=142051

The links of posts 1-4 are:

Quote
Post 1: http://www.vbulletin.com/forum/showpost.php?p=884772&postcount=1
Post 2: http://www.vbulletin.com/forum/showpost.php?p=884784&postcount=2
Post 3: http://www.vbulletin.com/forum/showpost.php?p=884786&postcount=3
Post 4: http://www.vbulletin.com/forum/showpost.php?p=884798&postcount=4

The links use a variety of URLs (p=884772&postcount=1, p=884784&postcount=2, p=884786&postcount=3, p=884798&postcount=4) while SMF uses:

Quote
site.com/?topic=123.0
site.com/?topic=123.msg1
site.com/?topic=123.msg2

Google probably hates the variations in the URL for the same page: msg1, .msg2, .msg3 ....
« Last Edit: September 14, 2006, 10:44:33 PM by geezmo »

Offline Harzem

  • SMF Hero
  • ******
  • Posts: 5,384
  • Gender: Male
  • I know, my avatar is nerve-wracking!
Re: Do SMF posts appear in search engines? (Something to be concerned about)
« Reply #21 on: September 15, 2006, 03:34:52 AM »
SMF has about 21 links to the same page.

site.com/?topic=123.0
site.com/?topic=123.msg1
site.com/?topic=123.msg2
<>

vB does exactly the same thing.

No, at least I couldn't find any single duplicate link up to now.

Geezmo pointed that but slightly wrong. The duplicate links in vB are single post links that include different content. Try clicking on geezmo's links and you'll see what I mean.

Offline geezmo

  • Full Member
  • ***
  • Posts: 441
Re: Do SMF posts appear in search engines? (Something to be concerned about)
« Reply #22 on: September 15, 2006, 04:23:02 AM »
At least we're going somewhere here. I hope the SMF coders are watching us here, cos this will definitely help solve the problem that's hindering SMF from being a forum that can beat vB. I hope Google would reply already to the question I sent them on why Google does not display SMF posts.

Offline bjp

  • Jr. Member
  • **
  • Posts: 163
Re: Do SMF posts appear in search engines? (Something to be concerned about)
« Reply #23 on: September 15, 2006, 07:06:07 AM »
I agree. This is a real probleme. I have 2 boards, one is phpbb and the other is SMF. Phpbb is much more link by google.
for exemple:
- smf (361 483 messages) and only 3 250 pr├ęsents in Google
- phpbb (372 601 messages) and only 54 211 pr├ęsents in Google

Offline Nikolas_00

  • Semi-Newbie
  • *
  • Posts: 58
    • Webdigity webmaster community
Re: Do SMF posts appear in search engines? (Something to be concerned about)
« Reply #24 on: September 18, 2006, 03:54:42 AM »
Hello fellas, I made a modification that can really help you with this, the archive for SMF.

You can sheck the results here : http://www.google.com/search?hl=en&q=site%3Awww.webdigity.com&btnG=Google+Search

Offline geezmo

  • Full Member
  • ***
  • Posts: 441
Re: Do SMF posts appear in search engines? (Something to be concerned about)
« Reply #25 on: September 18, 2006, 04:28:31 AM »
Hi Nikolas, good to see you here. I've installed your Archive mod last week, let's see if this is really effective and when this would bring results.

In any case, I think this should not stop SMF developers from finding out why Google does not list SMF threads as search results. Much is really being lost when an SMF forum does not appear in Google.

Offline dave

  • Jr. Member
  • **
  • Posts: 157
  • Gender: Male
  • Catch and Release
Re: Do SMF posts appear in search engines? (Something to be concerned about)
« Reply #26 on: September 19, 2006, 10:26:55 PM »
I agree
i ran a phpnuke site  (yes i learned the hard way about it getting hacked also)
but all be dammed if i posted something the very next week it was in google no issues

then i switched my site over  *( after nuke was hacked) to smfand it ran for  a year or so
and the search engine stuff was never ever the same :(

although nuke got hacked i was slamming with hits and visitors...

I just re opened the site sunday with SMF again
there are few posts and it will grow again.. but i know the hits wont be the same

I run 2 sites now
handgunplace.com
and basslurereviews.com
both SMF



Offline dave

  • Jr. Member
  • **
  • Posts: 157
  • Gender: Male
  • Catch and Release

Offline geezmo

  • Full Member
  • ***
  • Posts: 441
Re: Do SMF posts appear in search engines? (Something to be concerned about)
« Reply #28 on: October 08, 2006, 11:17:01 AM »
Just discovered that Yahoo can properly index my forum and some of my forum posts appear as search results in Yahoo. Unfortunately, majority of net users use Google to search and that's where our forum posts fail to show up.

Offline simonm

  • Semi-Newbie
  • *
  • Posts: 14
    • http://www.site-xyz.com
Re: Do SMF posts appear in search engines? (Something to be concerned about)
« Reply #29 on: October 10, 2006, 02:33:45 PM »

did anyone contacted google staff about it? what is theirs side of story ?

Offline geezmo

  • Full Member
  • ***
  • Posts: 441
Re: Do SMF posts appear in search engines? (Something to be concerned about)
« Reply #30 on: October 10, 2006, 08:15:26 PM »
No reply to my email in Google after a month :( There's also a pending question in the Google Groups board about SMF posts not appearing in Google but no one still has replied to it...

Offline dave

  • Jr. Member
  • **
  • Posts: 157
  • Gender: Male
  • Catch and Release
Re: Do SMF posts appear in search engines? (Something to be concerned about)
« Reply #31 on: October 25, 2006, 05:20:22 PM »
I switched my bass site to Vb and vbseo and traffic has been great

Offline geezmo

  • Full Member
  • ***
  • Posts: 441
Re: Do SMF posts appear in search engines? (Something to be concerned about)
« Reply #32 on: October 26, 2006, 04:05:37 AM »
Wait for some months and those vB posts will appear in Google. Not sure whether posts in your SMF forum will be there too by that time. :(

Offline Ben_S

  • SMF Friend
  • SMF Super Hero
  • *
  • Posts: 11,724
  • xxx
Re: Do SMF posts appear in search engines? (Something to be concerned about)
« Reply #33 on: October 26, 2006, 08:49:00 AM »
The only reason I can think of for topics not doing to well is the duplicate links to the same content, google supports wildcards in robots.txt so something like this may help.

Code: [Select]
User-agent: Googlebot
Disallow: /forum/*.msg*
Disallow: /forum/*sa=showPosts*
Disallow: /forum/*prev_next*
Disallow: /forum/*action=printpage*
Disallow: /forum/*action=recent*
Liverpool FC Forum with 14 million+ posts.

Offline geezmo

  • Full Member
  • ***
  • Posts: 441
Re: Do SMF posts appear in search engines? (Something to be concerned about)
« Reply #34 on: October 26, 2006, 10:18:01 AM »
Have you already tried that in your site, Ben_S?

Went to your Liverpool FC forum, congrats, that's a really huge forum. But still are you not concerned  that out of 2.3 million posts, only 1,000+ entries appear in Google search results, and most are not even threads or posts?

http://www.google.com/search?hl=en&q=site%3Aredandwhitekop.com%2Fforum&btnG=Google+Search

Google.com - site:redandwhitekop.com/forum

Results 1 - 10 of about 1,640 from redandwhitekop.com/forum for . (0.04 seconds)

Offline Ben_S

  • SMF Friend
  • SMF Super Hero
  • *
  • Posts: 11,724
  • xxx
Re: Do SMF posts appear in search engines? (Something to be concerned about)
« Reply #35 on: October 26, 2006, 10:49:45 AM »
Have you already tried that in your site, Ben_S?

I added it ~ 20 days ago, whether it helps or not will take a little while to show up.

The duplicate content issue is the only thing I can think of that would be causing topics not to index well, unless others have any thoughts on what may be causing it.
« Last Edit: October 26, 2006, 10:55:07 AM by Ben_S »
Liverpool FC Forum with 14 million+ posts.

Offline Harzem

  • SMF Hero
  • ******
  • Posts: 5,384
  • Gender: Male
  • I know, my avatar is nerve-wracking!
Re: Do SMF posts appear in search engines? (Something to be concerned about)
« Reply #36 on: October 26, 2006, 01:16:52 PM »
@vbgamer45, I already sent an email to Google's support. Hopefully, they'd reply and you can use that to tweak SMF's codes.

Thanks for doing that. Please inform me about their reply.

vbgamer45, I don't know the problem but it can be the individual message links that connect to the same page. Google doesn't like different links to the same content, but SMF has about 21 links to the same page.

site.com/?topic=123.0
site.com/?topic=123.msg1
site.com/?topic=123.msg2
site.com/?topic=123.msg3
site.com/?topic=123.msg4
site.com/?topic=123.msg5
...
site.com/?topic=123.msg19
site.com/?topic=123.msg20


These are all the same page, but different links. Google doesn't like it.
http://www.google.com/support/webmasters/bin/answer.py?answer=35769
Quote
Don't create multiple pages, subdomains, or domains with substantially duplicate content.

I had also stated this in the first page.

vBulletin has links to posts exactly the same way, but not publicly. You only have those links in your emails. In regular surfing, these don't show up.

Maybe considerable for SMF ::)

Offline geezmo

  • Full Member
  • ***
  • Posts: 441
Re: Do SMF posts appear in search engines? (Something to be concerned about)
« Reply #37 on: October 26, 2006, 01:18:22 PM »
Hopefully we'll see some good results soon. I'll add those codes to my robots.txt file too.

Offline RRasco

  • Jr. Member
  • **
  • Posts: 367
    • CBR Extreme
Re: Do SMF posts appear in search engines? (Something to be concerned about)
« Reply #38 on: October 26, 2006, 01:24:58 PM »
i hope we can find a solution to this soon.  i am currently redesigning my site to run SMF instead of phpBB.  i have a SEO for phpBB and every single one of my threads shows up in google.  its the word content on the threads that get me all my traffic, if i dont have google, i dont have traffic.
Vehicle Management System for SMF - SMFGarage.com

Offline R-S_Doug

  • Newbie
  • *
  • Posts: 4
Re: Do SMF posts appear in search engines? (Something to be concerned about)
« Reply #39 on: October 26, 2006, 01:43:58 PM »
Oh dear, this is not cool. This google search for "Do SMF posts appear in search engines";

hxxp:www.google.com/search?q=%22Do+SMF+posts+appear+in+search+engines%22 [nonactive]

doesn't return any results*, and a search for "geezmo" returns only the profile and user statistics, no posts or threads.

 :'(

*Update, now it does, one hit titled 'latest posts of dave'

Update two, this search;

hxxp:www.google.com/search?&q=site%3Awww.simplemachines.org+geezmo&btnG=Search&meta= [nonactive]

gives 400+ results, so there are posts making it to the serps, they just don't rank.
« Last Edit: October 26, 2006, 02:44:23 PM by R-S_Doug »