Does GOOGLE spider SMF without mod?

Started by zom, July 18, 2004, 02:40:09 AM

Previous topic - Next topic

Elegant John

Guys;

I've got google-bots crawling my site every single day without any special mods done. I've got the meta tags, adsense installed and that's about it.

http://www.latinagorditas.com is the site. I need to do the mod rewrite thing myself although finding time is the problem.

And by the way, yesterday. Google released a new tool/service that may take care of this problem.

Check out https://www.google.com/webmasters/sitemaps/. It's a hot topic right now in the blogosphere. I've done it to both of my blogs and are waiting for the results.

http://www.truckingmonkey.com & http://www.retromex.com


Harro

The search engine friendly url's in smf are great.
But I noticed they don't work anymore hwen you use mkportal.
So I don't have them anymore...  :(

Google won't crawl very deem into your forum, cuz it doesn't like those dynamic url's.
I had over 4000 topics/posts in google's index when I had phpbb with static url's, went down to 675 since I switched to smf and can't use them anymore, cuz I have mkportal.

Dannii

http://www.google.com.au/search?hl=en&lr=&q=+site:web.aanet.com.au+ftgforum

I'm only getting 7, although I'm sure i used to have more. possibly those are ones that google was linked to from elsewhere.
"Never imagine yourself not to be otherwise than what it might appear to others that what you were or might have been was not otherwise than what you had been would have appeared to them to be otherwise."

eddie43302

I got a question what template file of the smf templates do i change the meta information cause the meta that it is using now is the smf one, below is the meta its using

<meta name="keywords" content="PHP, MySQL, bulletin, board, free, open, source, smf, simple, machines, forum" />

Ben_S

Liverpool FC Forum with 14 million+ posts.

SeaOfSin

Quote from: Harro on June 05, 2005, 06:21:17 AM
The search engine friendly url's in smf are great.
But I noticed they don't work anymore hwen you use mkportal.
So I don't have them anymore...  :(

Google won't crawl very deem into your forum, cuz it doesn't like those dynamic url's.
I had over 4000 topics/posts in google's index when I had phpbb with static url's, went down to 675 since I switched to smf and can't use them anymore, cuz I have mkportal.

I have MKportal too and had it wrapped in the forum, but Idecided to try something this month and unwrapped it! and it really pushed my site high up in the search engines! I was lagging on the 5th page with one of my keywords and now I'm 3rd! :) 
And no-one on my forum yet has noticed a difference between when it was wrapped and unwrapped!! YAY!  Can you tell?

http://www.revolutionforum.net

I wrote a little php script and put it in my index.template to make it look (as close as I can get it!) to look like the MKPortal top banner and buttons (which I use) :)  I am even suprised by what I can do sometimes! from someone who says they cannot programme! :)

But it does make a big difference! and would say it really helps not to have them connected like that!

Sea Of Sin

Harro

Quote from: eddie43302 on June 05, 2005, 02:24:22 PM
I got a question what template file of the smf templates do i change the meta information cause the meta that it is using now is the smf one, below is the meta its using

<meta name="keywords" content="PHP, MySQL, bulletin, board, free, open, source, smf, simple, machines, forum" />

You only have to edit if for the default template btw, cuz that's the one that spiders will see.

@SeaOfSin: could be a good idea to try to get the left menu (and rights if you wish), also in the index.template.... Or just a little menu bar to the mkportal's "Main Menu" or something like that.
Think I'll give that a try after I finished my exams :)

I, Brian

Google certainly indexes the SMF forums here:
http://www.google.co.uk/search?q=site:www.simplemachines.org&num=100&hl=en&lr=&safe=off&filter=0

Shows 52,000 results.

Using the mod_rewrite function in the admin section could certainly help - but it is definitely worth making the distinction between Google actually *indexing* pages, and Google *ranking* pages.

In other words, just because a page is indexed, doesn't mean to say it will actually rank for anything on its own merits.

Google has always been a links-based search engine, so links into your sites and pages for relevant and descriptive keywords will certainly be helpful.




bluevoodu

Quote from: zom on July 19, 2004, 02:25:21 AM
could it be possible to have a sit_map page to help indexing like with phpbb. This php page contains all the leads to all the posts directely. If you know  scripting this could help: here is the code for phpbb:

Is that file for PHPBB .. or did you modify to use with smf? 

That would be PERFECT... if in XML format to be submitted to the Google Sitemap section.

Would this be possible to do?

I just got a file that will do this for my store:
www.egameaddiction.com/store/gsmap.php

We want you to join:
Chicken Dinner Gaming Community

[Unknown]


Champi

update, update... how about it.. you people have now some experiences with that sitemap...

i made me also some for my sites, put them in my rootdirectory, en submit them with google submit.. does it funktion?

i saw this topic was from  june.. perhaps some people have it running allready for that period..

greetz

andrejc

Hello everyone,
I have the same problem with google indexing my forum.Only main page is showed in results,but not forums or posts.I submited a XML site map,but nothing changed.When I used PHPbb,all forums and posts were indexed :(
Can you tell me what should I do to help google index all pages on my forum? www.andforum.net [nofollow]


Thank you

Thunderace

#33
Google indexes SMF very easily and with no mods.

However your change of forum software will mean that the links google was used to finding were all gone (it is finding bad links) .. it therefore may "sandbox" you for a while.

Ben_S

Page rank n/a. In other words google doesn't even know it exists let alone think it's important.

Liverpool FC Forum with 14 million+ posts.

andrejc

Quote
However your change of forum software will mean that the links google was used to finding were all gone (it is finding bad links) .. it therefore may "sandbox" you for a while.

And how long it can last?


andrejc

But google finds main page of my forum,how is then possible that he didn't find my site?

Ben_S

Because google doesn't care to look if you have no page rank.
Liverpool FC Forum with 14 million+ posts.

Thunderace

Google will take a cursery glance at your front page but it will only spider down through layers if it decides that you have a worthwhile site.

Advertisement: