[Accepted] Search Engines

BiErLeEuW · August 03, 2003, 05:21:34 PM

Is Simple Machines better for search machines?? I hope that the search machine could read the path to the right message

Joshua Dickerson · August 03, 2003, 06:10:06 PM

Pretty sure it is because it contains less crap in the query string. Haven't gotten much testing but there is a feature in discussion for non-IIS users to allow for even better SEO.

Juvenall Wilson · August 03, 2003, 06:47:46 PM

You know, I've never had any problems getting my SE installs spidered so even if it's the same thing I'd be happy..lol

Metho · August 03, 2003, 06:48:16 PM

Actually, looks like this site is once again using [Unknown]'s output buffering already? Is that gonna be standard or did he just put that in for fun?

Methonis

David · August 03, 2003, 06:50:38 PM

This site is running the build from the CVS, thus if you see it here it is part of the package.

Metho · August 03, 2003, 06:53:09 PM

Alrighty.

So to answer the original, yes, they'll be more spiderable.

Methonis

[Unknown] · August 03, 2003, 08:31:33 PM

Quote from: David on August 03, 2003, 06:50:38 PM
This site is running the build from the CVS, thus if you see it here it is part of the package.

The theme here is NOT in the CVS. But, yes the code is the same.

It's not using output buffering, it's built in.

-[Unknown]

David · August 03, 2003, 08:33:37 PM

Quote from: [Unknown] on August 03, 2003, 08:31:33 PM
The theme here is NOT in the CVS.

Ok fine, you got me there.

sensovision · August 03, 2003, 09:57:14 PM

hehe seems that this thread appear just when I was in the process of creating similar thread

And yeah Unknown's URL system is rulezzzzz it's best solution IMHO and it's make my forums crawlable in one day... I never seen that crawlers take so much pages for one session. I've already post it on the thread on YaBB SE.

BTW Unknown, will you be able to make buttons which switch between categories in same format as the rest URLs? as currently it's look like this:

Quoteindex.php?board=3;start=20

[Unknown] · August 04, 2003, 02:30:32 AM

I'm still considering making the start be /whatever. (like with the YaBB SE mod.) As a bultin feature it'd be EASY to implement...

-[Unknown]

Compuart · August 17, 2003, 12:24:08 AM

Took a shot at it. Converted the url's to look like index.php/t123/s20. Only modified the URL's that lead straight to the messages (so only the links on boardindex and messageindex), as that's where the crawler should go, and the less confusion the better I guess...

As the url-form doesn't seem to be supported on IIS, it's an option turned off by default.

(now let's see if this will be getting more than 5 results)

[Unknown] · August 17, 2003, 01:08:23 AM

Quote from: Compuart on August 17, 2003, 12:24:08 AM
Took a shot at it. Converted the url's to look like index.php/t123/s20. Only modified the URL's that lead straight to the messages (so only the links on boardindex and messageindex), as that's where the crawler should go, and the less confusion the better I guess...

As the url-form doesn't seem to be supported on IIS, it's an option turned off by default.

(now let's see if this will be getting more than 5 results)

Compuart, using my style: ?threadid=X/Y (where X is the threadid and Y is the start.) works fine and is already fininshed in the cvs... plus it works on IIS.

-[Unknown]

dschwab9 · August 17, 2003, 07:45:05 AM

Quote from: [Unknown] on August 17, 2003, 01:08:23 AM

Compuart, using my style: ?threadid=X/Y (where X is the threadid and Y is the start.) works fine and is already fininshed in the cvs... plus it works on IIS.

-[Unknown]

Don't some search engines not like URLs with question marks tho? Seems that's what tells it the page is dynamic and not to index it.

Compuart · August 17, 2003, 07:55:44 AM

that combined with the session ID that is added if a user has cookies disabled (as most crawlers have):
index.php?PHPSESSID=914e6a644c0e8d549685b0cfafeb5621&threadid=X/Y
vs.
index.php/p914e6a644c0e8d549685b0cfafeb5621/tX/sY

BiErLeEuW · August 17, 2003, 04:56:03 PM

but i want that also messages can be found by seach engines like phpBB got

Spaceman-Spiff · August 17, 2003, 05:39:29 PM

i like compuart's version better
but wont that require htaccess?

Compuart · August 17, 2003, 05:55:54 PM

apache can do this without htaccess

sensovision · August 17, 2003, 06:45:43 PM

I think both styles of URLs will work perfectly since they not contain session ID, and don't have semicolons which cause the problems for spiders. So I think this issue shouldn't be one to worry about.

[Unknown] · August 17, 2003, 07:27:18 PM

Compuart, the bigger issue is the fact that your way causes the use of two kinds of URLs. Not only does this make the code terrible, but this will DECREASE the search engine stuff because it counts off links to the ONE link, not versions of the link.

And I have a solution for the session id, okay? I just hadn't done it yet - didn't know it was IMPERITIVE or anything.

-[Unknown]

lbyard · September 15, 2003, 05:44:12 PM

Quote from: Juvenall Wilson on August 03, 2003, 06:47:46 PM
You know, I've never had any problems getting my SE installs spidered so even if it's the same thing I'd be happy..lol

That hasn't been my experience: http://www.simplemachines.org/community/index.php?threadid=1486.

Also, I think there is a need for an archiving capability to separate the day-to-day, short-term garbage from the good stuff that should be kept. Otherwise, the search engines, especially google, are going to assign a much lower quality rating to the overall content. Larry

News:

[Accepted] Search Engines