Do SMF posts appear in search engines? (Something to be concerned about)

Started by geezmo, September 06, 2006, 09:16:08 PM

Previous topic - Next topic
Print
Go Down Pages 1 ... 7 8 9 10 11 ... 15
User actions

MegaTinkerCoder

#160
January 04, 2007, 07:56:34 PM
The following links google has errors for on my site:
I removed my domain name as to not advertise my site hear aka keeping to the TOS

http://www.?.com/forum/Themes/Musiconica/images      4xx error   [?]      Dec 31, 2006
http://www.?.com/forum/Themes/Musiconica/images/    403 (Forbidden)   [?]    Dec 31, 2006
http://www.?.com/forum/Themes/default/images    4xx error   [?]    Dec 25, 2006
http://www.?.com/forum/Themes/default/images/    403 (Forbidden)   [?]    Dec 25, 2006
http://?/forum/...=054db1cc3c13475812063886fda7f4c6;sound    408 (Request timeout)   [?]    Dec 20, 2006

Google is trying to get to themes images, thats not surprising as I removed the /Themes/ entry from my robots.txt file, what is surprising is that there is an entry with ;sound at the end.

Meta tags do seem to improve results, more of my pages from another of my sites got indexed after I had a script automagically insert my title of that page at the beginning of that pages meta tag. I also noticed that the search engine seems to spend a certain amount of time on my pages, when the time ends it seems to leave my site indexing with only what it got during that time period. Also its going through phpsession id somehow? can i disallow those. If you guys could give a completed suggested robots.txt file that we could use, of course with a disclaimer saying that you don't know what it will do to other software on your site.

Thanks and you guys rock.

time = money, if your site doesn't = results then google is going to spend less time there imo



In the middle of difficulty lies opportunity.

Albert Einstein

Farmacija

#161
January 04, 2007, 08:03:30 PM
QuoteMeta tags do seem to improve results, more of my pages from another of my sites got indexed after I had a script automagically insert my title of that page at the beginning of that pages meta tag.
how do u done this?
www.farmaceuti.com
www.farmaceuti.com/tekstovi

MegaTinkerCoder

#162
January 04, 2007, 08:12:41 PM Last Edit: January 04, 2007, 08:35:28 PM by MegaTinkerCoder
I didnt do it on the forum...

but on regular pages you can have something along the lines of

Code Select
<meta <?php echo $metainfo; ?>>

You can set the title's using variables or whatever you want or if you generate the whole page via php its even easier... Even pass the title name in the post server variable, but I wouldn't do that...

edit: I noticed the mod Seo4SMF claims to be able to adjust your meta tags etc.
In the middle of difficulty lies opportunity.

Albert Einstein

nitins60

#163
January 04, 2007, 08:41:13 PM
How to Submit/Create SiteMap? i don't have basic knowledge also n it!

MegaTinkerCoder

#164
January 04, 2007, 08:44:46 PM
To submit a site map to google, go to http://www.google.com/accounts/ go to Webmaster Tools, and it will be in there. Google excepts several types of site maps, the easiest is a bare format listing of your files as plain txt separated by line returns.

https://www.google.com/webmasters/tools/siteoverview

You will have to prove to Google you own your site, through a few easy steps while there, not to mention create or have a google account.
In the middle of difficulty lies opportunity.

Albert Einstein

Toadmund

#165
January 04, 2007, 11:13:16 PM
How does one create a sitemap? What is a sitemap (I know what, but more detail)?
I have been wondering that myself, and how, or in what way is it helpfull, is it even necessary? Or does it just assist the robot as to where to go?

Dannii

#166
January 04, 2007, 11:16:07 PM
I just use my forum's RSS feeds and that works fine.
Sitemaps are used to let the spiders know where you have pages at. They don't impact on page rankings, and chances are that they would find them all eventually anyways.
"Never imagine yourself not to be otherwise than what it might appear to others that what you were or might have been was not otherwise than what you had been would have appeared to them to be otherwise."

MegaTinkerCoder

#167
January 05, 2007, 05:50:25 AM Last Edit: January 05, 2007, 05:55:00 AM by MegaTinkerCoder
http://www.google.com/support/webmasters/bin/answer.py?answer=40318
My forum's RSS feed is too short to use as a sitemap, it will get the spider crawling so I guess that would be fine.
In the middle of difficulty lies opportunity.

Albert Einstein

Dannii

#168
January 05, 2007, 06:11:30 AM
You can make it longer.. I use a length of 100 in mine.
"Never imagine yourself not to be otherwise than what it might appear to others that what you were or might have been was not otherwise than what you had been would have appeared to them to be otherwise."

MegaTinkerCoder

#169
January 05, 2007, 06:14:12 AM
wonderful, time to go read the manual lol ... I have been meaning to read it... really  ;)

I am guessing its probably something simple like ;count=100;type=...

In the middle of difficulty lies opportunity.

Albert Einstein

Stüldt Håjt

#170
January 05, 2007, 06:24:06 AM
I always thought that live feed is only feeding latest posts with msg urls, at least my feed is.

destalk

#171
January 05, 2007, 07:15:19 AM
Yep. The RSS feed does seem to feed the .msg posts, as well as any other url with RSS capabilities.

Dannii

#172
January 05, 2007, 07:33:46 AM
index.php?action=.xml;sa=news;limit=10;type=rss2 doesn't use msg urls for the link (it does for the guid though).
"Never imagine yourself not to be otherwise than what it might appear to others that what you were or might have been was not otherwise than what you had been would have appeared to them to be otherwise."

destalk

#173
January 05, 2007, 07:55:28 AM Last Edit: January 05, 2007, 08:05:03 AM by destalk
Just found this new article about fixing Google duplicate content & URL issues. It is not the easiest read, but it is written by an authority on the subject and may be very useful for those interested in the subject. It probably requires free registration to webmasterworld.

And this is another interesting general discussion about a similar topic.
http://www.webmasterworld.com/google/3110528.htm

Of course, as ever, much of this is speculation rather than 'fact'. ;)

destalk

#175
January 05, 2007, 09:09:14 AM
Quote from: Stüldt Håjt on January 05, 2007, 08:41:29 AM
Copy paste for those who don't have access to webmasterworld!

They are very long threads. I don't think it would be helpful to copy and paste. Registration is free.

MegaTinkerCoder

#176
January 05, 2007, 12:09:48 PM
Not to mention the possible copyright violation. Register or don't check it out. ;)
In the middle of difficulty lies opportunity.

Albert Einstein

Stüldt Håjt

#177
January 05, 2007, 02:19:11 PM
Quote from: destalk on January 05, 2007, 09:09:14 AM
They are very long threads. I don't think it would be helpful to copy and paste. Registration is free.

I thought registeration to webmasterworld costs. Well give us some kind of summary.

青山 素子

#178
January 05, 2007, 02:50:47 PM
Quote from: Stüldt Håjt on January 05, 2007, 02:19:11 PM
Quote from: destalk on January 05, 2007, 09:09:14 AM
They are very long threads. I don't think it would be helpful to copy and paste. Registration is free.

I thought registeration to webmasterworld costs. Well give us some kind of summary.

I thought it did as well, but I can see the full thread right now. Go read while it is open.
Motoko-chan
Director, Simple Machines

Note: Unless otherwise stated, my posts are not representative of any official position or opinion of Simple Machines.

Print
Go Up Pages 1 ... 7 8 9 10 11 ... 15
User actions
Advertisement: