News:

Want to get involved in developing SMF, then why not lend a hand on our github!

Main Menu

Optimus

Started by Bugo, February 15, 2011, 03:48:12 PM

Previous topic - Next topic

Hawkmoth

Hi
I hope someone may be able to give me some guidance.

On google my listing is showing with:-

www.follyfoot.org/‎
A description for this result is not available because of this site's robots.txt – learn more.

I am using the robots.txt suggested in this mod:-

User-agent: Googlebot-Image
Disallow: /smf/

User-agent: YandexImages
Disallow: /smf/

User-agent: msnbot-MM
Disallow: /smf/

User-agent: Googlebot-Mobile
Allow: /smf/*wap
Disallow: /smf/

User-agent: YandexImageResizer
Allow: /smf/*wap
Disallow: /smf/

User-agent: MediaPartners-Google
Allow: /smf/

User-agent: *
Allow: /smf/$
Allow: /smf/*action=.xml
Allow: /smf/*sitemap
Disallow: /smf/*action
Disallow: /smf/*wap
Disallow: /smf/*board=*wap
Disallow: /smf/*topic=*wap
Disallow: /smf/*;
Disallow: /smf/*PHPSESSID
Allow: /smf/*board*.html$
Allow: /smf/*topic*.html$
Disallow: /smf/
Sitemap: http://follyfoot.org/smf/sitemap.xml
Crawl-delay: 5
Clean-param: PHPSESSID /smf/index.php
Host: follyfoot.org


Am I doing something wrong?

Thanks

Arantor

The key here is:
Disallow: /smf/

in the User-Agent: * block

That will disallow anything that starts with /smf/


It might be better if you explain what it is you're trying to achieve rather than showing us the code and asking what's wrong with it. I can see cases where that list would be fine.

Hawkmoth

Hi Arantor

Many thanks for your quick reply.
I have removed that line now.

Quote from: Arantor on May 21, 2013, 02:12:10 PM
It might be better if you explain what it is you're trying to achieve rather than showing us the code and asking what's wrong with it. I can see cases where that list would be fine.

I originally installed this great MOD to help manage the verification Meta tags without having to manually edit files etc.
After installing the MOD, I noticed that it had the ability to do a lot of other useful stuff including the editing of the robot.txt.
I'm no expert as you can probably tell but the developer was kind enough to include some suggested rules which I duly used.

It was only few weeks later that we noticed the description wasn't showing correctly in google.

Many thanks

mossite

i want to install this mod, can anyone can help me to install it correctly
Greatness is Goodness

averageangler

Hi everyone who has taken the time to read my post, Thank You.
I have searched the board and am unable to find exactly where to find a solution that defines my problem. If this has been covered..please link me up.

My problem seems pretty basic, I assume user error. When using bing webmaster tools seo analyzer, it says no <h1> <meta> <description> .

also it says that robots.txt is blocking sitemap.xml
I used the optimus sitemap section and copy/paste the items it suggested.
I went FTP and deleted robots.txt and resubmitted sitemap to bing...
Google also was blocked by robots.txt
That has allowed access to the optimus sitemap. It seems odd that it would block its own sitemap?

I must have the settings wrong.
could someone point me in the right direction
thanks

Bugo

It would not be bad to show up your robots.txt and your forum.

Brewster

Hi

Great plugin. I am having issues with the sitemap generation though.

I have installed 1.8.6.2 using the package manager and am running SMF 2.0.4

When I go to scheduled tasks, there is no option for sitemap generation. I do have "Create Forum Map" - is this what I should be running? I have set this to be run every ten minutes, but nothing appears in the task log.

What information can I provide to help debug this issue?

Thanks,
Joe

Brewster

When I run this task manually, the sitemap gets generated correctly, but it doesnt seem to run as a scheduled task

Obcy

For me the same thing

Bugo

Attach your Subs-Optimus.php file.

Dhayzon

not  cleaning bbcode in meta description



I would like to use the function
strip_tags for cleaning

Kindred

Do not use bbcode or html in the description. Ever. Images are not allowed in the description tag anyway
Слaва
Украинi

Please do not PM, IM or Email me with support questions.  You will get better and faster responses in the support boards.  Thank you.

"Loki is not evil, although he is certainly not a force for good. Loki is... complicated."

Babyfacemagee

#292
Ok, so now I'm a bit confused.  My site Nexus7forum.com uses 'Pretty URLs'.  Should I not use this mod?  I just installed it hoping it would help with indexing.  Should I uninstall it?  Can anyone tell me what the specific advantages of using this mod for my particular site would be?  Thanks in advance and yes, I read this complete board from start to finish before posting this. 

Kindred

prettyurls are a waste of resources anyway..... and they contribute nothing to SEO
Слaва
Украинi

Please do not PM, IM or Email me with support questions.  You will get better and faster responses in the support boards.  Thank you.

"Loki is not evil, although he is certainly not a force for good. Loki is... complicated."

Babyfacemagee

I'm sure we could have a long debate about whether using a mod like 'Pretty URLs' or not adds value at all to a forum.  In many areas of life I've learned that looking at something purely from the 'technical' doesn't always give the complete story.   For instance while strictly speaking Pretty URLs might not help SEO at all from a technical standpoint, I think many would agree that a url with meaning or 'familiarity' does make someone more inclined to click on it when compared to a url that is cryptic.  Thus, there is a psychological component to why a person clicks a url as well as a 'technical'.  I think most would agree that is common sense.  Even if only 1 in 20 chooses my URL because it is understandable and hints at the subject matter...compared to another URL that is cryptic...that 1 in 20 is an advantage I want.

With that said, back to my main interest...the advantage of using this MOD for my site.   Would this mod help me have more 'site links' in google results and thus have more 'screen real estate' or otherwise increase traffic?  Right now when searching for 'nexus 7 forum' in google my site comes up usually within the top 3 listings.  My concern is that my competitors seem to have many 'site links' or 'sub-topics' listed beneath their main url and mine does not.  My site is large enough that I should have some of these as well and I believe it's because the theme i'm using or setup of my forum is not doing something that these others are.   It might not be coincidental that these competitors are predominantly using either Vbulletin or another paid platform. 

So again...would this mod help rectify this issue and help increase site links or subheadings on Google results?

Thx in advance.

Arantor

Yes we could. We could also note that pretty much all of this has been hashed many times over and the salient points are reiterated every time.

1. There is no actual SEO benefit for pretty URLs.
2. There is an arguable benefit to nicer looking URLs but that doesn't stop YouTube now, does it?
3. This mod does have some SEO improvements.
4. The 'site links' and 'sub links' are not related to this mod but based on having better ranking to those individual pages due to good backlinks.

Babyfacemagee

Thanks for the response Arantor.  #4 was what I was looking for. 

Best,

BFM

Antes

Updated the translation, thank you for including them to core :)

Bugo

There are some errors in your language files. Please fix them.

akonze

This mod deleted my complete configuration menu in the admin area. I can't administrate the board anymore and have to completetely reinstall everything.

I just can warn you to not use the current version. It seems to have a massive bug in it.

Advertisement: