News:

Want to get involved in developing SMF, then why not lend a hand on our github!

Main Menu

No to sitemap

Started by Do not heart me......, May 21, 2012, 11:21:22 AM

Previous topic - Next topic
Print
Go Down Pages1
User actions

Do not heart me......

May 21, 2012, 11:21:22 AM
Hello,
Most of the members always worry about the sitemap.

Allow this in your robot---

QuoteUser-agent: *
Allow: /recent
Crawl-delay: 5
Host: www.yourdomain.com

In the recent, your latest post are there and when the search engine crawl take all the links. You can check
www.yourdomain.com/recent

No need to install the any mod.
Print
Go Up Pages1
User actions
Advertisement: