I got coverage issue in google web tools:
Indexed, though blocked by robots.txt
https://domain.com/index.php?action=profile;u%3D321
https://domain.com/index.php?action=profile;u%3D399
https://domain.com/index.php?action=profile;u%3D467
https://domain.com/index.php?action=profile;u%3D214
https://domain.com/index.php?action=calendar
https://domain.com/index.php?action=register
https://domain.com/index.php?action=login
https://domain.com/index.php?action=search
https://domain.com/index.php?action=tags
https://domain.com/index.php?topic=1127.msg1753;topicseen
robots.txt has these lines:
User-agent: *
Disallow: /*action
Disallow: /*PHPSESSID
Disallow: /*;
Allow: /$
Allow: /*board*.html$
Allow: /*topic*.html$
Allow: /*.xml
Allow: /*.css$
Allow: /*.js$
Allow: /*.png$
Allow: /*.jpg$
Allow: /*.gif$
Well, the first half of the list is working as implemented, you have disallowed all the action URLs so they're showing up as "we used to have these, now we don't because blocked".
The topic one is a bit trickier and depends on whether you're using "search engine friendly" URLs in SMF or not, whether that topic was previously public or not and a few other things.
Lainaus käyttäjältä: Arantor - joulukuu 01, 2019, 03:12:20 AP
Well, the first half of the list is working as implemented, you have disallowed all the action URLs so they're showing up as "we used to have these, now we don't because blocked".
The topic one is a bit trickier and depends on whether you're using "search engine friendly" URLs in SMF or not, whether that topic was previously public or not and a few other things.
Do I need to allow /*action ?? I installed optimus plugin and it automatically created robots.txt
I have not much idea abbout smf so I don't know should I allow action or not.
Yes I am using url friendly option enabled.
The better question is why you think you need it. 99% of pages under action= are in fact not useful to search engines and just clutter up the index, like profile pages, calendar, tags etc.
No board or topic uses that style of URL so you can leave action= alone and it'll be fine.
As for the other case... the fact you have URL friendly option enabled means your URLs will be /topic,1.0.html rather than /index.php?topic=1.0 and that will fix itself over time to get rid of the old entries.
Actually google webtools gives issue that is why I want to fix it. Because It can affect rank of my website.
Regarding seo friendly url, it is enabled. Please check this screenshot: https://prnt.sc/q4ld36
Not all issues in webmaster tools are actual issues, they are just notifications of things that may be wrong, or might have changed, or might have an impact on the indexing of your pages. Seeing an issue, is not an issue in itself.
LainaaRegarding seo friendly url, it is enabled.
Yes, I know. It means you get URLs like topic,1.0.html rather than topic=1.0. It was useful 15 years ago when search engines were not as smart as they are now, but if you think this setting gets you nice URLs, it doesn't.
Thanks Aleksi for confirmation.
@Arantor, So my website has not url friendly url? How can I get url friendly url?
Your web site has URLs that are just fine. You don't need to change anything.