News:

Want to get involved in developing SMF? Why not lend a hand on our GitHub!

Main Menu

Meta name indexing issue?

Started by jbridges87, May 09, 2020, 09:41:58 PM

Previous topic - Next topic
Print
Go Down Pages1
User actions

jbridges87

May 09, 2020, 09:41:58 PM Last Edit: May 09, 2020, 09:58:16 PM by jbridges87
Hey guys, I was just looking over my site, and while I was researching SEO and meta tags, I discovered all of my pages contain a 'noindex', in the <head> section.
I confirmed this by going through different topics on my site, and then right clicking the page/view page source. The code shows as below;

Code Select
<meta name="robots" content="noindex" />

I doubled checked my robots.txt file, and I do not have any line entry to disallow indexing.
I don't understand why my pages aren't being indexed. This is what my robots.txt code looks like;

Code Select
User-agent: *
Disallow: /test_site/

Sitemap: https://crown-sports.com/sitemap.xml
Come by and check out my sports forum, here.
Running SMF v2.0.17

Arantor

#1
May 10, 2020, 04:18:58 AM
Example page?
Holder of controversial views, all of which my own.

jbridges87

#2
May 10, 2020, 12:42:55 PM
My site is in my signature, and you can choose any one of the topics, view the page source, and you will find the 'noindex'.
Come by and check out my sports forum, here.
Running SMF v2.0.17

Arantor

#3
May 10, 2020, 12:52:11 PM
There's a reason I asked you for a specific link, it's because it *matters*.

First topic I went to, https://crown-sports.com/index.php?topic=2.0 - no mention of noindex in there.

Ditto for https://crown-sports.com/index.php?board=2.0

That's why I asked you for a link because very likely you're using a link that WOULD be no index (e.g. last unread) precisely because that *shouldn't* be indexed because last unread is different for everyone (and meaningless for search engines)
Holder of controversial views, all of which my own.

jbridges87

#4
May 10, 2020, 01:10:06 PM
Here's a topic I wrote yesterday, for example, and if you look under the <head>, you will see

<meta name="robots" content="noindex" />
Come by and check out my sports forum, here.
Running SMF v2.0.17

Arantor

#5
May 10, 2020, 01:12:26 PM
Where?

Code Select
<head>

<link rel="apple-touch-icon" sizes="180x180" href="/apple-touch-icon.png?v=yyQjbl0NBY">
<link rel="icon" type="image/png" sizes="32x32" href="/favicon-32x32.png?v=yyQjbl0NBY">
<link rel="icon" type="image/png" sizes="16x16" href="/favicon-16x16.png?v=yyQjbl0NBY">
<link rel="manifest" href="/site.webmanifest?v=yyQjbl0NBY">
<link rel="mask-icon" href="/safari-pinned-tab.svg?v=yyQjbl0NBY" color="#5bbad5">
<link rel="shortcut icon" href="/favicon.ico?v=yyQjbl0NBY">
<meta name="msapplication-TileColor" content="#2b5797">
<meta name="theme-color" content="#ffffff">

<link rel="stylesheet" type="text/css" href="https://crown-sports.com/Themes/Reseller/css/bootstrap.css" />
<link rel="stylesheet" type="text/css" href="https://crown-sports.com/Themes/Reseller/css/reseller.css" />
<link rel="stylesheet" type="text/css" href="https://crown-sports.com/Themes/Reseller/css/index.css?fin20" />
<link rel="stylesheet" type="text/css" href="https://crown-sports.com/Themes/default/css/webkit.css" />
<script type="text/javascript" src="https://ajax.googleapis.com/ajax/libs/jquery/3.4.1/jquery.min.js"></script>
<script type="text/javascript" src="https://crown-sports.com/Themes/Reseller/scripts/bootstrap.min.js"></script>
<script type="text/javascript">
$(document).ready(function(){
$("input[type=button]").attr("class", "btn btn-default btn-sm");
$(".button_submit").attr("class", "btn btn-primary btn-sm");
$("#advanced_search input[type='text'], #search_term_input input[type='text']").removeAttr("size");
$(".table_grid").attr("class", "table table-striped");
$("img[alt='New'], img.new_posts").replaceWith("<span class='label label-warning'>New</span>");
$("#profile_success").removeAttr("id").removeClass("windowbg").addClass("alert alert-success");
$("#profile_error").removeAttr("id").removeClass("windowbg").addClass("alert alert-danger");
});
</script>
<script type="text/javascript" src="https://crown-sports.com/Themes/default/scripts/script.js?fin20"></script>
<script type="text/javascript" src="https://crown-sports.com/Themes/Reseller/scripts/theme.js?fin20"></script>
<script type="text/javascript"><!-- // --><![CDATA[
var smf_theme_url = "https://crown-sports.com/Themes/Reseller";
var smf_default_theme_url = "https://crown-sports.com/Themes/default";
var smf_images_url = "https://crown-sports.com/Themes/Reseller/images";
var smf_scripturl = "https://crown-sports.com/index.php";
var smf_iso_case_folding = false;
var smf_charset = "ISO-8859-1";
var ajax_notification_text = "Loading...";
var ajax_notification_cancel_text = "Cancel";
// ]]></script>
<meta name="viewport" content="width=device-width, initial-scale=1" />
<meta http-equiv="Content-Type" content="text/html; charset=ISO-8859-1" />
<meta name="description" content="Elite Sports Tours - Other - Crown Sports Forum" />
<title>Elite Sports Tours - Other - Crown Sports Forum</title>
<link rel="canonical" href="https://crown-sports.com/index.php?topic=31.0" />
<link rel="help" href="https://crown-sports.com/index.php?action=help" />
<link rel="search" href="https://crown-sports.com/index.php?action=search" />
<link rel="contents" href="https://crown-sports.com/index.php" />
<link rel="alternate" type="application/rss+xml" title="Crown Sports Forum - RSS" href="https://crown-sports.com/index.php?type=rss;action=.xml" />
<link rel="prev" href="https://crown-sports.com/index.php?topic=31.0;prev_next=prev" />
<link rel="next" href="https://crown-sports.com/index.php?topic=31.0;prev_next=next" />
<link rel="index" href="https://crown-sports.com/index.php?board=7.0" /><script type="text/javascript">
        var ct_date = new Date(),
            ctTimeMs = new Date().getTime(),
            ctMouseEventTimerFlag = true, //Reading interval flag
            ctMouseData = [],
            ctMouseDataCounter = 0;

        function ctSetCookie(c_name, value) {
            document.cookie = c_name + "=" + encodeURIComponent(value) + "; path=/";
        }
        ctSetCookie("ct_ps_timestamp", Math.floor(new Date().getTime()/1000));
        ctSetCookie("ct_fkp_timestamp", "0");
        ctSetCookie("ct_pointer_data", "0");
        ctSetCookie("ct_timezone", "0");

        setTimeout(function(){
            ctSetCookie("ct_checkjs", "2007207099");
            ctSetCookie("ct_timezone", ct_date.getTimezoneOffset()/60*(-1));
        },1000);

        //Writing first key press timestamp
        var ctFunctionFirstKey = function output(event){
            var KeyTimestamp = Math.floor(new Date().getTime()/1000);
            ctSetCookie("ct_fkp_timestamp", KeyTimestamp);
            ctKeyStopStopListening();
        }

        //Reading interval
        var ctMouseReadInterval = setInterval(function(){
            ctMouseEventTimerFlag = true;
        }, 150);
           
        //Writting interval
        var ctMouseWriteDataInterval = setInterval(function(){
            ctSetCookie("ct_pointer_data", JSON.stringify(ctMouseData));
        }, 1200);

        //Logging mouse position each 150 ms
        var ctFunctionMouseMove = function output(event){
            if(ctMouseEventTimerFlag == true){
               
                ctMouseData.push([
                    Math.round(event.pageY),
                    Math.round(event.pageX),
                    Math.round(new Date().getTime() - ctTimeMs)
                ]);
               
                ctMouseDataCounter++;
                ctMouseEventTimerFlag = false;
                if(ctMouseDataCounter >= 100){
                    ctMouseStopData();
                }
            }
        }

        //Stop mouse observing function
        function ctMouseStopData(){
            if(typeof window.addEventListener == "function"){
                window.removeEventListener("mousemove", ctFunctionMouseMove);
            }else{
                window.detachEvent("onmousemove", ctFunctionMouseMove);
            }
            clearInterval(ctMouseReadInterval);
            clearInterval(ctMouseWriteDataInterval);               
        }

        //Stop key listening function
        function ctKeyStopStopListening(){
            if(typeof window.addEventListener == "function"){
                window.removeEventListener("mousedown", ctFunctionFirstKey);
                window.removeEventListener("keydown", ctFunctionFirstKey);
            }else{
                window.detachEvent("mousedown", ctFunctionFirstKey);
                window.detachEvent("keydown", ctFunctionFirstKey);
            }
        }

        if(typeof window.addEventListener == "function"){
            window.addEventListener("mousemove", ctFunctionMouseMove);
            window.addEventListener("mousedown", ctFunctionFirstKey);
            window.addEventListener("keydown", ctFunctionFirstKey);
        }else{
            window.attachEvent("onmousemove", ctFunctionMouseMove);
            window.attachEvent("mousedown", ctFunctionFirstKey);
            window.attachEvent("keydown", ctFunctionFirstKey);
        }
    </script>
<link rel="stylesheet" type="text/css" id="trb_styles_css" href="https://crown-sports.com/Themes/default/css/trb_styles.css" />
</head>

I don't see it there.
Holder of controversial views, all of which my own.

jbridges87

#6
May 10, 2020, 01:15:10 PM
Come by and check out my sports forum, here.
Running SMF v2.0.17

Arantor

#7
May 10, 2020, 01:17:46 PM
I love being right.

Note your link: topic=29.msg32 - you'd *never* want that page indexed, because msg32 means "find me whichever page has message id 32 in it and show me that", and to avoid penalising you for duplicating content, SMF marks all the duplicates no-index, exactly as it should.

Note that the link I mentioned is topic=31.0, but topic=29.0 would do exactly the same thing: if you are on the canonical link for a given page, where that's page 1 (ends in .0) or a later page (ends in a different number after the dot), SMF treats those as indexable because they're the standard version of the page, but for links like the one you have will always be no-index specifically to avoid penalising you.
Holder of controversial views, all of which my own.

jbridges87

#8
May 10, 2020, 01:34:56 PM
Okay I see what you mean. I never noticed that extra verbage at the end of the URL. [.msg32].

Any idea why the Google Search Console has marked 22 of my topics to not be indexed? In fact, they're showing as never been crawled.

Come by and check out my sports forum, here.
Running SMF v2.0.17

Arantor

#9
May 10, 2020, 01:45:05 PM
Status: Excluded would tend to suggest that Google has a reason it doesn't want to go there, which could be any number of things - like entries in your robots.txt, issues with DNS, issues with the server...

I can't tell you what's wrong with it because I'm not equipped with telepathy - maybe ask Google why it decided to exclude your site...?
Holder of controversial views, all of which my own.

jbridges87

#10
May 10, 2020, 02:16:41 PM
Alright, I'll take it up with the almighty power lords of Google.
Gracias.
Come by and check out my sports forum, here.
Running SMF v2.0.17

jbridges87

#11
May 12, 2020, 02:21:03 PM
After manually requesting indexing through the Google Search Console, all of the URLs are now appearing as indexed.
It's odd that I had to manually request the indexing, considering some articles were over a month old.

Perhaps Google just hadn't got around to crawling the site yet.
In any case, this can be closed.

Thanks
Come by and check out my sports forum, here.
Running SMF v2.0.17
Print
Go Up Pages1
User actions
Advertisement: