Advertisement:

Author Topic: Search Engines  (Read 322 times)

Offline petewadey

  • Jr. Member
  • **
  • Posts: 155
Search Engines
« on: January 09, 2018, 06:06:50 AM »
I have Search Engines as a member group and given them certain permissions, somewhere between Guests and Members.
Most bots turn up in this group as if by magic, obviously something SMF do behind the scene. How often is this updated?
I ask because when I check guests ip's, I sometimes find genuine bots, and add them manually to the search engine group.
Mainly because I have given them more permissions than they would otherwise have as a guest.
Am I wasting my time?, Should I just be patient and wait for the data to update?
Thanks
Pete

Offline Illori

  • Project Manager
  • SMF Legend
  • *
  • Posts: 51,567
Re: Search Engines
« Reply #1 on: January 09, 2018, 06:21:47 AM »
not all bots will crawl your site and define themselves as a bot. if they dont they will not let the forum put them in the group. IMO you will hurt your ranking more if you give spiders more access then a guest gets.

Offline Kindred

  • The Mean One
  • Support Specialist
  • SMF Legend
  • *
  • Posts: 58,609
  • Gender: Male
    • Kindred-999 on GitHub
Re: Search Engines
« Reply #2 on: January 09, 2018, 07:08:00 AM »
it actualy violates Google's terms to have the bot see more than a standard guest.
Please do not PM, IM or Email me with support questions.  You will get better and faster responses in the support boards.  Thank you.

Offline petewadey

  • Jr. Member
  • **
  • Posts: 155
Re: Search Engines
« Reply #3 on: January 09, 2018, 08:24:31 AM »
Sorry, I was wrong in my original message. I allow guests to see that pages are there for members only, but don't wish bots to see those. That is the only difference.
Can anyone answer my original message please?

Offline Illori

  • Project Manager
  • SMF Legend
  • *
  • Posts: 51,567
Re: Search Engines
« Reply #4 on: January 09, 2018, 08:26:25 AM »
since spiders dont always identifiy themselves you will not always get what you want from that. as if they dont identify they will see the pages and see when they do they cant and down rate your site.

Offline petewadey

  • Jr. Member
  • **
  • Posts: 155
Re: Search Engines
« Reply #5 on: January 09, 2018, 08:33:04 AM »
In that case, I'd better rethink my permissions. Thanks for your help

Offline Kindred

  • The Mean One
  • Support Specialist
  • SMF Legend
  • *
  • Posts: 58,609
  • Gender: Male
    • Kindred-999 on GitHub
Re: Search Engines
« Reply #6 on: January 09, 2018, 03:11:48 PM »
Additionally, if I can see something, I should be able to get to it.
If I click on something and the system tells me "you have to register to complete this action" - I leave the site and never come back.
Please do not PM, IM or Email me with support questions.  You will get better and faster responses in the support boards.  Thank you.