Advertisement:
GCWebhosting

Author Topic: Stop spiders viewing profiles?  (Read 2964 times)

Offline casp3r

  • Jr. Member
  • **
  • Posts: 187
    • Aviation forum & gallery
Stop spiders viewing profiles?
« on: May 06, 2008, 05:00:56 PM »
Version: SMF 2.0 Beta 3.1 Public

I've noticed in the 'Search Engine' logs that some are viewing members profile - How do I stop this?

Many thanks in advance

Michael
Aviation forum & gallery
www.niaviation.co.uk

Online Kindred

  • The Mean One
  • Support Specialist
  • SMF Legend
  • *
  • Posts: 58,318
  • Gender: Male
    • Kindred-999 on GitHub
Re: Stop spiders viewing profiles?
« Reply #1 on: May 06, 2008, 05:03:07 PM »
turn off the guest's ability to view profiles in permissions
Please do not PM, IM or Email me with support questions.  You will get better and faster responses in the support boards.  Thank you.

Offline casp3r

  • Jr. Member
  • **
  • Posts: 187
    • Aviation forum & gallery
Re: Stop spiders viewing profiles?
« Reply #2 on: May 06, 2008, 05:08:39 PM »
Already have done that weeks ago but tonight I noticed that a profile was still being viewed.
Aviation forum & gallery
www.niaviation.co.uk

Offline karlbenson

  • SMF Friend
  • SMF Super Hero
  • *
  • Posts: 15,629
  • Gender: Male
    • Criminal Brief UK
Re: Stop spiders viewing profiles?
« Reply #3 on: May 06, 2008, 05:18:07 PM »
Making them private still won't stop spiders attempting to crawl them.

You would need to use a robots.txt to stop them crawling them.
In the base of your domain create a file called robots.txt and paste into it.

User-agent: *
Disallow: /index.php?action=profile


You can also block alot of other sections or individual spiders.  You can take a look at my robots.txt which block different things for different spiders.

Offline casp3r

  • Jr. Member
  • **
  • Posts: 187
    • Aviation forum & gallery
Re: Stop spiders viewing profiles?
« Reply #4 on: May 06, 2008, 05:20:54 PM »
Many thanks. Added to txt file. Will post back in a few days and let you know how it goes.
Aviation forum & gallery
www.niaviation.co.uk

Online Kindred

  • The Mean One
  • Support Specialist
  • SMF Legend
  • *
  • Posts: 58,318
  • Gender: Male
    • Kindred-999 on GitHub
Re: Stop spiders viewing profiles?
« Reply #5 on: May 06, 2008, 07:38:54 PM »
please do note...   if Guest viewing of profiles is OFF, then the spider is NOT viewing the profile...  merely attempting to do so.
Please do not PM, IM or Email me with support questions.  You will get better and faster responses in the support boards.  Thank you.