News:

Bored?  Looking to kill some time?  Want to chat with other SMF users?  Join us in IRC chat or Discord

Main Menu

Blocking search engines

Started by starbiz, May 17, 2022, 11:19:48 AM

Previous topic - Next topic

starbiz

What is the maximum that I can do (within reason) to block all search engines from indexing my forum contents?

I've unchecked "Allow guests to browse the forum" in "Features and Options => General", but what other steps should I take to ensure no forum posts find their way onto Google/Bing/Yandex/etc?

Antechinus

That should do it. Nothing else should be necessary. :)

vbgamer45

Also check out a robots.txt file search on a search engine to learn more
Community Suite for SMF - Take your forum to the next level built for SMF, Gallery,Store,Classifieds,Downloads,more!

SMFHacks.com -  Paid Modifications for SMF

Mods:
EzPortal - Portal System for SMF
SMF Gallery Pro
SMF Store SMF Classifieds Ad Seller Pro

Antechinus

Yup You can also block troublesome bots directly in .htaccess if some of them are running up a stack of bandwidth. I do that sometimes with (particularly) Chinese bots, or even just bots for advertising sites that I have no connection with.

movierchives

You could block the ASN numbers in the firewall or Cloudflare which would block all Microsoft, Google etc IPs

Advertisement: