Simple Machines Community Forum

Customizing SMF => Building Your Community and other Forum Advice => Topic started by: Rob Lightbody on March 04, 2021, 07:27:02 AM

Title: Finding dead links in forum posts?
Post by: Rob Lightbody on March 04, 2021, 07:27:02 AM
Hi there,

My forum's been going for 12 years.  I would like a way to find all the dead links that may be lurking in old posts?  Does anyone know an SMF-compatible way to do this?

The worst ones are where people have linked to an image that no longer exists, but there's links to websites that have disappeared too.

Thanks,

-Rob
Title: Re: Finding dead links in forum posts?
Post by: Kindred on March 04, 2021, 09:52:39 AM
I don't believe there is any good, automated way to do this.
Title: Re: Finding dead links in forum posts?
Post by: Steve on March 04, 2021, 10:53:30 AM
My search through the mods didn't yield anything useful either.
Title: Re: Finding dead links in forum posts?
Post by: shawnb61 on March 04, 2021, 11:47:32 AM
Lots of 3rd party tools do that:
https://www.deadlinkchecker.com
https://www.screamingfrog.co.uk
https://ahrefs.com/broken-link-checker

Most free versions only check the first few thousand URLs they find then ask you to pay.  Good for smaller sites.

Google Search Console supposedly has this, but I can't find it...  I preferred the old version - Google Webmaster Tools - it was right there under Diagnostics...
Title: Re: Finding dead links in forum posts?
Post by: vbgamer45 on March 04, 2021, 11:59:40 AM
Probably would have to build a tool to scan each message post using the database then find links/linked images and check first if the host still exists then second if the file exists.
Title: Re: Finding dead links in forum posts?
Post by: AlanDewey on March 06, 2021, 07:52:57 AM
Xenu Link Sleuth 

Free

I have used it to crawl many thousands of pages.  You can set the crawl rate.

What are you going to do with the broken links?  Try to find the updated url?  Delete them?