Archived Boards and Threads... > SMF Feedback and Discussion

search engines and new URL system

(1/1)

sensovision:
recently I saw topics about various flavours for URLs on the board and just thought about letting know that new system of URLs is work perfectly and no other modification needed (at least in my opinion), I could prove this by numbers from board I currently running and which using Uknown's Mod which was installed 1 month ago, after this my forum was finally spidered in full... I know that some people would like to see some numbers to compare results so here they are:
July statistic of hits by spiders:

--- Quote ---Fast-Webcrawler (AllTheWeb)   4427
Googlebot (Google)   621
Unknown robot (identified by 'robot')   455
Inktomi Slurp   498
Unknown robot (identified by 'crawl')   268
WISENutbot (Looksmart)   225
Scooter (AltaVista)   47
Alexa (IA Archiver)   29
Unknown robot (identified by 'spider')   11
Jeeves   3
Wget   1
Netcraft Web Server Survey   1
--- End quote ---

August statistic of hits by spiders:

--- Quote ---Fast-Webcrawler (AllTheWeb)   6929
Googlebot (Google)   1571
Alexa (IA Archiver)   1115
Unknown robot (identified by 'robot')   732
Inktomi Slurp   578
Unknown robot (identified by 'crawl')   259
WISENutbot (Looksmart)   202
Jeeves   50
Scooter (AltaVista)   38
Unknown robot (identified by 'spider')   33
Wget   7
Voila   1
Netcraft Web Server Survey   1
--- End quote ---
as you can see numbers of spidered page are grow, same thing happen with traffic from engines:
July:

--- Quote ---- Google   520   600
- Yahoo   259   259
- MSN   196   196
- AOL   64   64
- Other search engines   59   80
- AllTheWeb   17   17
- DMOZ   10   10
- Overture   7   7
- AltaVista   6   6
- Tiscali   6   6
- Go.com   5   5
- Ask Jeeves   5   5
- Lycos   2   2
- Excite   2   2
- Looksmart   2   2
- Freeserve   2   2
- Mamma   1   1
- Ask Jeeves UK   1   1
- Hotbot   1   1
- InfoSpace   1   1
- MetaCrawler (Metamoteur)   1   1
- Netscape   1   1
--- End quote ---
August:
--- Quote ---- Google   2546   2914
- Yahoo   929   929
- MSN   241   241
- AOL   205   205
- Other search engines   103   196
- Netscape   31   31
- AllTheWeb   17   17
- Overture   14   14
- Hotbot   13   13
- Lycos   10   38
- AltaVista   9   9
- Excite   5   5
- InfoSpace   4   4
- WebCrawler   4   4
- Go.com   3   3
- Go2Net (Metamoteur)   2   2
- DMOZ   2   2
- Mamma   2   2
- Looksmart   2   2
- MetaCrawler (Metamoteur)   2   2
- Ask Jeeves   1   1
- Freeserve   1   1
--- End quote ---

Omar Bazavilvazo:
great :)

sensovision:
I know that it's great ;) and wish to note that this numbers isn't final e.g. Google for this month reach these results:
Googlebot (Google)   1730
and for hits:
- Google   2777   3145
isn't this wonderfull? ;)

Navigation

[0] Message Index