September 25, 2021, 08:30:09 AM

News:

Bored?  Looking to kill some time?  Want to chat with other SMF users?  Join us in IRC chat or Discord


Additional Info
Type
Package ID
karlbenson:morespiders
First Created
April 09, 2008, 04:16:01 PM
Last Updated
December 24, 2011, 02:26:51 PM

More Spiders v1.2

Adds 83 more spiders/crawlers to your Spiders section in SMF
Compatible With 2.0, 2.0.2
Latest version v1.2
Downloads 41,172
Reviews 0
Rating 0/5
Subscribers 104
License (View License)
Author(s)



MORE SPIDERS v1.2
Created by Karl Benson
Supported by SleePy


Link to Mod | Support Topic


[/h][/h][/h]
Compatibility
For SMF 2.0 Beta 3 Public, 2.0 Beta 3.1 (and above)
It will not work for ANY earlier versions.

Introduction
Adds 77 more spiders/crawlers/bots to your Spiders section in SMF

Features
o 83 Spiders belonging to search engines, validators, checkers, crawlers, bots, software, etc.
- Including; Ask, Baidu, GigaBot, Google-AdSense, Google-Adwords, Google-SA, Google-Image, InternetArchive, Alexa, Omgili, Speedy Spider, Yahoo, Yahoo JP, DeadLinksChecker, W3C Validator, W3C CSSValidator, W3C FeedValidator, W3C LinkChecker, W3C mobileOK, W3C P3PValidator, Bloglines, Feedburner, SnapBot, Picsearch, Websnapr, AllTheWeb, Altavista, Asterias, 192bot, AbachoBot, Abdcatos, Acoon, Accoona, BecomeBot, BlogRefsBot, Daumoa, DuckDuckBot, Exabot, Furl, FyperSpider, Geona, GirafaBot, GoSeeBot, Ichiro, LapozzBot, Looksmart, Lycos, Majestic12, MLBot, MSRBOT, MSR-ISRCCrawler, Naver, Naver, NoxTrumBot, OmniExplorer, OnetSzukaj, ScrubTheWeb, SearchSight, Seeqpod, Shablast, SitiDiBot, Slider, Sogou, Sosospider, StackRambler, SurveyBot, Touche, Walhello, WebAlta, Wisponbot, YacyBot, YodaoBot, Charlotte, DiscoBot, EnaBot, Gaisbot, Kalooga, ScoutJet, TinEye, Twiceler, GSiteCrawler, HTTrack, Wget
(Remember SMF detects most Google/Yahoo/MSN bots by default)

It appears that most sites offering spider/bot lists have tonnes of inactive ones. I'm putting together my own lists by detecting them in the wild on my own sites. Plus any that get reported to me (after I've checked them out).

So if there are any ACTIVE ones I'm missing? Please let me know in the support topic.

Installation
Any previous versions of the mod does NOT need to be uninstalled.
This mod adds a row for each spider in the database only. It will ignore adding ones which already exist.
No theme edits required. No language strings to translate or editing. It adds database rows only.

Install and your done.
Note: Click uninstall to remove the mod from your mod list. But it won't remove the spiders from your database. You'll need to remove each one from your SMF Search Engines/Spider section.

For manual installation, just upload AddMoreSpiders.php to your SMF directory and run it in your browser (then delete the file).

Useful Links
SMF Package Parser (No you won't need this for this mod)
Manual Installation Of Mods
How Do I Modify Files?

Donate
Has this modification helped you? Support the developer by Donating

Support
Please use the modification thread for support with this modification.
(Please don't ask me to do the edits for you)

Changelog
1.0 - 9th April 2008
o Initial release.
1.1 - 4th May 2008
o Fixed Alexa/InternetArchive
o 25 More Spiders added (which have been detected on my forum in the past month)
1.2 - 20th June 2008
o Added a handful of new spiders which have been detected in the past month
Manual installation info
You have to register or login to be able to leave a review
There are currently no reviews on this customization
Advertisement: