Wikimedia Traffic Analysis Report - Crawler requests

Monthly requests or daily averages, for period: 1 Mar 2013 - 31 Mar 2013 (last 12 months)
000 ⇒ k
 
 This analysis is based on a 1:1000 sampled server log (squids)

Warning: all recent Wikimedia traffic analysis reports have been generated from old scripts.

The scripts are orphaned, and have not been maintained for at least 6 months. Many bugs are considerably older.
Known Bugzilla bugs: 46190, 46191, 46195, 46201, 46205, 46265, (46267), 46268, 46269, 46271, 46273, 46274, 46275, 46277, 46278, 46279, 46289

 See also: Requests by destination or by origin / Methods / Scripts / User agents / Skins / Crawlers / Op.Sys. / Mobile devices / Browsers / Google / Country data / Traffic trends, and notes about reliability of these data

The following overview of crawler (aka bot) page requests is based on the user agent information that accompanies most server requests. Unfortunately this user agent information follows rather loosely defined guidelines.
Also please bear in mind than the most popular crawler names may be somewhat overrepresented. This is the result of so called user agent spoofing (where a requester supplies false credentials, e.g. to bypass web servers filters).
GoogleBot seems to be a favorite for spoofing. Therefore requests from an ip address registered by Google (see below) are color coded GoogleBot, others GoogleBot

For this report page requests are considered to be issued by a crawler in two cases:
1 The user agent string contains a web address (only crawlers should have that, but there a some false positives, where a browser sends a user agent string with a web address (ill behaved plug-in, main offenders have been eliminated)
2 The user agent string contains the term bot, spider or crawl[er]'

In total 111,631,450 page requests (mime type text/html only!) per day are considered crawler requests, out of 660,151,100 external requests, which is 16.9%

Page requests for crawlers that specify a url in the agent string
Count
x 1000		Secondary domain
(~site) name		URLMime typeUser agent
google
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) - -
 www.google.com/bot.html-Mozilla/5.0 (compatible; GoogleBot/2.1; url) - -
 www.google.com/bot.htmltext/..Mozilla/5.0 (iPhone; CPU iPhone OS 4_1 like Mac OS X; en-us) AppleWebKit/532.9 KHTML Version/4.0.5 Mobile/8B117 Safari/6531.22.7 (compatible; GoogleBot-Mobile/2.1; url) - -
 www.google.com/bot.html-Mozilla/5.0 (iPhone; CPU iPhone OS 4_1 like Mac OS X; en-us) AppleWebKit/532.9 KHTML Version/4.0.5 Mobile/8B117 Safari/6531.22.7 (compatible; GoogleBot-Mobile/2.1; url) - -
 www.google.com/bot.htmlimage/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) - -
 desktop.google.com/application/xmlMozilla/5.0 (compatible; Google Desktop/5.9.1005.12335; url) - -
 www.google.com/feedfetcher.htmlimage/..Mozilla/5.0 (compatible) FeedFetcher-Google; (url) - -
 desktop.google.com/image/..Mozilla/5.0 (compatible; Google Desktop/5.9.1005.12335; url) - -
 code.google.com/p/crawler4j/text/..crawler4j (url) - -
 www.google.com/feedfetcher.html-FeedFetcher-Google; (url) - -
 www.google.com/feedfetcher.htmlapplication/xmlFeedFetcher-Google; (url) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: ortografia4) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: ortopedianew) - -
 code.google.com/appengineapplication/jsonAppEngine-Google; (url; appid: s~redconceptual) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: wikien3) - -
 www.google.com/feedfetcher.htmltext/..Mozilla/5.0 (compatible) FeedFetcher-Google; (url) - -
 www.google.com/feedfetcher.htmltext/..FeedFetcher-Google; (url) - -
 desktop.google.com/text/..Mozilla/5.0 (compatible; Google Desktop/5.9.1005.12335; url) - -
 www.google.com/feedfetcher.htmlapplication/jsonMozilla/5.0 (compatible) FeedFetcher-Google; (url) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: rarplayer) - -
 code.google.com/appenginetext/..WikiBot/0.1 AppEngine-Google; (url; appid: newikipedia) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~kyouen3) - -
 docs.google.comimage/..Mozilla/5.0 (compatible; GoogleDocs; apps-presentations; url) - -
 www.google.com/feedfetcher.htmlapplication/xmlMozilla/5.0 (compatible) FeedFetcher-Google; (url) - -
 code.google.com/appenginetext/..Mozilla/5.0 (Windows; Windows NT 5.1; en-US; rv:1.9.0.7) Gecko/2009021910 Firefox/3.0.7 AppEngine-Google; (url; appid: s~fonetika3) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: wikien4) - -
 www.google.com/bot.htmltext/..SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; GoogleBot-Mobile/2.1; url) - -
 docs.google.comimage/..Mozilla/5.0 (compatible; GoogleDocs; documents; url) - -
 code.google.com/appenginetext/..Acre/dev/50:887 refinery.freebase.com AppEngine-Google; (url; appid: s~freebase-refinery) - -
 www.google.com/bot.htmltext/..DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; GoogleBot-Mobile/2.1; url) - -
 code.google.com/appengineapplication/xmlAppEngine-Google; (url; appid: wikipedia-raw) - -
 code.google.com/appenginetext/..Wiki.java 0.27 AppEngine-Google; (url; appid: wikipediatools) - -
 desktop.google.com/-Mozilla/5.0 (compatible; Google Desktop/5.9.1005.12335; url) -
 code.google.com/appenginetext/..Python-urllib/2.5 AppEngine-Google; (url; appid: s~isnt-it) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~kasumiremix) - -
 www.google.com/bot.htmltext/..GoogleBot/2.1 (url) - -
 code.google.com/appenginetext/..www.productontology.org/1.0 (Contact: mail address ) AppEngine-Google; (url; appid: gr4bing) - -
 www.google.com/bot.html-SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; GoogleBot-Mobile/2.1; url) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: usawebdl) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: d24-img) - -
 www.google.com/bot.html-DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; GoogleBot-Mobile/2.1; url) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~francetiki) - -
 www.google.com/feedfetcher.htmltext/..Mozilla/5.0 (compatible) FeedFetcher-Google;(url) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: my-api) - -
 www.google.com/bot.htmlNONE/wikipedia- Mozilla/5.0 (compatible; GoogleBot/2.1; url) - -
 docs.google.comtext/..Mozilla/5.0 (compatible; GoogleDocs; script; url) - -
 code.google.com/appengineimage/..AppEngine-Google; (url; appid: usawebproxy0) - -
 www.google.com/coop/cse/creftext/..FeedFetcher-Google-CoOp; (url) - -
 www.google.com/bot.htmlimage/..Mozilla/5.0 (iPhone; CPU iPhone OS 4_1 like Mac OS X; en-us) AppleWebKit/532.9 KHTML Version/4.0.5 Mobile/8B117 Safari/6531.22.7 (compatible; GoogleBot-Mobile/2.1; url) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: boxapp) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~misterhac) - -
 www.google.com/bot.htmlapplication/pdfMozilla/5.0 (compatible; GoogleBot/2.1; url) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~espanatiki) - -
 code.google.com/appenginetext/..www.productontology.org/1.0 (Contact: martin.heppATunibw.de) AppEngine-Google; (url; appid: gr4bing) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~japantiki) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~app3123ak) - -
 code.google.com/appengineapplication/jsonMozilla/5.0 AppEngine-Google; (url; appid: s~redconceptual) - -
 code.google.com/appengineimage/..AppEngine-Google; (url; appid: s~misterhac) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: worldwide-propaganda) - -
 code.google.com/appenginetext/..Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/536.5 KHTML Chrome/19.0.1084.52 Safari/536.5 AppEngine-Google; (url; appid: seiyukyouen) - -
 code.google.com/appengineapplication/jsonMWBOT GAE Edition AppEngine-Google; (url; appid: philip-bot) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~sancampoen) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: threewiki) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~italiatiki) - -
 code.google.com/appenginetext/.. mail address AppEngine-Google; (url; appid: s~wiki-sherpa) - -
 desktop.google.com/image/..Mozilla/5.0 (compatible; Google Desktop/5.9.911.3589; url) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~win8wale) - -
 code.google.com/appengineimage/..AppEngine-Google; (url; appid: d24-img) - -
 www.google.com/feedfetcher.html-Mozilla/5.0 (compatible) FeedFetcher-Google; (url) - -
 docs.google.comimage/..Mozilla/5.0 (compatible; GoogleDocs; drawings; url) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: guidesites) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: toom16-10) - -
 code.google.com/appenginetext/..Acre/dev/50:889 refinery.freebase.com AppEngine-Google; (url; appid: s~freebase-refinery) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: kires-roxy) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~stremor-crawler) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: usawebproxy0) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~theunblock) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~drizzlprox) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: tunisistan) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: surf6003) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: beansacks) - -
 code.google.com/appengineapplication/jsonUser-Agent:Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/536.5 KHTML Chrome/19.0.1084.56 Safari/536.5 AppEngine-Google; (url; appid: s~in-onda) - -
 www.google.com/bot.htmlNONE/wikidata- Mozilla/5.0 (compatible; GoogleBot/2.1; url) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: proxyusing121) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: pazvantoff) - -
 code.google.com/appengineimage/..AppEngine-Google; (url; appid: boxapp) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: wmhsonline) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: thetechnolust) - -
 code.google.com/appenginetext/..Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_2) AppleWebKit/535.7 KHTML Chrome/16.0.912.77 Safari/535.7 AppEngine-Google; (url; appid: s~feedly-social) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: atxproxy) - -
 www.google.com/feedfetcher.htmlimage/..FeedFetcher-Google; (url) - -
 www.google.com/bot.htmlapplication/oggMozilla/5.0 (compatible; GoogleBot/2.1; url) - -
facebook
 www.facebook.com/externalhit_uatext.phpimage/..facebookexternalhit/1.1 (url) - -
 www.facebook.com/externalhit_uatext.phptext/..facebookexternalhit/1.1 (url) - -
 www.facebook.com/externalhit_uatext.phptext/..facebookexternalhit/1.0 (url) - -
 www.facebook.com/externalhit_uatext.phpimage/..facebookexternalhit/1.1 (url) -
 www.facebook.com/externalhit_uatext.phpimage/..facebookexternalhit/1.0 (url) - -
 developers.facebook.comimage/..facebookplatform/1.0 (url) - -
 www.facebook.com/externalhit_uatext.php-facebookexternalhit/1.1 (url) - -
 www.facebook.com/externalhit_uatext.phptext/..facebookexternalhit/1.1 (url) -
 www.facebook.com/externalhit_uatext.phptext/..facebookexternalhit/1.0 (url) -
 www.facebook.com/externalhit_uatext.php-facebookexternalhit/1.1 (url) -
 www.facebook.com/externalhit_uatext.php-facebookexternalhit/1.0 (url) - -
 developers.facebook.comimage/..facebookplatform/1.0 (url) -
 developers.facebook.com-facebookplatform/1.0 (url) - -
 www.facebook.com/externalhit_uatext.phpimage/..facebookexternalhit/1.0 (url) -
bing
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) - -
 www.bing.com/bingbot.htm-Mozilla/5.0 (compatible; bingbot/2.0; url) - -
 www.bing.com/bingbot.htm-Mozilla/5.0 (compatible; bingbot/2.0; url) -
 www.bing.com/bingbot.htmimage/..Mozilla/5.0 (compatible; bingbot/2.0; url) - -
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) (via Web-Blaster/2.21 (http://www.assoziations-blaster.de/web-blast.html)) - -
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) (via Web-Blaster/2.21 (http://www.a-blast.org/web-blast.html)) - -
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) -
 www.bing.com/bingbot.htmapplication/jsonMozilla/5.0 (compatible; bingbot/2.0; url) - -
 www.bing.com/bingbot.htmapplication/oggMozilla/5.0 (compatible; bingbot/2.0; url) - -
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: proxydisk8) - -
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: wxcity1) - -
 www.bing.com/bingbot.htmimage/..Mozilla/5.0 (compatible; bingbot/2.0; url) -
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: proxydisk9) - -
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: surf603) - -
google?
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) - -
 www.google.com/bot.html-Mozilla/5.0 (compatible; GoogleBot/2.1; url) -
 www.google.com/bot.htmltext/..GoogleBot/2.1 (url) - -
 www.google.com/bot.htmltext/..Mozilla/5.0 (iPhone; CPU iPhone OS 4_1 like Mac OS X; en-us) AppleWebKit/532.9 KHTML Version/4.0.5 Mobile/8B117 Safari/6531.22.7 (compatible; GoogleBot-Mobile/2.1; url) - -
 www.google.com/bot.html-Mozilla/5.0 (compatible; GoogleBot/2.1; url) - -
 www.google.com/bot.htmlimage/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) - -
 www.google.com/bot.htmltext/..GoogleBot/2.1 (url) en-us,en-gb,en;q=0.7,*;q=0.3 -
 www.google.com/bot.htmlapplication/jsonMozilla/5.0 (compatible; GoogleBot/2.1; url) - -
 www.google.com/bot.html-Mozilla/5.0 (iPhone; CPU iPhone OS 4_1 like Mac OS X; en-us) AppleWebKit/532.9 KHTML Version/4.0.5 Mobile/8B117 Safari/6531.22.7 (compatible; GoogleBot-Mobile/2.1; url) - -
 www.google.com/bot.htmltext/..GoogleBot/2.1 (url) en-us,en;q=0.5 -
 www.google.com/bot.htmlimage/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) en-US,en;q=0.8 -
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) en-US,en;q=0.8 -
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) bg -
 www.google.com/bot.html-GoogleBot/2.1 (url) en-us,en;q=0.5
 www.google.com/bot.htmltext/..DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; GoogleBot-Mobile/2.1; url) - -
 www.google.com/bot.html-DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; GoogleBot-Mobile/2.1; url) - -
 www.google.com/bot.htmlimage/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) en-US,en;q=0.5 -
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) - -
yandex
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; url) ru, uk;q=0.8, be;q=0.8, en;q=0.7, *;q=0.01 -
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; url) en-us, en;q=0.7, *;q=0.01 -
 yandex.com/bots-Mozilla/5.0 (compatible; YandexBot/3.0; url) ru, uk;q=0.8, be;q=0.8, en;q=0.7, *;q=0.01 -
 yandex.com/bots-Mozilla/5.0 (compatible; YandexBot/3.0; url) en-us, en;q=0.7, *;q=0.01 -
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexImages/3.0; url) - -
 yandex.com/botsimage/..Mozilla/5.0 (compatible; YandexImageResizer/2.0; url) - -
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; url) - -
 yandex.com/bots-Mozilla/5.0 (compatible; YandexImageResizer/2.0; url) -
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexImages/3.0; url) ru, uk;q=0.8, be;q=0.8, en;q=0.7, *;q=0.01 -
 yandex.com/botsimage/..Mozilla/5.0 (compatible; YandexImages/3.0; url) - -
 yandex.com/botsimage/..Mozilla/5.0 (compatible; YandexImages/3.0; url) ru, uk;q=0.8, be;q=0.8, en;q=0.7, *;q=0.01 -
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexDirect/3.0; url) ru, uk;q=0.8, be;q=0.8, en;q=0.7, *;q=0.01 -
 yandex.com/bots-Mozilla/5.0 (compatible; YandexBot/3.0; url) -
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; MirrorDetector; url) ru, uk;q=0.8, be;q=0.8, en;q=0.7, *;q=0.01 -
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; url) de, en;q=0.7, *;q=0.01 -
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexImages/3.0; url) en-us, en;q=0.7, *;q=0.01 -
 yandex.com/bots-Mozilla/5.0 (compatible; YandexBot/3.0; url) - -
 yandex.com/bots-Mozilla/5.0 (compatible; YandexImages/3.0; url) -
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexDirect/3.0; url) en-us, en;q=0.7, *;q=0.01 -
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; MirrorDetector; url) en-us, en;q=0.7, *;q=0.01 -
 yandex.com/bots-Mozilla/5.0 (compatible; YandexBot/3.0; MirrorDetector; url) ru, uk;q=0.8, be;q=0.8, en;q=0.7, *;q=0.01 -
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexImageResizer/2.0; url) - -
 yandex.com/bots-Mozilla/5.0 (compatible; YandexImages/3.0; url) - -
baidu
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) zh-cn,zh-tw -
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) en-US -
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) - -
 www.baidu.com/search/spider.html-Mozilla/5.0 (compatible; Baiduspider/2.0; url) zh-cn,zh-tw -
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) ja-JP,ja -
 www.baidu.com/search/spider.html-Mozilla/5.0 (compatible; Baiduspider/2.0; url) en-US -
 www.baidu.com/search/spider.htmtext/..Baiduspider-image(url) - -
 www.baidu.com/search/spider.htmimage/..Baiduspider-image(url) - -
 www.baidu.com/search/spider.html-Mozilla/5.0 (compatible; Baiduspider/2.0; url) en-us,en;q=0.5 -
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) en-us,en;q=0.5 -
 www.baidu.com/search/spider.html-Mozilla/5.0 (compatible; Baiduspider/2.0; url) -
 www.baidu.com/search/spider.htmlapplication/jsonMozilla/5.0 (compatible; Baiduspider/2.0; url) - -
 www.baidu.com/search/spider.html-Mozilla/5.0 (compatible; Baiduspider/2.0; url) ja-JP,ja -
 www.baidu.com/search/spider.htmlapplication/jsonMozilla/5.0 (compatible; Baiduspider/2.0; url) en-us,en;q=0.5 -
 www.baidu.com/search/spider.htmlimage/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) zh-cn,zh-tw -
naver
 help.naver.com/robots/text/..Yeti/1.0 (NHN Corp.; url) ko,en;q=0.5 -
 help.naver.com/robots/text/..Yeti/1.0 (NHN Corp.; url) ja,en;q=0.5 -
 help.naver.com/robots/text/..Yeti/1.0 (NHN Corp.; url) ko,ja,en;q=0.5 -
 help.naver.com/robots/-Yeti/1.0 (NHN Corp.; url) ko,en;q=0.5 -
 help.naver.com/robots/-Yeti/1.0 (NHN Corp.; url) ja,en;q=0.5 -
 help.naver.com/robots/text/..Yeti/1.0 (NHN Corp.; url) - -
 help.naver.com/robots/text/..Yeti/1.1 (NHN Corp.; url) vi_VN,vi;q=0.8,en-US;q=0.6,en;q=0.4 -
 help.naver.com/robots/image/..Yeti/1.0 (NHN Corp.; url) ja,en;q=0.5 -
 help.naver.com/robots/image/..Yeti/1.1 (NHN Corp.; url) vi_VN,vi;q=0.8,en-US;q=0.6,en;q=0.4 -
 help.naver.com/robots/image/..Yeti/1.0 (NHN Corp.; url) ko,ja,en;q=0.5 -
 help.naver.com/robots/-Yeti/1.0 (NHN Corp.; url) -
 help.naver.com/robots/application/jsonYeti/1.0 (NHN Corp.; url) - -
msn
 search.msn.com/msnbot.htmtext/..msnbot-media/1.1 (url) - -
 search.msn.com/msnbot.htmimage/..msnbot-media/1.1 (url) - -
 search.msn.com/msnbot.htmtext/..msnbot/2.0b (url) - -
 search.msn.com/msnbot.htmtext/..msnbot-NewsBlogs/2.0b (url) - -
 search.msn.com/msnbot.htmimage/..msnbot-NewsBlogs/2.0b (url) - -
 search.msn.com/msnbot.htmimage/..msnbot/2.0b (url) - -
 search.msn.com/msnbot.htmtext/..msnbot-Products/1.0 (url) - -
 search.msn.com/msnbot.htmtext/..msnbot-UDiscovery/2.0b (url) - -
 search.msn.com/msnbot.htmtext/..msnbot/0.01 (url) - -
 search.msn.com/msnbot.htm-msnbot-media/1.1 (url) - -
 search.msn.com/msnbot.htm-msnbot-media/1.1 (url) -
yahoo
 help.yahoo.com/help/us/ysearch/slurpimage/..Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; url) NOT Firefox/3.5 en-us,en;q=0.5 -
 help.yahoo.com/help/us/ysearch/slurptext/..Mozilla/5.0 (compatible; Yahoo! Slurp; url) en-us,en;q=0.5 -
 help.yahoo.com/help/us/ysearch/slurptext/..Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; url) NOT Firefox/3.5 en-us,en;q=0.5 -
 help.yahoo.com/help/us/ysearch/slurptext/..Mozilla/5.0 (compatible; Yahoo! Slurp; url) - -
 help.yahoo.co.jp/help/jp/search/indexing/indexing-15.htmltext/..Y!J-BRJ/YATS crawler (url) - -
 help.yahoo.com/help/us/ysearch/slurptext/..Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; url) en-us,en;q=0.5 -
 help.yahoo.com/help/us/ysearch/slurp-Mozilla/5.0 (compatible; Yahoo! Slurp; url) en-us,en;q=0.5 -
 help.yahoo.com/help/us/ysearch/slurpapplication/jsonMozilla/5.0 (compatible; Yahoo! Slurp/3.0; url) NOT Firefox/3.5 en-us,en;q=0.5 -
 help.yahoo.com/help/us/ysearch/slurp-Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; url) en-us,en;q=0.5 -
 developer.yahoo.com/yql/providertext/..Mozilla/5.0 (compatible; Yahoo Pipes 2.0; url) Gecko/20090729 Firefox/3.5.2 - -
 help.yahoo.co.jp/help/jp/search/indexing/indexing-15.htmltext/..Y!J-BRT/1.0 crawler (url) - -
 help.yahoo.co.jp/help/jp/search/indexing/indexing-15.htmltext/..Y!J-BRW/1.0 crawler (url) - -
 help.yahoo.co.jp/help/jp/search/indexing/indexing-15.htmltext/..Y!J-BRW/1.0 crawler (url) ja, *;q=0.5 -
 help.yahoo.com/help/us/ysearch/slurpapplication/xmlMozilla/5.0 (compatible; Yahoo! Slurp;url) - -
 help.yahoo.com/help/us/ysearch/slurp-Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; url) NOT Firefox/3.5 en-us,en;q=0.5 -
 help.yahoo.com/help/us/ysearch/slurpimage/..Mozilla/5.0 (compatible; Yahoo! Slurp; url) en-us,en;q=0.5 -
digplanet
 www.digplanet.com/wikiapplication/vnd.php.serializedDigplanet/1.0 (url; ) PHP/5.4 - -
youdao
 www.youdao.com/help/webmaster/spider/text/..Mozilla/5.0 (compatible; YoudaoBot/1.0; url; ) - -
 www.youdao.com/help/webmaster/spider/-Mozilla/5.0 (compatible; YoudaoBot/1.0; url; ) -
 www.youdao.com/help/webmaster/spider/text/..Mozilla/5.0 (compatible; YoudaoBot/1.0; url; ) zh-cn;q=1.0, zh-tw;q=0.8, en;q=0.5, *;q=0.1 -
 www.youdao.com/help/webmaster/spider/-Mozilla/5.0 (compatible; YoudaoBot/1.0; url; ) zh-cn;q=1.0, zh-tw;q=0.8, en;q=0.5, *;q=0.1 -
 toolbar.youdao.com/image/..Youdao Toolbar (url) - -
cibra
 cibra.de/text/..CiBra Data Collector (url) - -
orange
 wikipedia.orange.fr/text/..API/1.0 (url) - -
 wikipedia.orange.fr/application/xmlAPI/1.0 (url) - -
ahrefs
 ahrefs.com/robot/text/..Mozilla/5.0 (compatible; AhrefsBot/4.0; url) - -
 ahrefs.com/robot/-Mozilla/5.0 (compatible; AhrefsBot/4.0; url) - -
 ahrefs.com/robot/-Mozilla/5.0 (compatible; AhrefsBot/4.0; url) -
 ahrefs.com/robot/text/..Mozilla/5.0 (compatible; AhrefsBot.FreshPages/0.1; url) - -
 ahrefs.com/robot/application/jsonMozilla/5.0 (compatible; AhrefsBot/4.0; url) - -
 ahrefs.com/robot/NONE/wikidata- Mozilla/5.0 (compatible; AhrefsBot/4.0; url) - -
 ahrefs.com/robot/text/..Mozilla/5.0 (compatible; AhrefsBot/4.0; url) (via Web-Blaster/2.21 (http://www.assoziations-blaster.de/web-blast.html)) - -
genieo
 www.genieo.com/webfilter.htmltext/..Mozilla/5.0 (compatible; Genieo/1.0 url) - -
 www.genieo.com/webfilter.htmlapplication/xmlMozilla/5.0 (compatible; Genieo/1.0 url) - -
 www.genieo.com/webfilter.htmlimage/..Mozilla/5.0 (compatible; Genieo/1.0 url) - -
 www.genieo.com/webfilter.htmlimage/..Mozilla/5.0 (compatible; Genieo/1.0 url) en,*
sblog
 fulltext.sblog.cz/screenshot/image/..Mozilla/5.0 (compatible; Seznam screenshot-generator 2.0; url) cs,cz,sk;q=0.7,*;q=0.5 -
 fulltext.sblog.cz/text/..SeznamBot/3.0 (url) cs -
 fulltext.sblog.cz/screenshot/text/..Mozilla/5.0 (compatible; Seznam screenshot-generator 2.0; url) cs,cz,sk;q=0.7,*;q=0.5 -
 fulltext.sblog.cz/-SeznamBot/3.0 (url) cs -
 fulltext.sblog.cz/screenshot/-Mozilla/5.0 (compatible; Seznam screenshot-generator 2.0; url) cs,cz,sk;q=0.7,*;q=0.5 -
 fulltext.sblog.cz/screenshot/text/..Mozilla/5.0 (compatible; Seznam screenshot-generator 2.0; url) - -
 fulltext.sblog.cz/screenshot/-Mozilla/5.0 (compatible; Seznam screenshot-generator 2.0; url) - -
80legs
 www.80legs.com/webcrawler.htmltext/..Mozilla/5.0 (compatible; 008/0.85; url) Gecko/2008032620 - -
zum
 help.zum.com/inquirytext/..ZumBot/1.0 (ZUM Search; url) - -
 help.zum.com/inquiryimage/..ZumBot/1.0 (ZUM Search; url) - -
soso
 help.soso.com/webspider.htmtext/..Sosospider(url) zh-cn,zh-hk,zh-tw,en-us -
 help.soso.com/webspider.htmtext/..Mozilla/5.0(compatible; Sosospider/2.0; url) zh-cn,zh-hk,zh-tw,en-us -
 help.soso.com/webspider.htmapplication/xmlSosospider(url) zh-cn,zh-hk,zh-tw,en-us -
 help.soso.com/webspider.htm-Sosospider(url) zh-cn,zh-hk,zh-tw,en-us -
www.
 www.text/..GoogleBot/2.1 ( urlGoogleBot.com/bot.html) - -
 www.text/..GoogleBot-Image/1.0 ( urlGoogleBot.com/bot.html) - -
 www.text/..GoogleBot/2.1 (urlGoogleBot.com/bot.html) - -
php
 pear.php.net/application/vnd.php.serializedPEAR HTTP_Request class ( url ) - -
 pear.php.net/package/http_request2text/..HTTP_Request2/0.5.2 (url) PHP/5.2.17 - -
 pear.php.net/text/..PEAR HTTP_Request class ( url ) - -
 pear.php.net/image/..PEAR HTTP_Request class ( url ) - -
 pear.php.net/package/http_request2application/xmlHTTP_Request2/2.0.0 (url) PHP/5.3.8 - -
 pear.php.net/package/http_request2text/..HTTP_Request2/2.1.1 (url) PHP/5.3.2-1ubuntu4.18 - -
 pear.php.net/package/http_request2image/..HTTP_Request2/2.1.1 (url) PHP/5.3.2-1ubuntu4.18 - -
exabot
 www.exabot.com/go/robottext/..Mozilla/5.0 (compatible; Exabot/3.0; url) - -
 www.exabot.com/go/robottext/..Mozilla/5.0 (compatible; Exabot/3.0 (BiggerBetter); url) - -
 www.exabot.com/go/robot-Mozilla/5.0 (compatible; Exabot/3.0; url) - -
wordpress
 josefboberg.wordpress.comtext/..WordPress/3.6-alpha-23334; url - -
 thesandymonocle.wordpress.comtext/..WordPress/3.6-alpha-23334; url - -
 jaggedykaye.wordpress.comtext/..WordPress/3.6-alpha-23334; url - -
 greatriversofhope.wordpress.comtext/..WordPress/3.6-alpha-23334; url - -
 wildanrenaldi.wordpress.comtext/..WordPress/3.6-alpha-23334; url - -
 lesliebrodie.wordpress.comtext/..WordPress/3.6-alpha-23334; url - -
 bestofactus.wordpress.comtext/..WordPress/3.6-alpha-23334; url - -
 kingcrimsonprog.wordpress.comimage/..WordPress/3.6-alpha-23334; url - -
 02varvara.wordpress.comtext/..WordPress/3.6-alpha-23334; url - -
 urielarte.wordpress.comtext/..WordPress/3.6-alpha-23334; url - -
 radishmag.wordpress.comtext/..WordPress/3.6-alpha-23334; url - -
 tsjok45.wordpress.comtext/..WordPress/3.6-alpha-23334; url - -
 gunnyg.wordpress.comtext/..WordPress/3.6-alpha-23334; url - -
 usazorrozpress.wordpress.comtext/..WordPress/3.6-alpha-23334; url - -
 novalandhikablog.wordpress.comtext/..WordPress/3.6-alpha-23334; url - -
 melusinefee.wordpress.comtext/..WordPress/3.6-alpha-23334; url - -
toolserver
 wiki.toolserver.org/view/GeoHacktext/..Geohack (url) - -
 wiki.toolserver.org/view/GeoHack-Geohack (url) -
 toolserver.org/~dispenser/text/..DispensersTools (url) - -
 toolserver.org/~dispenser/-DispensersTools (url) -
 toolserver.org/~dispenser/application/x-www-form-urlencodedDispensersTools (url) -
 toolserver.org/~dispenser/application/jsonDispensersTools (url) - -
 toolserver.org/~para/cgi-bin/kmlexporttext/..url libwww-perl/6.02 - -
wikipedia
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/2.1.20.0 url - -
 en.wikipedia.org/wiki/User:NicoV/Wikipedia_Cleaner/Documentationtext/..WPCleaner (url) - -
 en.wikipedia.org/wiki/User:NicoV/Wikipedia_Cleaner/Documentation-WPCleaner (url) - -
 fr.wikipedia.org/wiki/Utilisateur:OrlodrimBottext/..OrlodrimBot/1.0 (url) - -
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/2.1.19.0 url - -
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/2.1.20 url - -
 fr.wikipedia.org/wiki/Utilisateur:OrlodrimBot-OrlodrimBot/1.0 (url) - -
 fr.wikipedia.org/wiki/Utilisateur:Salebotapplication/jsonSalebot, see url (uses Perl MediaWiki::API) - -
 en.wikipedia.org/wiki/Wikipedia_talk:Database_reports'application/json('url,) - -
echonest
 the.echonest.com/reader/application/xmlnestReader/0.3 (discovery; url; reader at echonest.com) en -
 the.echonest.com/reader/text/..nestReader/0.3 (discovery; url; reader at echonest.com) en -
sogou
 www.sogou.com/docs/help/webmasters.htm#07text/..Sogou web spider/4.0(url) zh-cn -
 www.sogou.com/docs/help/webmasters.htm#07-Sogou web spider/4.0(url) zh-cn -
 www.sogou.com/docs/help/webmasters.htm#07text/..Sogou web spider/4.0(url) - -
 www.sogou.com/docs/help/webmasters.htm#07text/..Sogou Pic Spider/3.0(url) zh-cn -
 www.sogou.com/docs/help/webmasters.htm#07application/jsonSogou web spider/4.0(url) - -
semrush
 www.semrush.com/bot.htmltext/..Mozilla/5.0 (compatible; SemrushBot/0.95; url) - -
blekko
 blekko.com/about/blekkobottext/..Mozilla/5.0 (compatible; Blekkobot; ScoutJet; url) - -
 blekko.com/about/blekkobot-Mozilla/5.0 (compatible; Blekkobot; ScoutJet; url) - -
yacy
 yacy.net/bot.htmltext/..yacybot (freeworld/global; amd64 Linux 2.6.32-custom; java 1.6.0_26; Europe/en) url en-us,en;q=0.5 -
 yacy.net/bot.htmltext/..yacybot (freeworld/global; amd64 Windows 7 6.1; java 1.7.0_04; Europe/de) url en-us,en;q=0.5 -
 yacy.net/bot.htmltext/..yacybot (freeworld/global; amd64 Linux 3.2.0-34-generic; java 1.6.0_27; Europe/ru) url en-us,en;q=0.5 -
 yacy.net/bot.htmltext/..yacybot (freeworld/global; amd64 Linux 3.2.0-38-generic; java 1.6.0_27; Europe/lv) url en-us,en;q=0.5 -
 yacy.net/bot.htmltext/..yacybot (webportal-global; x86 Windows XP 5.1; java 1.7.0_17; Europe/es) url en-us,en;q=0.5 -
 yacy.net/bot.html-yacybot (freeworld/global; amd64 Linux 3.2.0-34-generic; java 1.6.0_27; Europe/ru) url en-us,en;q=0.5 -
 yacy.net/bot.htmltext/..yacybot (freeworld/global; amd64 Linux 3.2.13-grsec-xxxx-grs-ipv6-64; java 1.6.0_27; Europe/en) url en-us,en;q=0.5 -
 yacy.net/bot.htmltext/..yacybot (freeworld/global; amd64 Windows 7 6.1; java 1.6.0_31; Europe/de) url en-us,en;q=0.5 -
 yacy.net/bot.htmltext/..yacybot (freeworld/global; amd64 Windows 7 6.1; java 1.6.0_41; Europe/de) url en-us,en;q=0.5 -
 yacy.net/bot.htmltext/..yacybot (freeworld/global; amd64 Windows 7 6.1; java 1.7.0_13; Europe/de) url en-us,en;q=0.5 -
 yacy.net/bot.htmltext/..yacybot (freeworld-global; amd64 Linux 3.2.0-37-generic; java 1.7.0_13; Europe/en) url en-us,en;q=0.5 -
 yacy.net/bot.htmltext/..yacybot (webportal-global; amd64 Windows 7 6.1; java 1.7.0_11; Asia/zh) url en-us,en;q=0.5 -
 yacy.net/bot.htmltext/..yacybot (freeworld-global; amd64 Linux 3.5.0-25-generic; java 1.7.0_17; Europe/de) url en-us,en;q=0.5 -
 yacy.net/bot.htmltext/..yacybot (freeworld/global; amd64 Linux 3.1.10-1.16-default; java 1.6.0_27; Europe/de) url en-us,en;q=0.5 -
 yacy.net/bot.htmltext/..yacybot (freeworld-global; amd64 Linux 3.2.0-37-generic; java 1.6.0_27; Europe/en) url en-us,en;q=0.5 -
 yacy.net/bot.htmltext/..yacybot (webportal/global; amd64 Linux 3.2.0-39-generic; java 1.7.0_15; Europe/en) url en-us,en;q=0.5 -
 yacy.net/bot.htmltext/..yacybot (freeworld/global; amd64 Linux 3.7.9-2-ARCH; java 1.7.0_15; Europe/fr) url en-us,en;q=0.5 -
 yacy.net/bot.htmltext/..yacybot (freeworld/global; amd64 Linux 3.2.0-4-amd64; java 1.7.0_03; Europe/de) url en-us,en;q=0.5 -
 yacy.net/bot.htmltext/..yacybot (freeworld/global; amd64 Windows Server 2008 R2 6.1; java 1.7.0_17; Europe/de) url en-us,en;q=0.5 -
jike
 shoulu.jike.com/spider.htmltext/..Mozilla/5.0 (compatible; JikeSpider; url) zh-cn;q=0.8, *;q=0.5 -
 shoulu.jike.com/spider.htmltext/..Mozilla/5.0 (compatible; JikeSpider; url) - -
 shoulu.jike.com/spider.html-Mozilla/5.0 (compatible; JikeSpider; url) zh-cn;q=0.8, *;q=0.5 -
 shoulu.jike.com/spider.htmlapplication/jsonMozilla/5.0 (compatible; JikeSpider; url) - -
majestic12
 www.majestic12.co.uk/bot.php?text/..Mozilla/5.0 (compatible; MJ12bot/v1.4.3; url) - -
 www.majestic12.co.uk/bot.php?text/..Mozilla/5.0 (compatible; MJ12bot/v1.4.3; url) en -
 www.majestic12.co.uk/bot.php?-Mozilla/5.0 (compatible; MJ12bot/v1.4.3; url) -
cognarius
 cognarius.com-AppsArlak/1.0 (url) -
 cognarius.comapplication/jsonAppsArlak/1.0 (url) - -
 cognarius.comtext/..AppsArlak/1.0 (url) - -
143
 173.13.143.74/bot.phptext/..Mozilla/5.0 (compatible; YioopBot; url) - -
 173.13.143.74/bot.phpimage/..Mozilla/5.0 (compatible; YioopBot; url) - -
 173.13.143.74/bot.php-Mozilla/5.0 (compatible; YioopBot; url) - -
pagefreezer
 pagefreezer.com/pagefreezer-crawler/image/..PageFreezer (pagefreezer crawler; url; mail address ) en-us,en;q=0.5 -
 pagefreezer.com/pagefreezer-crawler/text/..PageFreezer (pagefreezer crawler; url; mail address ) en-us,en;q=0.5 -
gnip
 www.gnip.com/text/..UnwindFetchor/1.0 (url) - -
 www.gnip.com/image/..UnwindFetchor/1.0 (url) - -
mail
 go.mail.ru/help/robotstext/..Mozilla/5.0 (compatible; Mail.RU_Bot/2.0; url) ru,ua;q=0.7,by;q=0.7,*;q=0.1 -
 go.mail.ru/help/robotstext/..Mozilla/5.0 (compatible; Mail.RU_Bot/2.0; url) - -
 go.mail.ru/help/robotsimage/..Mozilla/5.0 (compatible; Mail.RU_Bot/2.0; url) ru,ua;q=0.7,by;q=0.7,*;q=0.1 -
scrapy
 scrapy.orgtext/..Scrapy/0.16.4 (url) en -
wikidict
 www.wikidict.detext/..url - -
flipboard
 flipboard.com/browserproxyimage/..Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (FlipboardProxy/0.0.5; url) en-us,en;q=0.5 -
 flipboard.com/browserproxytext/..Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (FlipboardProxy/1.1; url) en-us,en;q=0.5 -
 flipboard.com/browserproxytext/..Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (FlipboardProxy/0.0.5; url) en-us,en;q=0.5 -
 flipboard.com/browserproxyimage/..null (FlipboardProxy/1.1; url) - -
 flipboard.com/browserproxy-Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (FlipboardProxy/0.0.5; url) en-us,en;q=0.5 -
 flipboard.com/browserproxy-Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (FlipboardProxy/1.1; url) en-us,en;q=0.5 -
plos
 alm.plos.orgapplication/jsonPLoS Article Level Metrics - url - -
 alm.plos.org-PLoS Article Level Metrics - url -
 alm2-dev.plos.orgapplication/jsonArticle Level Metrics - url - -
coccoc
 help.coccoc.com/text/..coccoc/1.0 (url) en-us;q=0.7,en;q=0.3 -
 help.coccoc.com/-coccoc/1.0 (url) en-us;q=0.7,en;q=0.3 -
 help.coccoc.com/text/..coccoc/1.0 (url) - -
 help.coccoc.com/image/..coccoc/1.0 (url) en-us;q=0.7,en;q=0.3 -
easou
 www.easou.com/search/spider.htmltext/..Mozilla/5.0 (compatible; EasouSpider; url) zh;q=0.9,en;q=0.8 -
 www.easou.com/search/spider.htmlapplication/jsonMozilla/5.0 (compatible; EasouSpider; url) - -
bin-co
 www.bin-co.com/php/scripts/load/text/..BinGet/1.00.A (url) - -
 www.bin-co.com/php/scripts/load/application/vnd.php.serializedBinGet/1.00.A (url) - -
traslated
 mymemory.traslated.net/doc/text/..Mozilla/5.0 (MyMemory Bot url) - -
goo
 help.goo.ne.jp/contact/text/..goo wikipedia (url) - -
 help.goo.ne.jp/door/crawler.htmltext/..ichiro/3.0 (url) - -
 search.goo.ne.jp/option/use/sub4/sub4-1/text/..DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo;url) - -
 search.goo.ne.jp/option/use/sub4/sub4-1/-DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo;url) - -
 search.goo.ne.jp/option/use/sub4/sub4-1/-DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo; url) - -
 goo.gl/7y4SXimage/..GoogleProducer; (url) - -
 goo.gl/7y4SXtext/..GoogleProducer; (url) - -
localhost
 localhost/wordpresstext/..WordPress/3.5.1; url - -
 localhost/wp2text/..WordPress/3.5; url - -
 localhost/1text/..WordPress/3.5.1; url - -
 localhost/search/bot.phptext/..Mozilla/5.0 (compatible; WooMeter; url) - -
 localhost/2text/..WordPress/3.5.1; url - -
 localhost/uknewtext/..WordPress/3.5.1; url - -
 localhost/JPtext/..WordPress/3.5.1; url - -
archive
 www.archive.org/details/archive.org_bottext/..Mozilla/5.0 (compatible; archive.org_bot url) - -
 www.archive.org/details/archive.org_botimage/..Mozilla/5.0 (compatible; special_archiver/3.1.1 url) - -
 archive.org/details/archive.org_botimage/..Mozilla/5.0 (compatible; heritrix/3.1.2-SNAPSHOT-20121013.132750 url) - -
 www.archive.org/details/archive.org_botimage/..Mozilla/5.0 (compatible; archive.org_bot url) - -
 www.archive.org/details/archive.org_bottext/..Mozilla/5.0 (compatible; special_archiver/3.1.1 url) - -
 www.archive.org/details/archive.org_bot-Mozilla/5.0 (compatible; archive.org_bot url) - -
SearchNearMe
 SearchNearMe.com/contact.phpapplication/vnd.php.serializedSearchNearMe (url) - -
 SearchNearMe.com/contact.phptext/..SearchNearMe (url) - -
bsurprised
 bsurprised.com/text/..BSurprised WikiBox 0.1.3 (url) en -
 bsurprised.com/text/..BSurprised WikiBox 0.1.3 (url) af -
 bsurprised.com/-BSurprised WikiBox 0.1.3 (url) en
 bsurprised.com/text/..BSurprised WikiBox 0.1.3 (url) hu -
topsy
 labs.topsy.com/butterfly/text/..Mozilla/5.0 (compatible; Butterfly/1.0; url) Gecko/2009032608 Firefox/3.0.8 - -
 labs.topsy.com/butterfly/-Mozilla/5.0 (compatible; Butterfly/1.0; url) Gecko/2009032608 Firefox/3.0.8 - -
elcidharth
 elcidharth.comtext/..WordPress/3.6-alpha-23334; url - -
 elcidharth.comimage/..WordPress/3.6-alpha-23334; url - -
okian
 www.okian.ro/text/..MyBot/1.0 (url) - -
daum
 tab.search.daum.net/aboutWebSearch.htmltext/..Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows server; url) Daumoa/3.0 ko-kr,ko;q=0.8,en-us;q=0.5,en;q=0.3 -
 tab.search.daum.net/aboutWebSearch.htmltext/..Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows server; url) Daumoa/3.0 - -
in
 www.m-culture.in.thtext/..m-culture.in.th (url) - -
sistrix
 crawler.sistrix.net/text/..Mozilla/5.0 (compatible; SISTRIX Crawler; url) - -
ac
 www.tkl.iis.u-tokyo.ac.jp/~crawler/text/..Mozilla/5.0 (compatible; Steeler/3.5; url) ja,en -
 www.clips.ua.ac.be/pages/patternapplication/jsonPattern/2.3 url - -
 www.clips.ua.ac.be/pages/patterntext/..Pattern/2.3 url - -
 www.ninjal.ac.jp/corpus_center/ulc/crawl-entext/..Mozilla/5.0 (compatible; heritrix/3.1.1 url) - -
kosmix
 www.kosmix.com/html/kosmos.htmlapplication/xmlMozilla/5.0(compatible;Kosmos/1.0;url) - -
wikimedia
 commons.wikimedia.org/wiki/User:Thumbnails_Check_Botimage/..Thumbnails_Check_Bot/0.1 (url; beta) - -
 tools.wikimedia.de/~para/GeoCommons/text/..url - -
 commons.wikimedia.org/wiki/User:Thumbnails_Check_Bottext/..Thumbnails_Check_Bot/0.1 (url; beta) - -
picsearch
 www.picsearch.com/bot.htmltext/..psbot/0.1 (url) - -
 www.picsearch.com/bot.htmlimage/..psbot/0.1 (url) - -
weblio
 www.weblio.jp/info/crawler.jspimage/..Mozilla/5.0 (compatible; Webliobot/0.1; url) - -
 www.weblio.jp/text/..Mozilla/5.0 (compatible; WeblioBot; url) - -
 www.weblio.jp/info/crawler.jsptext/..Mozilla/5.0 (compatible; Webliobot/0.1; url) - -
paper
 support.paper.li/entries/20023257-what-is-paper-litext/..Mozilla/5.0 (compatible; PaperLiBot/2.1; url) - -
z-add
 w3.z-add.co.uk/linkcheck/text/..Z-Add Link Checker (url) - -
speaktoit
 www.speaktoit.comapplication/jsonSpeaktoit url - -
emining
 emining.jp/text/..emBot-GalaBuzz/Nutch-1.0 (url; mail address ) en-us,en-gb,en;q=0.7,*;q=0.3 -
wikimpress
 wikimpress.org/text/..Mozilla/5.0 (compatible; Linux i686 (x86_64); de-DE; url>Wikimpress) Wikimpress/1.0 - -
 wikimpress.org/-Mozilla/5.0 (compatible; Linux i686 (x86_64); de-DE; url>Wikimpress) Wikimpress/1.0 - -
federatedmedia
 federatedmedia.nettext/..Mozilla/5.0 (url) Gecko/20061208 Firefox/2.0.0.1 en-us,en;q=0.5 -
linguee
 www.linguee.com/bottext/..Linguee Bot (url; mail address ) - -
 www.linguee.com/bot-Linguee Bot (url; mail address ) - -
archive-it
 archive-it.org/files/site-owners.htmltext/..Mozilla/5.0 (compatible; archive.org_bot; Archive-It; url) - -
 archive-it.org/files/site-owners.htmlimage/..Mozilla/5.0 (compatible; archive.org_bot; Archive-It; url) - -
drupal
 drupal.org/text/..Drupal (url) - -
 drupal.org/image/..Drupal (url) - -
 drupal.org/text/..User-Agent: Drupal (url) - -
apercite
 www.apercite.fr/robot/index.htmlimage/..Mozilla/5.0 (compatible; Apercite; url) en-us,en;q=0.5 -
muso
 www.muso.comtext/..Mozilla/5.0 (compatible; musobot/1.0; mail address ; url) - -
zeebox
 www.zeebox.comtext/..Zeebox (url) en-us,en;q=0.5 -
 www.zeebox.comapplication/jsonZeebox (url) en-us,en;q=0.5 -
bibalex
 archive.bibalex.org/bot/text/..Mozilla/5.0 (compatible; archive.bibalex.org_bot; url) - -
 archive.bibalex.org/bot/image/..Mozilla/5.0 (compatible; archive.bibalex.org_bot; url) - -
parsijoo
 www.parsijoo.ir/text/..Mozilla/5.0 (compatible; parsijoo url) - -
mediawiki
 www.mediawiki.org/text/..MediaWiki OAI Harvester 0.2 (url) - -
 www.mediawiki.org/-MediaWiki OAI Harvester 0.2 (url) -
wwwgogetpapers
 wwwgogetpapers.com/application/jsonUser-Agent: GoGetPapersBot (url) - -
leiki
 www.leiki.comtext/..Leikibot/1.0 (url) - -
tineye
 tineye.com/crawler.htmlapplication/jsonTinEye/1.1 (url) - -
yoursite
 yoursite.com/botinfotext/..Mozilla/5.0 (compatible; YourCoolBot/1.0; url) - -
tweetmeme
 tweetmeme.com/text/..Mozilla/5.0 (compatible; TweetmemeBot/3.0; url) en-gb,en;q=0.5 -
FeedBurner
 www.FeedBurner.comtext/..FeedBurner/1.0 (url) - -
embed
 support.embed.ly/image/..Mozilla/5.0 (compatible; Embedly/0.2; snap; url) - -
 support.embed.ly/text/..Mozilla/5.0 (compatible; Embedly/0.2; url) - -
abonti
 www.abonti.comtext/..Mozilla/5.0 (compatible; Abonti/0.91 - url) - -
mysite
 www.mysite.com/text/..MyBot/1.0 (url) - -
 www.mysite.com/-MyBot/1.0 (url) -
 www.mysite.com/application/jsonMyBot/1.0 (url) - -
easybib
 content.easybib.com/autocite/text/..EasyBib AutoCite (url) - -
 content.easybib.com/autocite/application/jsonEasyBib AutoCite (url) - -
frontle
 www.frontle.com/application/vnd.php.serializedFrontleBot/1.0 (url) - -
chickyrun
 chickyrun.tk/text/..ChickyBot/1.1 (url; mail address ) - -
alexa
 www.alexa.com/site/help/webmasterstext/..ia_archiver (url; mail address ) - -
yougorhymes
 www.yougorhymes.com/site/rhyme-bottext/..RhymeBot/0.1 (url) - -
 www.yougorhymes.com/site/rhyme-bot-RhymeBot/0.1 (url) -
hatena
 a.hatena.ne.jp/helptext/..Hatena Antenna/0.5 (url) - -
plagiarismcheck
 plagiarismcheck.orgapplication/jsonWikiCrawl 1.0b (url contact-mail: mail address ) - -
xbmc
 www.xbmc.orgimage/..XBMC/11.0 Git:20120702-f3cd288 (iOS; 11.0.0 AppleTV2,1, Version 5.1.1 (Build 9B830); url) - -
rockpeaks
 www.rockpeaks.com/contacttext/..RockPeaks/0.1 (url) - -
trendiction
 www.trendiction.de/botimage/..Mozilla/5.0 (Windows; Windows NT 6.0; en-GB; rv:1.0; trendictionbot0.5.0; trendiction search; url; please let us know of any problems; web at trendiction.com) Gecko/20071127 Firefox/3.0.0.11 en-gb,en;q=0.5 -
 www.trendiction.de/bottext/..Mozilla/5.0 (Windows; Windows NT 6.0; en-GB; rv:1.0; trendictionbot0.5.0; trendiction search; url; please let us know of any problems; web at trendiction.com) Gecko/20071127 Firefox/3.0.0.11 en-gb,en;q=0.5 -
simplepie
 simplepie.orgapplication/xmlSimplePie/1.2 (Feed Parser; url; Allow like Gecko) Build/20090627192103 - -
 simplepie.orgtext/..SimplePie/1.2 (Feed Parser; url; Allow like Gecko) Build/20090627192103 - -
friendofrenia
 friendofrenia.com/application/jsonUser-Agent: FriendoFrenia (url) - -
 friendofrenia.com/text/..User-Agent: FriendoFrenia (url) - -
netarkivet
 netarkivet.dk/webcrawler/text/..Mozilla/5.0 (compatible; heritrix/1.14.4 url) - -
 netarkivet.dk/webcrawler/image/..Mozilla/5.0 (compatible; heritrix/1.14.4 url) - -
kalooga
 kalooga.com/crawlerimage/..Mozilla/5.0 (compatible; KaloogaBot; url) - -
 kalooga.com/crawlertext/..Mozilla/5.0 (compatible; KaloogaBot; url) - -
netseer
 www.netseer.com/crawler.htmltext/..Mozilla/5.0 (compatible; NetSeer crawler/2.0; url; mail address ) - -
sf
 magpierss.sf.nettext/..MagpieRSS/0.7x (url) en-us,en;q=0.5 -
 liferea.sf.net/text/..Liferea/1.x.x (Linux; es_ES.UTF-8; url) en-us,en;q=0.5 -
 liferea.sf.net/text/..Liferea/0.x.x (Linux; en_US.UTF-8; url) en-us,en;q=0.5 -
dasdonkey
 www.dasdonkey.comtext/..Mozilla/5.0 (compatible; DonkeyBot/0.1; url) - -
msai
 www.msai.in/uaprof/micromax/X455.xmlimage/..url en,hi -
 www.msai.in/uaprof/micromax/X1i_Extra.xmlimage/..url en,hi -
 www.msai.in/uaprof/micromax/X101.xmlimage/..url en,hi -
 www.msai.in/uaprof/micromax/X1i_Extra.xmltext/..url en,hi -
seokicks
 www.seokicks.de/robot.htmltext/..Mozilla/5.0 (compatible; SEOkicks-Robot url) - -
warebay
 www.warebay.com/bot.htmltext/..Mozilla/5.0 (compatible; WBSearchBot/1.1; url) en-us,en;q=0.5 -
stackoverflow
 stackoverflow.com/questions/8956331/how-to-get-results-from-the-wikipedia-api-with-phptext/..Testing for url - -
rcdtokyo
 www.rcdtokyo.com/pc2m/text/..Mozilla/5.0 (compatible; PEAR HTTP_Request class; url) ja -
github
 github.com/pauldix/typhoeus/tree/mastertext/..Typhoeus - url - -
 github.com/pauldix/feedzirra/tree/masterapplication/xmlfeedzirra url - -
textdigger
 textdigger.comtext/..Mozilla/5.0 (url) Gecko/20061208 Firefox/2.0.0.1 en-us,en;q=0.5 -
rockmelt
 rockmelt.comtext/..RockmeltEmbedder (url; mail address ) - -
proximic
 www.proximic.com/info/spider.phptext/..Mozilla/5.0 (compatible; proximic; url) - -
fotopedia
 www.fotopedia.comapplication/jsonPicor (url) - -
netvibes
 www.netvibes.comtext/..Netvibes (url) - -
vermagerd
 www.vermagerd.be/wptext/..WordPress/3.4.2; url - -
pinterest
 pinterest.com/image/..Pinterest/0.1 url - -
 pinterest.com/text/..Pinterest/0.1 url - -
kinshoo
 kinshoo.org/bot.htmltext/..KinshooBot (compatible; crawl.kins71302a1 Beta v1; Kinshoo 0.1; kinshoo.org) url en-us,en;q=0.5 -
backgroundswitcher
 www.backgroundswitcher.com/text/..John's Background Switcher 4.4 (url) - -
 www.backgroundswitcher.com/image/..John's Background Switcher 4.6 (url) - -
 www.backgroundswitcher.com/text/..John's Background Switcher 4.6 (url) - -
 www.backgroundswitcher.com/image/..John's Background Switcher 4.4 (url) - -
sonyericsson
 www.sonyericsson.com/UAprof/R800xR301.xmlimage/..Mozilla/5.0 (Linux; Android/2.3.3; en-us; SonyEricssonR800xurl Build/3.0.1.E.1.44) AppleWebKit/533.1 KHTML Version/4.0 Mobile Safari/533.1 en-US -
 www.sonyericsson.com/UAprof/R800xR301.xmltext/..Mozilla/5.0 (Linux; Android/2.3.3; en-us; SonyEricssonR800xurl Build/3.0.1.E.1.44) AppleWebKit/533.1 KHTML Version/4.0 Mobile Safari/533.1 en-US -
pingdom
 www.pingdom.com/text/..Pingdom.com_bot_version_1.4_(url) - -
 www.pingdom.comtext/..Pingdom.com_bot_version_1.4_(url) - -
js-kit
 js-kit.com/text/..JS-Kit URL Resolver, url - -
searchtechnologies
 www.searchtechnologies.comtext/..Mozilla/5.0 (compatible; heritrix/1.14.3 url) - -
nvdev
 qa.nvdev.comtext/..Netvibes (url) - -
 trunk.nvdev.comtext/..Netvibes (url) - -
sanskritdictionary
 www.sanskritdictionary.com/application/vnd.php.serializedUser-Agent: SanskritDictionary/0.1 (url) - -
avantbrowser
 www.avantbrowser.comtext/..Avant Browser (url) en-us,en;q=0.5 -
 www.avantbrowser.comtext/..Advanced Browser (url) en-us,en;q=0.5 -
instapaper
 www.instapaper.com/text/..Mozilla/5.0 (Macintosh; Intel Mac OS X 10_6_8) AppleWebKit/534.50 KHTML Version/5.1 Instapaper/4.0 (url) - -
newsgator
 www.newsgator.comtext/..NewsGatorOnline/2.0 (url; 1 subscribers) en-us,en;q=0.5 -
 www.newsgator.com/text/..FeedDemon/2.7 (url; Microsoft Windows XP) en-us,en;q=0.5 -
zipcode
 zipcode.ustext/..Mozilla/5.0 (compatible; YourCoolBot/1.0; url) - -
Anonymouse
 Anonymouse.org/image/..url (Unix) - -
 Anonymouse.org/text/..url (Unix) - -
theworldtopbrands
 theworldtopbrands.comtext/..WordPress/3.5.1; url - -
jetbrains
 www.jetbrains.com/omea_reader/text/..JetBrains Omea Reader 2.0 Release Candidate 1 (url) en-us,en;q=0.5 -
 www.jetbrains.com/omea_reader/text/..JetBrains Omea Reader 1.0.x (url) en-us,en;q=0.5 -
queryseeker
 queryseeker.com/bot.htmltext/..QuerySeekerSpider ( url ) - -
moviecus
 www.moviecus.com/botcontactinfo.phpapplication/yamlmoviecus bot (url) - -
watchmouse
nb
 www.nb.no/vevfangstimage/..Mozilla/5.0 (compatible; heritrix/1.14.4 url) - -
 www.nb.no/vevfangsttext/..Mozilla/5.0 (compatible; heritrix/1.14.4 url) - -
go
 kc.nict.go.jp/project1/crawl.htmltext/..ICC-Crawler/2.0 (Mozilla-compatible; ; url) ja -
 kc.nict.go.jp/project1/crawl-ja.htmltext/..ICC-Crawler (Mozilla-compatible; mail address ; url) ja -
zapbot
 www.zapbot.comtext/..Mozilla/5.0 (compatible; ZapBot/0.2c; url) - -
 www.zapbot.nettext/..Mozilla/5.0 (compatible; ZapBot/0.2n; url) - -
 www.zapbot.orgtext/..Mozilla/5.0 (compatible; ZapBot/0.2o; url) - -
seomoz
 www.seomoz.org/dp/rogerbottext/..rogerbot/1.0 (url, mail address ) - -
 www.seomoz.org/dp/rogerbottext/..rogerbot/1.0 (url, mail address ) - -
psu
 ist.psuimage/..Mozilla/5.0 (compatible; heritrix/1.14.4 url,edu) - -
 ist.psu-Mozilla/5.0 (compatible; heritrix/1.14.4 url,edu) - -
 ist.psutext/..Mozilla/5.0 (compatible; heritrix/1.14.4 url,edu) - -
site
 www.site.com/application/jsonBot/2.0 (url) - -
 www.site.com/-Bot/2.0 (url) -
semager
 www.semager.de/blog/semager-bots/text/..Mozilla/5.0 (compatible; Semager/1.4c; url) - -
site-shot
 www.site-shot.com/image/..Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/534.34 KHTML Site-Shot/2.1 (url) Safari/534.34 en-US,* -
 www.site-shot.com/text/..Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/534.34 KHTML Site-Shot/2.1 (url) Safari/534.34 en-US,* -
example
 example.com/MyCoolToolPage/application/jsonMyCoolTool (url) - -
 example.com/MyCoolTool/text/..User-Agent: MyCoolTool/1.1 (url; mail address ) - -
chiavicodificate
 www.chiavicodificate.ittext/..WordPress/3.1.1; url - -
esciudad
 www.esciudad.com/application/jsonEsciudad/1.0 (url) - -
 www.esciudad.com/text/..Esciudad/1.0 (url) - -
weborking
 weborking.comtext/..Weborking(url) - -
 weborking.comapplication/jsonWeborking(url) - -
pagepot
 pagepot.net/text/..Pagepot-crawler 1.0 /(url)/ - -
feedshow
 www.feedshow.comtext/..FeedshowOnline (url) en-us,en;q=0.5 -
 www.feedshow.comtext/..Feedshow/x.0 (url; 1 subscriber) en-us,en;q=0.5 -
wikiapiary
 wikiapiary.com/wiki/User:Bumble_Beeapplication/jsonBumble Bee/1.0 (WikiApiary; url) - -
 wikiapiary.com/wiki/User:Bumble_Bee-Bumble Bee/1.0 (WikiApiary; url) -
tinyurl
 tinyurl.com/64t5ntext/..Rome Client (url) Ver: 0.9 en-us,en;q=0.5 -
 tinyurl.com/64t5n-Rome Client (url) Ver: UNKNOWN - -
publicknowledgeproject
 alm.publicknowledgeproject.orgapplication/jsonArticle Level Metrics - url - -
superfeedr
 superfeedr.comapplication/xmlSuperfeedr bot/2.0 url - Please get in touch if we are polling too hard. - -
 superfeedr.com-Superfeedr bot/2.0 url - Please get in touch if we are polling too hard. - -
stad
 stad.comtext/..Mozilla/5.0 (compatible; stadbot/1.0; url) - -
tweetedtimes
 tweetedtimes.comtext/..Mozilla/5.0 (compatible; TweetedTimes Bot/1.0; url) - -
trendytrack
 trendytrack.comtext/..WordPress/3.5.1; url - -
jetsli
 jetsli.de/crawlertext/..Mozilla/5.0 (compatible; Jetslide; url) en-us -
zookabot
 zookabot.comtext/..Zookabot/2.5;url - -
onemusicapi
 www.onemusicapi.comtext/..onemusicapi.com/beta url - -
spinn3r
 spinn3r.com/robottext/..Mozilla/5.0 (X11; Linux x86_64; en-US; rv:1.9.0.19; aggregator:Spinn3r (Spinn3r 3.1); url) Gecko/2010040121 Firefox/3.0.19 - -
138664.519999986total

Page requests for probable crawlers, recognized by keyword
Count
x 1000		Agent string
  Mime type (count ≥ 3)
php wikibot classes - -
 application/vnd.php.serialized
 text/..
 -
GoogleBot-Image/1.0 - -
 image/..
 text/..
 -
 application/pdf
AniBot/0.9 php/curl - -
 application/vnd.php.serialized
 text/..
 -
Peachy MediaWiki Bot API Version 2.0 (beta) - -
 application/vnd.php.serialized
 text/..
 image/..
spider - -
 text/..
 application/vnd.php.serialized
 application/json
 -
 image/..
MediaWikiCrawler-Google/2.0 ( mail address ) - -
 text/..
 -
PythonWikipediaBot/1.0 - -
 application/json
 application/xml
 text/..
 application/x-www-form-urlencoded
 -
Peachy MediaWiki Bot API Version 2.0 (beta) -
 -
LinkParser/2.0 - -
 text/..
GoogleBot-Image/1.0 - -
 text/..
 image/..
 -
 application/rsd+xml
 application/opensearchdescription+xml
- Peachy MediaWiki Bot API Version 2.0 (beta) -
 multipart/form-data
enwiki_removal/r-1 (unknown) Pywikipediabot/2.0 - -
 application/json
 text/..
tigerbot - -
 -
 application/json
 text/..
PythonWikipediaBot/1.0 -
 -
 application/x-www-form-urlencoded
DotNetWikiBot/2.101 (Microsoft Windows NT 5.1.2600 Service Pack 3; ) - -
 text/..
 application/xml
DotNetWikiBot/2.101 (Unix 2.6.32.45; ) - -
 text/..
 application/xml
pywikipedia-radeh.py/r11231 Pywikipediabot/1.0 - -
 application/json
 application/xml
wikiwix-bot-3.0 - -
 text/..
 -
DotNetWikiBot/2.101 (Microsoft Windows NT 6.1.7601 Service Pack 1; ) - -
 text/..
 application/xml
 application/x-www-form-urlencoded
pywikipedia-newar4ur.py/r11202 Pywikipediabot/1.0 - -
 application/json
 application/xml
 -
pywikipedia-newar4ur.py/r11202 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
ClueBot/2.0 - -
 application/vnd.php.serialized
 text/..
ClueBot/1.1 - -
 application/vnd.php.serialized
 text/..
Mozilla/5.0 MaboMwFramework/1.2 (w:de:MerlIwBot) - -
 text/..
Mozilla/5.0 (Windows; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 ( mail address ) fr; q=1.0, en; q=0.5, *; q=0.1 -
 text/..
 -
 application/pdf
pywikipedia-wikidata_wd.py/r11228 Pywikipediabot/1.0 - -
 application/json
 application/xml
 -
WikiCatResearchBot ( mail address ) - -
 text/..
pywikipedia-redirect.py/r11168 Pywikipediabot/1.0 - -
 application/json
 text/..
enwiki_removal/r-1 (unknown) Pywikipediabot/2.0 -
 application/x-www-form-urlencoded
Mozilla/5.0 (Windows; Windows NT 5.1; zh-CN; rv:1.8.0.11) Firefox/1.5.0.11; 360Spider zh-CN -
 text/..
 -
 image/..
 application/ogg
pywikipedia-wikidata9pt.py/r11228 Pywikipediabot/1.0 - -
 application/json
 application/xml
 text/..
pywikipedia-interwiki.py/r11096 Pywikipediabot/1.0 - -
 application/xml
 application/json
p-welcome-w-bn-core.py/r10872 Pywikipediabot/1.0 - -
 application/json
DotNetWikiBot/2.101 (Microsoft Windows NT 6.2.9200.0; ) - -
 text/..
 application/xml
 application/x-www-form-urlencoded
pywikipedia-new_interwiki.py/r11204 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-new_interwiki.py/r11204 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
TrueKnowledgeBot bot mail address > - -
 application/xml
 image/..
 application/vnd.php.serialized
 text/..
Mozilla 5.0 (Apibot 0.32) - -
 application/vnd.php.serialized
pywikipedia-substub.py/r11028 Pywikipediabot/1.0 - -
 application/json
Mozilla/5.0 (compatible; Ezooms/1.0; mail address ) - -
 text/..
 application/json
 image/..
 -
 application/ogg
DotNetWikiBot/2.101 (Unix 3.0.0.12; ) - -
 text/..
 application/xml
p-welcome-w-bn-core.py/r10872 Pywikipediabot/1.0 -
 -
wikidata_properties/r-1 (unknown) Pywikipediabot/2.0 - -
 application/json
www.integromedb.org/Crawler - -
 text/..
 image/..
 -
fa-welcome.py/r11054 Pywikipediabot/1.0 - -
 application/json
UAA-UAA.py/r-1 (unknown) Pywikipediabot/1.0 - -
 application/json
pywikipedia-wikidata9de.py/r11228 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-hamsang.py/r11204 Pywikipediabot/1.0 - -
 application/json
 application/xml
wikidata_properties/r-1 (unknown) Pywikipediabot/2.0 -
 application/x-www-form-urlencoded
fa-welcome.py/r11054 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (Exabot-Thumbnails) en,* -
 image/..
 text/..
 application/json
 -
MediaWiki::Bot/3.2.6 - -
 application/json
 text/..
DigitalsmithsBot - -
 text/..
crawl/0.4 libcrawl/0.3 - -
 text/..
 image/..
 application/ogg
pyelph-new_interwikirus.py/r11204 Pywikipediabot/1.0 - -
 application/json
 application/xml
pyelph-new_interwikirus.py/r11204 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
pywikipedia-wikidata_cleanlabel.py/r11200 Pywikipediabot/1.0 - -
 application/json
 application/xml
Mozilla/5.0 (Windows; Windows NT 5.1; zh-CN; rv:1.8.0.11) Gecko/20070312 Firefox/1.5.0.11; 360Spider zh-CN -
 text/..
 -
 image/..
 application/xml
pywikipedia-wikidata_disamb.py/r11200 Pywikipediabot/1.0 - -
 application/json
 application/xml
unknown Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (Exabot-Thumbnails) en,*
 -
py2-zzdataimporter.py/r11185 Pywikipediabot/1.0 - -
 application/json
 application/xml
 -
py2-zzdataimporter.py/r11185 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
pyelph-new_interwiki.py/r11204 Pywikipediabot/1.0 - -
 application/json
 application/xml
pyelph-new_interwiki.py/r11204 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
Tawbot (public svn release; plwiki) - -
 text/..
wikidata_create/r-1 (unknown) Pywikipediabot/2.0 - -
 application/json
 text/..
AnomieBOT 1.0 (TagDater; see [[User:AnomieBOT]]) - -
 application/json
pywikipedia-28main.py/r11113 Pywikipediabot/1.0 - -
 application/json
 application/xml
Wikibot/2.0.2 CFNetwork/609.1.4 Darwin/13.0.0 en-us -
 image/..
 application/json
 text/..
 -
pywikipedia-new_interwiki.py/r11216 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-new_interwiki.py/r11216 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
pyelph-new_interwiki.py/r11189 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
WikiTrans.net Bot (User:WikiTransBot; Contact: mail address ) - -
 text/..
 application/json
pyelph-new_interwiki.py/r11189 Pywikipediabot/1.0 - -
 application/json
 application/xml
Mozilla/5.0 (compatible; SearchBot) - -
 text/..
DotNetWikiBot/2.99 (Microsoft Windows NT 6.1.7601 Service Pack 1; ) - -
 text/..
 application/xml
 image/..
pywikipedia-redirect.py/r11204 Pywikipediabot/1.0 - -
 application/json
GermCrawler - -
 application/json
 text/..
maj_articles_recents/r11179 Pywikipediabot/2.0 - -
 application/json
Mozilla/5.0 (compatible; Nigma.ru/3.0; mail address ) - -
 text/..
 application/opensearchdescription+xml
migrate_genders/r-1 (unknown) Pywikipediabot/2.0 - -
 application/json
maj_articles_recents/r11179 Pywikipediabot/2.0 -
 application/x-www-form-urlencoded
Peachy MediaWiki Bot API Version 1.0 - -
 application/vnd.php.serialized
Answersbot - -
 text/..
MorbZ-Bot - -
 application/json
 text/..
BeneBot*/1.0 WikibasePhpLib/0.1 - -
 application/json
pywikipedia-newar4ur.py/r11200 Pywikipediabot/1.0 -
 -
pywikipedia-newar4ur.py/r11200 Pywikipediabot/1.0 - -
 application/json
pywikipedia-wikidata9.py/r11184 Pywikipediabot/1.0 - -
 application/json
 application/xml
MyCuteBot/0.1 - -
 text/..
 application/json
 application/vnd.php.serialized
pywikipedia-redirect.py/r11204 Pywikipediabot/1.0 -
 application/x-www-form-urlencoded
 -
 application/json
pywikipedia-welcomeurdu.py/r11135 Pywikipediabot/1.0 - -
 application/json
pywikipedia-redirect.py/r11176 Pywikipediabot/1.0 -
 application/x-www-form-urlencoded
 -
pywikipedia-hamsang.py/r11308 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-wikidata9.py/r11204 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-welcomeurdu.py/r11135 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
pywikipedia-redirect.py/r11176 Pywikipediabot/1.0 - -
 application/json
indexer2/r-1 (unknown) Pywikipediabot/2.0 - -
 application/json
DotNetWikiBot/2.101 (Unix 3.0.0.32; ) - -
 text/..
 application/xml
CorenSearchBot/1.7 en libwww-perl/6.04 - -
 text/..
trunk-featured.py/r11251 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-wikidata9eu.py/r11204 Pywikipediabot/1.0 - -
 application/json
DotNetWikiBot/2.100 (Unix 3.2.0.38; ) - -
 text/..
Python27-pythonw.exe/r11204 Pywikipediabot/1.0 - -
 application/json
DotNetWikiBot/2.100 (Microsoft Windows NT 6.2.9200.0; ) - -
 text/..
 application/xml
pywikipedia-wikidata_lowercase.py/r11200 Pywikipediabot/1.0 - -
 application/json
 application/xml
Wikirage.Com Statistics Bot - -
 text/..
mail address mail address – MediaWiki Tcl Bot Framework 0.5 (r1) - -
 application/json
 application/x-www-form-urlencoded
maj_articles_recents/r11235 Pywikipediabot/2.0 - -
 application/json
pywikipedia-redirect.py/r11245 Pywikipediabot/1.0 - -
 application/json
trunk-checkimages.py/r11200 Pywikipediabot/1.0 - -
 application/json
pywikipedia-redirect.py/r11202 Pywikipediabot/1.0 - -
 application/json
pywikipedia-hamsang.py/r11204 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
pywikipedia-new_interwiki.py/r11228 Pywikipediabot/1.0 - -
 application/json
 application/xml
AnomieBOT 1.0 (OrphanReferenceFixer; see [[User:AnomieBOT]]) - -
 application/json
pywikipedia-new_interwiki.py/r11228 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
pywikipedia-redirect.py/r11215 Pywikipediabot/1.0 -
 application/x-www-form-urlencoded
 -
pywikipedia-redirect.py/r11275 Pywikipediabot/1.0 - -
 application/json
 text/..
DotNetWikiBot/2.100 (Unix 5.10.0.0; ) - -
 text/..
 application/xml
Peachy MediaWiki Bot API Version 1.0 -
 -
SineBot/1.5.19(User:SineBot) - -
 application/vnd.php.serialized
 text/..
pywikipedia-redirect.py/r11202 Pywikipediabot/1.0 -
 application/x-www-form-urlencoded
 -
pywikipedia-redirect.py/r11215 Pywikipediabot/1.0 - -
 application/json
mail address mail address – MediaWiki Tcl Bot Framework 0.5 (r1) -
 application/x-www-form-urlencoded
DotNetWikiBot/2.101 (Unix 3.0.0.31; ) - -
 text/..
pywikipedia-redirect.py/r11231 Pywikipediabot/1.0 - -
 application/json
pywikipedia-redirect.py/r11231 Pywikipediabot/1.0 -
 application/x-www-form-urlencoded
 -
GoogleBot-Image/1.0 -
 -
 image/..
 text/..
pywikipedia-newar4ur.py/r11228 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
pywikipedia-wikidata_new_global.py/r11228 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-wikidata_essss.py/r11228 Pywikipediabot/1.0 - -
 application/json
Test Webbot - -
 text/..
 -
DotNetWikiBot/2.101 (Unix 3.1.9.0; ) - -
 text/..
 application/xml
pywikipedia-newar4ur.py/r11228 Pywikipediabot/1.0 - -
 application/json
pywikipedia-radeh.py/r11193 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
pywikipedia-radeh.py/r11193 Pywikipediabot/1.0 - -
 application/json
python-wikitools/1.2 (User:Mr.Z-bot) - -
 application/json
SchoolReviewNetworkWikiBot - -
 application/json
pywikipedia-importwdwi.py/r11181 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
WikiPlaysBot - -
 text/..
pywikipedia-wdph22.py/r11275 Pywikipediabot/1.0 - -
 application/json
Mozilla/5.0 (Windows; Windows NT 5.1; zh-CN; rv:1.8.0.11) Gecko/20070312 Firefox/1.5.0.11; 360Spider - -
 text/..
 application/json
 application/xml
AnomieBOT 1.0 (FlagIconRemover; see [[User:AnomieBOT]]) - -
 application/json
pywikipedia-importwdwi.py/r11181 Pywikipediabot/1.0 - -
 application/json
pywikipedia-wikidata3en.py/r11204 Pywikipediabot/1.0 - -
 application/json
 application/xml
AnomieBOT 1.0 (PERTableUpdater; see [[User:AnomieBOT]]) - -
 application/json
 text/..
commons-imagerecat.py/r11028 Pywikipediabot/1.0 - -
 application/json
 -
pywikipedia-redirect.py/r11193 Pywikipediabot/1.0 -
 application/x-www-form-urlencoded
 -
www.monit24.pl-m24Bot/4.1- - -
 image/..
 -
 text/..
pywikipedia-redirect.py/r11193 Pywikipediabot/1.0 - -
 application/json
 text/..
user_scripts-BotReversor.py/r11147 Pywikipediabot/1.0 - -
 application/json
AnomieBOT 1.0 (TemplateSubster; see [[User:AnomieBOT]]) - -
 application/json
php wikibot classes -
 -
Metabot 0.1 - -
 text/..
ybot-ko_datastat.py/r11114 Pywikipediabot/1.0 -
 -
ybot-ko_datastat.py/r11114 Pywikipediabot/1.0 - -
 application/json
pywikipedia-interwiki.py/r11176 Pywikipediabot/1.0 - -
 application/json
 application/xml
WikiBot/0.1 - -
 text/..
 image/..
Wikipediabot-mywikidatabot2.py/r-1 (unknown) Pywikipediabot/1.0 - -
 application/json
 application/xml
user_scripts-BotReversor.py/r11147 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
TVersity Media Robot - -
 text/..
HosiryuhosiBot IRC-RecentChanges Checker ja -
 text/..
 application/x-www-form-urlencoded
pywikipedia-welcomeurdu.py/r11193 Pywikipediabot/1.0 - -
 application/json
pywikipedia-welcomeurdu.py/r11193 Pywikipediabot/1.0 -
 -
FAST Search Web Crawler 14.0.0325.0000 - -
 text/..
 -
 image/..
 application/ogg
pywikipedia-wdph23.py/r11275 Pywikipediabot/1.0 - -
 application/json
 application/xml
AdMedia bot - -
 text/..
pywikipedia-importwd14.py/r11181 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
pywikipediabot-wikidata_irc_en.py/r11215 Pywikipediabot/1.0 - -
 application/json
python-wikitools/1.2 (User:Mr.Z-bot) -
 application/x-www-form-urlencoded
pywikipedia-redirect.py/r11200 Pywikipediabot/1.0 - -
 application/json
 text/..
Mozilla/5.0 (compatible; MyBot/1.0;) -
 application/x-www-form-urlencoded
pywikipedia-redirect.py/r11200 Pywikipediabot/1.0 -
 application/x-www-form-urlencoded
 -
SurakWare MediaWiki Bot/1.0 - -
 text/..
 application/xml
wikidata-sitelinks.py/r11176 Pywikipediabot/1.0 - -
 application/json
pywikipedia-importwd14.py/r11181 Pywikipediabot/1.0 - -
 application/json
Mozilla/5.0 (compatible; MyBot/1.0;) - -
 application/json
Webwiki Search Engine Bot - www.webwiki.de - -
 text/..
pywikipedia-wikidata_new_wd.py/r11228 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-importwd.py/r11181 Pywikipediabot/1.0 - -
 application/json
pywikipedia-redirect.py/r11207 Pywikipediabot/1.0 -
 application/x-www-form-urlencoded
 -
pywikipedia-anagrama.py/r11215 Pywikipediabot/1.0 - -
 application/json
pywikipedia-redirect.py/r11207 Pywikipediabot/1.0 - -
 application/json
Python27-pythonw.exe/r11172 Pywikipediabot/1.0 - -
 application/json
pywikipedia-newar4ur.py/r11216 Pywikipediabot/1.0 - -
 application/json
pywikipedia-redirect.py/r11255 Pywikipediabot/1.0 - -
 application/json
pywikipedia-dikantenyvaovao.py/r11215 Pywikipediabot/1.0 - -
 application/json
pywikipedia-redirect.py/r11245 Pywikipediabot/1.0 -
 application/x-www-form-urlencoded
 -
pywikipedia-newar4ur.py/r11204 Pywikipediabot/1.0 - -
 application/json
pywikipedia-redirect.py/r11181 Pywikipediabot/1.0 -
 application/x-www-form-urlencoded
 -
Epywikipedia-welcome.py/r11181 Pywikipediabot/1.0 - -
 application/json
Twitterbot/1.0 - -
 text/..
 image/..
 -
 application/pdf
maj_articles_recents/r11235 Pywikipediabot/2.0 -
 application/x-www-form-urlencoded
pywikipedia-importwd.py/r11181 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
pywikipedia-redirect.py/r11228 Pywikipediabot/1.0 - -
 application/json
(u'python-wikitools/1.1.1 (User:Cerabot)',) - -
 application/json
 text/..
pywikipedia-newar4ur.py/r11204 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
pywikipedia-redirect.py/r11286 Pywikipediabot/1.0 - -
 application/json
Global-Crawler/Nutch-1.4 (Search platform crawler) en-us,en-gb,en;q=0.7,*;q=0.3 -
 text/..
 application/ogg
pywikipedia-redirect.py/r11255 Pywikipediabot/1.0 -
 application/x-www-form-urlencoded
 -
pywikipedia-redirect.py/r11228 Pywikipediabot/1.0 -
 application/x-www-form-urlencoded
 -
pywikipedia-newar4ur.py/r11216 Pywikipediabot/1.0 -
 -
pywikipediabot-wikidata_irc_global.py/r11215 Pywikipediabot/1.0 - -
 application/json
pyelph-new_interwikiru.py/r11204 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
pywikipedia-redirect.py/r11227 Pywikipediabot/1.0 -
 application/x-www-form-urlencoded
 -
pywikipedia-radeh.py/r11231 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
pywikipedia-zzredirectyeh.py/r11088 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
Semantix Bot 0.1 - -
 text/..
pywikipedia-zzredirectyeh.py/r11088 Pywikipediabot/1.0 - -
 application/json
pywikipedia-redirect.py/r11308 Pywikipediabot/1.0 - -
 application/json
pywikipedia-redirect.py/r11272 Pywikipediabot/1.0 - -
 application/json
pywikipedia-redirect.py/r11234 Pywikipediabot/1.0 -
 application/x-www-form-urlencoded
 -
HTMLParser/2.0 - -
 text/..
 image/..
pywikipedia-redirect.py/r11227 Pywikipediabot/1.0 - -
 application/json
pywikipedia-redirect.py/r11234 Pywikipediabot/1.0 - -
 application/json
pywikipedia-redirect.py/r11272 Pywikipediabot/1.0 -
 application/x-www-form-urlencoded
 -
pywikipedia-iwiki2_TS.py/r11138 Pywikipediabot/1.0 - -
 application/json
 application/xml
DotNetWikiBot/2.92 (Microsoft Windows NT 5.1.2600 Service Pack 3; ) - -
 text/..
 application/xml
pywikipedia-redirect.py/r11181 Pywikipediabot/1.0 - -
 application/json
Mozilla/5.0 (SnapPreviewBot) Gecko/20061206 Firefox/1.5.0.9 en-us,en;q=0.5 -
 image/..
 text/..
pywikipedia-iwiki2_TS.py/r11138 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
MediaWiki::Bot/3.005002 - -
 application/json
pywikipedia-28main.build89.py/r11131 Pywikipediabot/1.0 - -
 application/json
 application/xml
pyelph-new_interwikiru.py/r11204 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-redirect.py/r11298 Pywikipediabot/1.0 - -
 application/json
Pywikipediabot/2.0 - -
 application/json
FAST Search Web Crawler 14.0.0325.0000 -
 -
 text/..
pywikipedia-dikantenyvaovao.py/r10663 Pywikipediabot/1.0 - -
 application/json
milog_bot/1.0 ( mail address ) - -
 text/..
migrate_genders/r-1 (unknown) Pywikipediabot/2.0 -
 application/x-www-form-urlencoded
Phantom.js bot cs-CZ,en,* -
 image/..
 text/..
pywikipedia-redirect.py/r11138 Pywikipediabot/1.0 - -
 application/json
wikidata-sitelinks.py/r11176 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
Crawler - -
 text/..
 -
pywikipedia-welcome.py/r11252 Pywikipediabot/1.0 - -
 application/json
pywikipedia-iwiki2_TS.py/r11161 Pywikipediabot/1.0 - -
 application/json
 application/xml
JavaCrawler/1.1 - -
 text/..
360spider-image - -
 image/..
 text/..
pywikipedia-iwiki2_TS.py/r11161 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
trunk-checkimages.py/r11136 Pywikipediabot/1.0 - -
 application/json
My Nutch Spider/Nutch-1.6 en-us,en-gb,en;q=0.7,*;q=0.3 -
 text/..
pywikipedia-importwd.py/r11144 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
pywikipedia-interwiki.py/r11138 Pywikipediabot/1.0 - -
 application/json
 application/xml
svnpywikipedia-interwiki.py/r11270 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-featured.py/r11268 Pywikipediabot/1.0 - -
 application/json
pywikipedia-radeh.py/r11216 Pywikipediabot/1.0 -
 -
pywikipedia-importwd.py/r11144 Pywikipediabot/1.0 - -
 application/json
~Bot ([[:fr:w:User:TildeBot]] by [[:fr:w:User:Alphos]] mail address ) - -
 text/..
pywikipedia-wikidata9da.py/r11228 Pywikipediabot/1.0 - -
 application/json
 application/xml
dtSearchSpider - -
 text/..
pywikipedia-wikidata9.py/r11228 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-redirect.py/r11189 Pywikipediabot/1.0 - -
 application/json
pywikipedia-redirect.py/r11189 Pywikipediabot/1.0 -
 application/x-www-form-urlencoded
 -
pywikipedia-featured.py/r11246 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-radeh.py/r11216 Pywikipediabot/1.0 - -
 application/json
HRoestBot, de-wikipedia using pywikipedia framework - -
 text/..
 application/json
pywikipedia-anagrama.py/r10663 Pywikipediabot/1.0 - -
 application/json
Pywikipediabot/2.0 -
 application/x-www-form-urlencoded
mail address mail address – MediaWiki Tcl Bot Framework 0.5 (r24) - -
 application/json
mail address mail address – MediaWiki Tcl Bot Framework 0.5 (r24) -
 application/x-www-form-urlencoded
maj_articles_recents/r11162 Pywikipediabot/2.0 - -
 application/json
pywikipedia-featured.py/r11268 (wikipedia.py) Pywikipediabot/1.0 - -
 application/json
Python27-pythonw.exe/r11227 Pywikipediabot/1.0 - -
 application/json
Wikibot/2.0.2 CFNetwork/609 Darwin/13.0.0 en-us -
 image/..
 application/json
 text/..
PhronesisSpider - -
 text/..
~Bot ([[:fr:w:User:TildeBot]] by [[:fr:w:User:Alphos]] mail address ) -
 -
maj_articles_recents/r11162 Pywikipediabot/2.0 -
 application/x-www-form-urlencoded
pywikipedia-wikidata7.py/r11168 Pywikipediabot/1.0 - -
 application/json
 application/xml
WPBot 1.0 - -
 text/..
Wiki.java 0.27 r134 (OctraBot 2.3) - -
 text/..
pywikipedia-redirect.py/r11138 Pywikipediabot/1.0 -
 application/x-www-form-urlencoded
 -
wikidata-remove_interwiki.py/r11277 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-wikidata9gl.py/r11228 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-redirect.py/r11144 Pywikipediabot/1.0 - -
 application/json
Goalkeeperbot(User:Beetstra)/1.0 - -
 text/..
pywikipedia-new_interwiki.py/r11202 Pywikipediabot/1.0 - -
 application/json
 application/xml
COIBot/1.00 - -
 text/..
pywikipedia-featured.py/r11299 Pywikipediabot/1.0 - -
 application/json
 application/xml
AnomieBOT 1.0 (BAGBot; see [[User:AnomieBOT]]) - -
 application/json
 text/..
pywikipedia-wikidata_irc.py/r11204 Pywikipediabot/1.0 - -
 application/json
Mozilla/5.0 (Windows; Windows NT 5.1; zh-CN; rv:1.8.0.11) Firefox/1.5.0.11; 360Spider - -
 text/..
 application/json
 application/xml
pywikipedia-redirect.py/r11144 Pywikipediabot/1.0 -
 application/x-www-form-urlencoded
 -
Opera/8.01 (J2ME/MIDP; MXit WebBot/6.2.1/1.8.5.168;) Opera Mini/3.1 - -
 image/..
 text/..
 -
pywikipedia-wd_move.py/r11176 Pywikipediabot/1.0 - -
 application/json
pywikipedia-new_interwiki.py/r11202 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
pywikipedia-fr.q.formatage.py/r11216 (wikipedia.py) Pywikipediabot/1.0 - -
 application/json
 application/xml
Wiki.java 0.27 r127 (OctraBot 2.1) - -
 text/..
trunk-interwiki.py/r11180 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-wdph26.py/r11275 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipediabot-wikidata_new_global.py/r11215 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-featured.py/r11286 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-wikidata3.py/r11184 Pywikipediabot/1.0 - -
 application/json
 application/xml
Zing-BottaBot/2.0 - -
 text/..
pywikipedia-wikidata_lowercase_manuel_lijst.py/r11200 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-wd_move.py/r11176 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
pywikipedia-wikidata9uk.py/r11228 Pywikipediabot/1.0 - -
 application/json
bot: fr-anal - -
 application/json
HRoestBot, de-wikipedia using pywikipedia framework -
 application/x-www-form-urlencoded
 -
pywikipedia-interwiki.py/r11147 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-wikidata_wd.py/r11311 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-interwiki.py/r11028 Pywikipediabot/1.0 - -
 application/json
 application/xml
 -
 application/x-www-form-urlencoded
myurlcrawler/0.1 - -
 text/..
 audio/midi
HersfoldIRCBot version 1.5.2 - -
 -
 text/..
pywikipedia-wikidata7.py/r11179 Pywikipediabot/1.0 - -
 application/json
 application/xml
My Nutch Spider/Nutch-1.5.1 en-us,en-gb,en;q=0.7,*;q=0.3 -
 text/..
pywikipedia-wikidata7.py/r11144 Pywikipediabot/1.0 - -
 application/json
 application/xml
theWxitBot/0.1 - -
 application/json
 image/..
Mozilla/5.0 (Windows; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 ( mail address ) - -
 text/..
wikidata-remove_interwiki.py/r11235 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-radeh.py/r11085 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-radeh.py/r11176 Pywikipediabot/1.0 -
 -
wikidata_blank_items/r-1 (unknown) Pywikipediabot/2.0 - -
 application/json
ideasBot 1.0 Series By DGideas in zhwp - -
 text/..
pywikipedia-interwiki.py/r11167 Pywikipediabot/1.0 - -
 application/json
 application/xml
iteco dummy crawler ru-RU,ru;q=0.8,en-US;q=0.6,en;q=0.4 -
 text/..
DotNetWikiBot/2.100 (Microsoft Windows NT 6.1.7601 Service Pack 1; ) - -
 text/..
 application/x-www-form-urlencoded
wikiscore-MakeScoreTable.py/r11152 Pywikipediabot/1.0 - -
 application/json
Wiki.java 0.27 r127 (OctraBot 2.0) - -
 text/..
ybot-ko_dataconn.py/r11114 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
pywikipedia-radeh.py/r11176 Pywikipediabot/1.0 - -
 application/json
pywikipedia-wikidata9ca.py/r11204 Pywikipediabot/1.0 - -
 application/json
 application/xml
admin-ipblocker-auto.py/r11228 Pywikipediabot/1.0 - -
 application/json
pywikirish-welcome.py/r11215 Pywikipediabot/1.0 - -
 application/json
user_scripts-llista1000.py/r11147 Pywikipediabot/1.0 - -
 application/json
pywikipedia-zzlangcat.py/r11104 Pywikipediabot/1.0 - -
 application/json
 -
 application/x-www-form-urlencoded
pywikipedia-interwiki.py/r11102 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
SD Crawler/Nutch-1.5.1 (automated Crawler) en-us,en-gb,en;q=0.7,*;q=0.3 -
 text/..
pywikipedia-zzfatranslator.py/r11136 Pywikipediabot/1.0 - -
 application/json
pywikipedia-featured.py/r11277 Pywikipediabot/1.0 - -
 application/json
 application/xml
TjBot-1-interwiki.py/r11166 (wikipedia.py) Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-zzfatranslator.py/r11136 Pywikipediabot/1.0 -
 -
pywikipedia-radeh.py/r11085 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
HTMLParser/1.6 - -
 text/..
Mozilla/5.0 (compatible; Mail.RU/3.14) CrawlMl - -
 text/..
pywikipedia-zzredirectyeh.py/r11176 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
DotNetWikiBot/2.100 (Unix 3.2.0.39; ) - -
 text/..
1501944/r11081 Pywikipediabot/2.0 -
 application/x-www-form-urlencoded
pywikipedia-wikidata_wd.py/r11181 (wikipedia.py) Pywikipediabot/1.0 - -
 application/json
ybot-ko_dataconn.py/r11114 Pywikipediabot/1.0 - -
 application/json
pywikipedia-ko_datacheck.py/r11204 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
DotNetWikiBot/2.100 (Unix 3.2.0.37; ) - -
 text/..
trunk-interwiki.py/r11177 Pywikipediabot/1.0 - -
 application/json
 application/xml
Empedia Bot - -
 text/..
pywikipedia-interwiki.py/r11102 Pywikipediabot/1.0 - -
 application/json
 application/xml
pynik-checkimages.py/r11204 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
pywikipedia-ko_datacheck.py/r11204 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-zzredirectyeh.py/r11176 Pywikipediabot/1.0 - -
 application/json
 application/xml
37/r-1 (unknown) Pywikipediabot/2.0 - -
 application/json
pywikipedia-welcomeurdu.py/r11189 Pywikipediabot/1.0 - -
 application/json
pywikipedia-parserfunctioncount.py/r11204 Pywikipediabot/1.0 - -
 application/json
1618216/r11222 Pywikipediabot/2.0 - -
 application/json
Pywikipedia-new_interwiki.py/r11255 Pywikipediabot/1.0 - -
 application/json
ZeekBot - -
 text/..
 image/..
ip-web-crawler.com en-us -
 text/..
IsnareWikiParser/1.0 [contact: mail address - -
 text/..
pywikipedia-wikidata9nwd.py/r11204 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-welcomeurdu.py/r11189 Pywikipediabot/1.0 -
 -
pywikipedia-parserfunctioncount.py/r11215 Pywikipediabot/1.0 - -
 application/json
Mozilla 5.0 (Apibot 0.30b5) - -
 application/vnd.php.serialized
1501944/r11081 Pywikipediabot/2.0 - -
 application/json
pywikipedia-checkimages.py/r11228 Pywikipediabot/1.0 -
 -
DotNetWikiBot/2.96 (Microsoft Windows NT 6.1.7601 Service Pack 1; ) - -
 text/..
 application/xml
pywikipedia-wikidata3cat.py/r11228 Pywikipediabot/1.0 - -
 application/json
www.monit24.pl-m24Bot/4.0- - -
 -
 image/..
 text/..
pywikipedia-klbot_pt.py/r11179 Pywikipediabot/1.0 - -
 application/json
 application/xml
Screaming Frog SEO Spider/2.11 - -
 text/..
 -
 application/ogg
 audio/webm
 image/..
pynik-checkimages.py/r11275 Pywikipediabot/1.0 - -
 application/json
pywikipedia-welcome.py/r11027 Pywikipediabot/1.0 - -
 application/json
maj_articles_recents/r11140 Pywikipediabot/2.0 -
 application/x-www-form-urlencoded
user_scripts-llista1000.py/r11147 Pywikipediabot/1.0 -
 -
pynik-checkimages.py/r11204 Pywikipediabot/1.0 - -
 application/json
ideasBot 1.0 Series By DGideas - -
 text/..
SiocWikiBot/1.0 - -
 application/vnd.php.serialized
 text/..
XLinkBot/1.00 - -
 text/..
Mozilla/5.0 (compatible; SnapPreviewBot; en-US; rv:1.8.0.9) Gecko/20061206 Firefox/1.5.0.9 en-us,en;q=0.5 -
 text/..
pywikipedia-wikidata_disamb_dp.py/r11200 Pywikipediabot/1.0 - -
 application/json
 application/xml
wikidata_blank_items/r-1 (unknown) Pywikipediabot/2.0 -
 application/x-www-form-urlencoded
1618216/r11222 Pywikipediabot/2.0 -
 application/x-www-form-urlencoded
maj_articles_recents/r11140 Pywikipediabot/2.0 - -
 application/json
pywikipedia-interwiki.py/r11144 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-checkimages.py/r11228 Pywikipediabot/1.0 - -
 application/json
DotNetWikiBot, edited by D. Rodionov/2.91 (Microsoft Windows NT 6.0.6002 Service Pack 2; ) - -
 text/..
 application/xml
pywikipedia-featured.py/r11268 (wikipedia.py) Pywikipediabot/1.0 -
 -
Mozilla/5.0 (X11; Linux i686; en-US; rv:1.8.0.7) Gecko/20060909 Firefox/1.5.0.7 SnapPreviewBot en-us,en;q=0.5 -
 text/..
TwynCatBot/0.2 (Contact: www.twyn.com) - -
 application/json
pywikipedia-importwd.py/r11210 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
pywikipediabot-wikidata_irc_de.py/r11215 Pywikipediabot/1.0 - -
 application/json
pynik-checkimages.py/r11176 Pywikipediabot/1.0 -
 -
RobBot ( mail address ) - -
 application/vnd.php.serialized
pynik-checkimages.py/r11176 Pywikipediabot/1.0 - -
 application/json
Peachy MediaWiki Bot API Version 0.1beta - -
 application/vnd.php.serialized
pywikipedia-wikidata9de.py/r11304 Pywikipediabot/1.0 - -
 application/json
COIBot/2.0 - -
 text/..
UCMore Crawler App en-us,en;q=0.5 -
 text/..
pywiki-commonscat.py/r11204 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
DotNetWikiBot/2.100 (Unix 3.0.0.12; ) - -
 text/..
 application/xml
wikidata-delsitelinks.py/r11060 Pywikipediabot/1.0 - -
 application/json
 -
unknown Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (Exabot-Thumbnails) en;q=0.9,*;q=0.8
 -
pywikipedia-importwd14.py/r11231 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
('python-wikitools/1.1.1 (User:BernsteinBot)',) - -
 application/json
wikbotlite/2.0 CFNetwork/609.1.4 Darwin/13.0.0 en-us -
 image/..
 application/json
 text/..
pywikipedia-ko_catcheck.py/r11275 Pywikipediabot/1.0 - -
 application/json
wAPI/1.1 (Bot: NoomBot Operator: Noommos Contact: mail address ) - -
 application/vnd.php.serialized
Junut Bot 1.0.3 ru-RU,en,* -
 text/..
 -
pywikipedia-findbox.py/r11085 Pywikipediabot/1.0 -
 -
AnomieBOT 1.0 (RandomPagePicker; see [[User:AnomieBOT]]) - -
 application/json
pywikipedia-importwd.py/r11210 Pywikipediabot/1.0 - -
 application/json
pywikirish-welcome.py/r11215 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
pywikipediabot-wikidata_irc_fr.py/r11215 Pywikipediabot/1.0 - -
 application/json
pywikipedia-redirect.py/r11301 Pywikipediabot/1.0 - -
 application/json
moje-porzucone.py/r11215 Pywikipediabot/1.0 -
 -
py2-zzdataimporter.py/r11138 Pywikipediabot/1.0 - -
 application/json
GoogleBot - -
 text/..
pywikipedia-interwiki.py/r11200 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikt-interwiki.py/r11216 (wikipedia.py) Pywikipediabot/1.0 - -
 application/xml
 application/json
pywikipedia-importwd14.py/r11231 Pywikipediabot/1.0 - -
 application/json
moje-porzucone.py/r11215 Pywikipediabot/1.0 - -
 application/json
pywikipedia-interwiki.py/r11196 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-radeh.py/r11229 Pywikipediabot/1.0 - -
 application/json
pynik-checkimages.py/r11202 Pywikipediabot/1.0 - -
 application/json
Wikidata-wikidata.py/r11202 Pywikipediabot/1.0 - -
 application/json
py3-ko_datacheck.py/r11231 Pywikipediabot/1.0 - -
 application/json
 application/xml
OrlodrimBot/1.0 - -
 text/..
 -
 application/x-www-form-urlencoded
pywikipedia-wikidata_new_wden.py/r11228 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-radeh.py/r11229 Pywikipediabot/1.0 -
 -
trunk-checkimages.py/r11300 Pywikipediabot/1.0 - -
 application/json
Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (Exabot-Thumbnails) en;q=0.9,*;q=0.8 -
 text/..
 image/..
 application/ogg
Wikibot/2.0.2 CFNetwork/548.1.4 Darwin/11.0.0 en-us -
 image/..
 application/json
 text/..
pywikipedia-parserfunctioncount.py/r11202 Pywikipediabot/1.0 - -
 application/json
Mozilla/5.0 (compatible; LucidWorks/; ; crawler at example dot com) en-us,en-gb,en;q=0.7,*;q=0.3 -
 text/..
nn-interwiki.py/r11138 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
py3-ko_datacheck.py/r11231 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
pywikipedia-importwd.py/r11172 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
trunk-interwiki.py/r11140 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-interwiki.py/r11103 Pywikipediabot/1.0 - -
 application/xml
 application/json
pywikipedia-ko_datacheck.py/r11275 Pywikipediabot/1.0 - -
 application/json
 application/xml
py2-zzdataimporter.py/r11138 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
bot-VM-auto-erl.py/r11215 Pywikipediabot/1.0 - -
 application/json
pywikipedia2-interwiki.py/r11176 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-interwiki.py/r11104 Pywikipediabot/1.0 - -
 -
 application/json
 application/x-www-form-urlencoded
 application/xml
EarwigBot/0.2.dev.gitf082fca7 (Python/2.7.3; https://github.com/earwig/earwigbot; mail address ) - -
 application/json
 -
Wikibot/2.0.2 CFNetwork/609.1.4 Darwin/13.0.0 en-gb -
 image/..
 application/json
 text/..
wikiwix-bot-3.0 en -
 text/..
trunk-checkimages.py/r11220 Pywikipediabot/1.0 - -
 application/json
pywikipedia-findbox.py/r11085 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywiki-commonscat.py/r11204 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-coord2.py/r11275 Pywikipediabot/1.0 - -
 application/json
 text/..
 application/xml
trunk-redirect.py/r11200 Pywikipediabot/1.0 - -
 application/json
 application/xml
ybot-ko_missing.py/r11114 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
Mozilla/5.0 (compatible; FriendFeedBot/0.1; Http://friendfeed.com/about/bot; 416 subscribers; feed-id=3852576738117026533) - -
 application/xml
 -
Peachy MediaWiki Bot API Version 0.1beta -
 -
pynik-checkimages.py/r11231 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
EarwigBot/0.2.dev.gitf082fca7 (Python/2.7.3; https://github.com/earwig/earwigbot; mail address ) -
 application/x-www-form-urlencoded
pywikipedia-featured.py/r11275 Pywikipediabot/1.0 - -
 application/json
 application/xml
pynik-checkimages.py/r11202 Pywikipediabot/1.0 -
 -
lowiki_removal/r-1 (unknown) Pywikipediabot/2.0 - -
 application/json
hercule-commonscat.py/r11200 Pywikipediabot/1.0 -
 -
pynik-checkimages.py/r11215 Pywikipediabot/1.0 - -
 application/json
pywikipedia-bot_control.py/r504 Pywikipediabot/1.0 - -
 application/json
 application/xml
 image/..
 text/..
ybot-ko_missing2.py/r11114 Pywikipediabot/1.0 - -
 application/json
 application/xml
ybot-ko_missing.py/r11114 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-featured.py/r11308 Pywikipediabot/1.0 - -
 application/json
 application/xml
Local Site Parser 1.0 en-us,en;q=0.5 -
 text/..
cd-delinker.py/r11029 Pywikipediabot/1.0 - -
 application/json
pywikipedia-wdph22.py/r11268 Pywikipediabot/1.0 - -
 application/json
pywikipedia-coord2.py/r11268 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
pywikipediabot-wikidata_irc_es.py/r11215 Pywikipediabot/1.0 - -
 application/json
pywikipedia-dave_sezioni.py/r11060 Pywikipediabot/1.0 - -
 application/json
 application/xml
Wikibot/2.0.2 CFNetwork/609.1.4 Darwin/13.0.0 de-de -
 image/..
 application/json
 text/..
pynik-checkimages.py/r11231 Pywikipediabot/1.0 - -
 application/json
hercule-commonscat.py/r11200 Pywikipediabot/1.0 - -
 application/json
 application/xml
User:WP 1.0 bot (operated by User:Theopolisme on enwiki) - -
 text/..
pywikipedia-coord2.py/r11268 Pywikipediabot/1.0 - -
 application/json
 text/..
 application/xml
user_scripts-selfwatch.py/r11085 Pywikipediabot/1.0 - -
 application/json
pywikipedia-basicreferenceslist.py/r11138 (wikipedia.py) Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
pywikipedia-basicreferenceslist.py/r11138 (wikipedia.py) Pywikipediabot/1.0 - -
 application/json
pywikipedia-iwiki2_TS.py/r11131 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
trunk-interwiki.py/r11168 Pywikipediabot/1.0 - -
 application/json
 application/xml
 text/..
pywikipedia-findbox.py/r11176 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
('python-wikitools/1.1.1 (User:BernsteinBot)',) -
 application/x-www-form-urlencoded
opentask-opentasks.py/r10326 (pywikibot/__init__.py) Pywikipediabot/2.0 - -
 application/json
NoyaBot - -
 text/..
pywikipedia2-interwiki.py/r11200 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-basicreferenceslist.py/r11181 (wikipedia.py) Pywikipediabot/1.0 - -
 application/json
Geni ircpybot 1.0 - -
 application/json
 text/..
 application/xml
ybot-ko_missing2.py/r11114 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
Python27-pythonw.exe/r11201 Pywikipediabot/1.0 - -
 application/json
nn-interwiki.py/r11138 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-importwd10.py/r11231 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
pywikipedia-newar4ur.py/r11135 Pywikipediabot/1.0 - -
 application/json
ZeBigWebBot - -
 text/..
Wikibot/2.0.2 CFNetwork/609.1.4 Darwin/13.0.0 zh-cn -
 image/..
 application/json
 text/..
 -
pywikipedia-importwd.py/r11172 Pywikipediabot/1.0 - -
 application/json
pywikipedia-iwiki2_TS.py/r11131 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-interwiki.py/r11204 Pywikipediabot/1.0 - -
 application/json
 application/xml
 application/x-www-form-urlencoded
 -
pywikipedia-findbox.py/r11176 Pywikipediabot/1.0 - -
 application/json
pywikipedia-interwiki.py/r11179 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikt-interwiki.py/r11070 (wikipedia.py) Pywikipediabot/1.0 - -
 application/xml
 application/json
pywikipedia-zzlangcat.py/r11265 Pywikipediabot/1.0 - -
 application/json
 -
 application/x-www-form-urlencoded
python-wikitools/1.2 (User:LaraBot) - -
 application/json
pywikipedia-featured.py/r11280 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-newar4ur.py/r11135 Pywikipediabot/1.0 -
 -
Python27-pythonw.exe/r11193 Pywikipediabot/1.0 - -
 application/json
pywikipedia-ko_datacheck.py/r11227 Pywikipediabot/1.0 - -
 application/json
 application/xml
Geni ircpybot 1.0 -
 -
pywikipedia-who_is_your_daddy.py/r11104 Pywikipediabot/1.0 - -
 application/json
pywikipedia-interwiki.py/r11265 Pywikipediabot/1.0 - -
 application/json
 -
 application/xml
 application/x-www-form-urlencoded
pynik-checkimages.py/r11215 Pywikipediabot/1.0 -
 -
pywikipedia-interwiki.py/r11189 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-welcomeurdu.py/r11185 Pywikipediabot/1.0 - -
 application/json
OpenLink Virtuoso RDF crawler - -
 image/..
 text/..
hockey_players/r-1 (unknown) Pywikipediabot/2.0 - -
 application/json
pywikipedia-iw2make.py/r11302 Pywikipediabot/1.0 - -
 application/json
 application/xml
cd-delinker.py/r11029 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
RapidPM Nutch Spider/Nutch-1.6 en-us,en-gb,en;q=0.7,*;q=0.3 -
 text/..
pywikipedia-importwd10.py/r11231 Pywikipediabot/1.0 - -
 application/json
bot-VM-auto-erl.py/r11215 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
pyelph-new_interwikickb.py/r11204 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
nn-interwiki.py/r11176 Pywikipediabot/1.0 - -
 application/json
 application/xml
AnomieBOT 1.0 (DeletionSortingCleaner; see [[User:AnomieBOT]]) - -
 application/json
DotNetWikiBot/2.96 (Microsoft Windows NT 6.0.6002 Service Pack 2; ) - -
 text/..
pywiki-commonscat.py/r11136 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
pywikipedia-iw2data.py/r11275 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-interwiki.py/r11231 Pywikipediabot/1.0 - -
 application/xml
 application/json
 -
 application/x-www-form-urlencoded
pywikipedia-kotahur.py/r11204 Pywikipediabot/1.0 -
 -
pywikt-interwiki.py/r11216 (wikipedia.py) Pywikipediabot/1.0 -
 application/x-www-form-urlencoded
 -
Wikibot/1.63 CFNetwork/596.3.3 Darwin/12.3.0 (x86_64) (MacBookPro8,1) en-us -
 image/..
 text/..
pywikipedia-interwiki.py/r11201 Pywikipediabot/1.0 - -
 application/json
 application/xml
deliw-deliw/r11202 Pywikipediabot/1.0 - -
 application/json
pywikipedia-bot_control.py/r504 Pywikipediabot/1.0 -
 application/x-www-form-urlencoded
 -
pywikipedia-interwiki.py/r11180 Pywikipediabot/1.0 - -
 application/json
 application/xml
 text/..
MediaWiki::Bot 3.1.5 - -
 application/json
process_mlb/r-1 (unknown) Pywikipediabot/2.0 - -
 application/json
pywikipedia-wikidata3.py/r11203 Pywikipediabot/1.0 - -
 application/json
python-wikitools/1.2 (User:LaraBot) -
 application/x-www-form-urlencoded
HersfoldIRCBot version 1.5.1 - -
 -
 text/..
Friendly Spider 1.0 contact mail address - -
 text/..
User:WP 1.0 bot (operated by User:Theopolisme on enwiki) -
 -
pywikipedia-basicreferenceslist.py/r11166 (wikipedia.py) Pywikipediabot/1.0 - -
 application/json
misc-tasks-expensive_templates.py/r11204 Pywikipediabot/1.0 - -
 application/json
Wikipediabot-mywikidatabot2.py/r11228 Pywikipediabot/1.0 - -
 application/json
 application/xml
commons-commons-commands.py/r11228 Pywikipediabot/1.0 - -
 application/json
 application/xml
pywikipedia-welcomeurdu.py/r11200 Pywikipediabot/1.0 -
 -
Wiki.java 0.27 r127 (OctraBot 2.2) - -
 text/..
pywikipedia-wd_edititem.py/r11216 Pywikipediabot/1.0 -
 -
 application/x-www-form-urlencoded
user_scripts-treulallengua.py/r11085 Pywikipediabot/1.0 - -
 application/json
bot-bot_rss2.py/r11144 Pywikipediabot/1.0 - -
 application/json
AnomieBOT 1.0 (CHUUClerk; see [[User:AnomieBOT]]) - -
 application/json
 text/..
46033.3total

IP ranges: known ip ranges for Google are 64.233.[160.0-191.255], 66.249.[64.0-95.255], 66.102.[0.0-15.255], 72.14.[192.0-255.255],
74.125.[0.0-255.255], 209.085.[128.0-255.255], 216.239.[32.0-63.255] and a few minor other subranges

Errata: WMF traffic logging service suffered from server capacity problems in Aug/Sep/Oct 2011.
Absolute traffic counts for October 2011 are approximatly 7% too low.
Data loss only occurred during peak hours. It therefore may have had somewhat different impact for traffic from different parts of the world.
and may have also skewed relative figures like share of traffic per browser or operating system.

From mid September till late November squid log records for mobile traffic were in invalid format.
Data could be repaired for logs from mid October onwards. Older logs were no longer available.

In a an unrelated server outage precisely half of traffic to WMF mobile sites was not counted from Oct 16 - Nov 29 (one of two load-balanced servers did not report traffic).
WMF has since improved server monitoring, so that similar outages should be detected and fixed much faster from now on.

Generated on Tue, Apr 9, 2013 16:15
Author:Erik Zachte (Web site)
Mail: ezachte@### (no spam: ### = wikimedia.org)
All data and images on this page are in the public domain.

Note: page may load slower on Microsoft Internet explorer than on other major browsers