Other reports:
 Requests: Destination/Mime - Origin - Methods - Scripts - User agents - Skins - Crawlers - Op.Sys. - Browsers - Google - Country data

 Notes on reliability of these data

 Unresolved Bugzilla bugs: 46190, 46191, 46195, 46201, 46265, (46267), 46268, 46269, 46271, 46273, 46274, 46275, 46277, 46278, 46279, 57376

The following overview of crawler (aka bot) page requests is based on the user agent information that accompanies most server requests. Unfortunately this user agent information follows rather loosely defined guidelines. Also please bear in mind than the most popular crawler names may be somewhat overrepresented. This is the result of so called user agent spoofing (where a requester supplies false credentials, e.g. to bypass web servers filters). GoogleBot seems to be a favorite for spoofing. Therefore requests from an ip address registered by Google (see below) are color coded GoogleBot, others GoogleBot For this report page requests are considered to be issued by a crawler in two cases: 1 The user agent string contains a web address (only crawlers should have that, but there a some false positives, where a browser sends a user agent string with a web address (ill behaved plug-in, main offenders have been eliminated) 2 The user agent string contains the term bot, spider or crawl[er]' In total 117,810,680 page requests (mime type text/html only!) per day are considered crawler requests, out of 582,700,870 external requests, which is 20.2%
Page requests for crawlers that specify a url in the agent string
Count x 1000	Secondary domain (~site) name	URL	Mime type	User agent
	bing
		www.bing.com/bingbot.htm	text/..	Mozilla/5.0 (compatible; bingbot/2.0; url) - -
		www.bing.com/bingbot.htm	image/..	Mozilla/5.0 (compatible; bingbot/2.0; url) - -
		www.bing.com/bingbot.htm	text/..	Mozilla/5.0 (compatible; bingbot/2.0; url) -
		www.bing.com/bingbot.htm	application/xml	Mozilla/5.0 (compatible; bingbot/2.0; url) - -
		www.bing.com/bingbot.htm	text/..	37.58.85.180 Mozilla/5.0 (compatible; bingbot/2.0; url) - -
		www.bing.com/bingbot.htm	text/..	10.23.42.20 Mozilla/5.0 (compatible; bingbot/2.0; url) (via Web-Blaster/2.21 (http://www.assoziations-blaster.de/web-blast.html)) - -
		www.bing.com/bingbot.htm	text/..	10.23.42.20 Mozilla/5.0 (compatible; bingbot/2.0; url) (via Web-Blaster/2.21 (http://www.a-blast.org/web-blast.html)) - -
		www.bing.com/bingbot.htm	text/..	(compatible; bingbot/2.0; url) - -
		www.bing.com/bingbot.htm	text/..	Mozilla/5.0 (compatible; bingbot/2.0; url) WikipediaAPI - -
		www.bing.com/bingbot.htm	text/..	Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~yourrevenues-hrd) - -
		www.bing.com/bingbot.htm	text/..	Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~surf301-hrd) - -
		www.bing.com/bingbot.htm	application/json	Mozilla/5.0 (compatible; bingbot/2.0; url) - -
		www.bing.com/bingbot.htm	text/..	Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~surf603-hrd) - -
		www.bing.com/bingbot.htm	text/..	Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~proxy6009-hrd) - -
		www.bing.com/bingbot.htm	image/..	Mozilla/5.0 (compatible; bingbot/2.0; url) -
		www.bing.com/bingbot.htm	text/..	Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~surf712-hrd) - -
		www.bing.com/bingbot.htm	text/..	Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~surfproxy6-hrd) - -
		www.bing.com/bingbot.htm	application/xml	Mozilla/5.0 (compatible; bingbot/2.0; url) -
		www.bing.com/bingbot.htm	application/ogg	Mozilla/5.0 (compatible; bingbot/2.0; url) - -
		www.bing.com/bingbot.htm	text/..	Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~they-encounter-hrd) - -
		www.bing.com/bingbot.htm	text/..	Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~proxypython6-hrd) - -
		www.bing.com/bingbot.htm	text/..	54.215.148.134 Mozilla/5.0 (compatible; bingbot/2.0; url) - -
		www.bing.com/bingbot.htm	text/..	54.215.150.33 Mozilla/5.0 (compatible; bingbot/2.0; url) - -
		www.bing.com/bingbot.htm	text/..	54.241.179.159 Mozilla/5.0 (compatible; bingbot/2.0; url) - -
		www.bing.com/bingbot.htm	text/..	Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~proxy6000-hrd) - -
		www.bing.com/bingbot.htm	text/..	54.215.150.37 Mozilla/5.0 (compatible; bingbot/2.0; url) - -
		www.bing.com/bingbot.htm	text/..	(compatible; bingbot/2.0; url) -
		www.bing.com/bingbot.htm	text/..	Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~swedishdanish-hrd) - -
	google
		www.google.com/bot.html	text/..	Mozilla/5.0 (compatible; GoogleBot/2.1; url) - -
		www.google.com/bot.html	text/..	Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot-Mobile/2.1; url) - -
		www.google.com/bot.html	-	Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot-Mobile/2.1; url) - -
		code.google.com/appengine	text/..	WikiBot/0.1 AppEngine-Google; (url; appid: newikipedia) - -
		desktop.google.com/	application/xml	Mozilla/5.0 (compatible; Google Desktop/5.9.1005.12335; url) - -
		desktop.google.com/	text/..	Mozilla/5.0 (compatible; Google Desktop/5.9.1005.12335; url) - -
		www.google.com/feedfetcher.html	image/..	Mozilla/5.0 (compatible) FeedFetcher-Google; (url) - -
		www.google.com/bot.html	image/..	Mozilla/5.0 (compatible; GoogleBot/2.1; url) - -
		desktop.google.com/	image/..	Mozilla/5.0 (compatible; Google Desktop/5.9.1005.12335; url) - -
		www.google.com/feedfetcher.html	application/xml	FeedFetcher-Google; (url) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: ortopedianew) - -
		code.google.com/p/crawler4j/	text/..	crawler4j (url) - -
		docs.google.com	image/..	Mozilla/5.0 (compatible; GoogleDocs; apps-presentations; url) - -
		docs.google.com	image/..	Mozilla/5.0 (compatible; GoogleDocs; documents; url) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: ortografia4) - -
		www.google.com/feedfetcher.html	text/..	FeedFetcher-Google; (url) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: kampungbebas) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: alexliao1995) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~zagrobelnyprox) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: thearakanesemeetingpoint) - -
		www.google.com/feedfetcher.html	text/..	Mozilla/5.0 (compatible) FeedFetcher-Google; (url) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: andrewexploit) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~s-alexander) - -
		www.google.com/bot.html	text/..	DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; GoogleBot-Mobile/2.1; url) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: wikien3) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: 9329269) - -
		www.google.com/bot.html	text/..	SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; GoogleBot-Mobile/2.1; url) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~schoolruiner) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: icanjango) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: bubba-ps) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: ax4413) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: dadolphson-proxy) - -
		code.google.com/appengine	text/..	Acre/dev/53:922 proxy.freebase-refinery.appspot.com AppEngine-Google; (url; appid: s~freebase-refinery) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: rarplayer) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: webslinger81) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: 9000tunnels) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~adddon1) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: dex-dwds) - -
		script.google.com/bot.html	text/..	Mozilla/5.0 (compatible; GoogleApps script; url) - -
		code.google.com/appengine	text/..	Mozilla/5.0 (Windows NT 6.2; rv:25.0) Gecko/20100101 Firefox/25.0 AppEngine-Google; (url; appid: s~june0066g) zh-cn,zh;q=0.8,en-us;q=0.5,en;q=0.3 -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: proxy-ba-k) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: 100pui) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: mygale1975) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: darecountyschools) - -
		www.google.com/bot.html	text/..	GoogleBot/2.1 (url) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: ghost-surf) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: azamasmadi) - -
		code.google.com/p/abot	text/..	abot v1.1.1.0 url - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: cravibruce) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: discretepword) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: toom16-10) - -
		www.google.com/feedfetcher.html	text/..	Mozilla/5.0 (compatible) FeedFetcher-Google;(url) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: chiprut-proxy) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: hamgerbur) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~espanatiki) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: jg96graham) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: wikien4) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: wwwwebp0) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: mad-proxy) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: lunaslunacy) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: ucsm111) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: velocity-web-proxy) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: mosesproxy) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~warawasetekure) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: weps004) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: boxapp) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: quigonjinn04) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: jackieonthefloor) - -
		code.google.com/appengine	text/..	Python-urllib/2.5 AppEngine-Google; (url; appid: s~isnt-it) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: taterproxy) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: bassgnt) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: rabbit-hole-app) - -
		code.google.com/appengine	text/..	www.productontology.org/1.0 (Contact: martin.heppATunibw.de) AppEngine-Google; (url; appid: gr4bing) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: worldwide-propaganda) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~hbypasser) - -
		www.google.com/bot.html	-	DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; GoogleBot-Mobile/2.1; url) - -
		www.google.com/bot.html	-	Mozilla/5.0 (compatible; GoogleBot/2.1; url) - -
		www.google.com/bot.html	-	SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; GoogleBot-Mobile/2.1; url) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: kikopea-openproxy) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: jactinternet) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: digitaniel) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: findmory) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~inter-land) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: sunmintgreen2) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: tentativiinutili) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: anonchurro) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: wiwohk-proxy-server) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: minecraft6699) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: riccio-hacks-proxy) - -
		code.google.com/appengine	image/..	AppEngine-Google; (url; appid: s~inter-land) - -
		code.google.com/appengine	text/..	Mozilla/5.0 (Windows NT 6.2; rv:25.0) Gecko/20100101 Firefox/25.0 AppEngine-Google; (url; appid: s~june0066a) zh-cn,zh;q=0.8,en-us;q=0.5,en;q=0.3 -
		docs.google.com	image/..	Mozilla/5.0 (compatible; GoogleDocs; drawings; url) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: puthiyathiravidan) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: irfansurf) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~samson-server) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: python-proxy-server) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~neidlingermj1) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: ageryder) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: jttm-server-prox) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: thepeterdeutsch) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~proxyseekkety) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: beholdonline) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: icebre4ker) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: lil05warrior) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: threewiki) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: freesurf003) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~clon-games) - -
		code.google.com/appengine	application/json	MWBOT GAE Edition AppEngine-Google; (url; appid: philip-bot) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: varlopie) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: 1free-surfing) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: javahavens) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: posten604) - -
		code.google.com/appengine	text/..	Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_2) AppleWebKit/535.7 KHTML Chrome/16.0.912.77 Safari/535.7 AppEngine-Google; (url; appid: s~feedly-social) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: laaplicaciondelucas) - -
		code.google.com/appengine	image/..	AppEngine-Google; (url; appid: s~misterhac) - -
		code.google.com/appengine	text/..	Mozilla/5.0 (Windows NT 6.2; rv:25.0) Gecko/20100101 Firefox/25.0 AppEngine-Google; (url; appid: s~june0066b) zh-cn,zh;q=0.8,en-us;q=0.5,en;q=0.3 -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~silixd-proxy) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: m19631005) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~alekproxy) - -
		code.google.com/appengine	image/..	AppEngine-Google; (url; appid: s~freekaznet) - -
		www.google.com/feedfetcher.html	application/xml	Mozilla/5.0 (compatible) FeedFetcher-Google; (url) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: keiths-proxy-server) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: klobotdoor) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: hoptheborder) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~vulture-engine) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: proxy12345) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~badbolt20) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: mbw-portal) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: 42turkeysproxy) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: web-proxy-hh) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~japantiki) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: thegatetoweb) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~app3123ak) - -
		desktop.google.com/	image/..	Mozilla/5.0 (compatible; Google Desktop/5.9.911.3589; url) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: icecool1987) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: hideproxyz) - -
		code.google.com/appengine	text/..	mail address AppEngine-Google; (url; appid: s~wiki-sherpa) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: tgbeeson) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: elbigboss-35) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: go6internet) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: internet-comunidadmoviles) - -
		www.google.com/bot.html	-	Mozilla/5.0 (iPhone; CPU iPhone OS 4_1 like Mac OS X; en-us) AppleWebKit/532.9 KHTML Version/4.0.5 Mobile/8B117 Safari/6531.22.7 (compatible; GoogleBot-Mobile/2.1; url) - -
		code.google.com/appengine	image/..	Mozilla/5.0 (Windows NT 6.1; WOW64; rv:25.0) Gecko/20100101 Firefox/25.0 AppEngine-Google; (url; appid: s~revdonut-01) zh-cn,zh;q=0.7,en-us;q=0.3 -
		code.google.com/appengine	text/..	Mozilla/5.0 (Windows NT 6.2; rv:26.0) Gecko/20100101 Firefox/26.0 AppEngine-Google; (url; appid: s~june0066d) zh-cn,zh;q=0.8,en-us;q=0.5,en;q=0.3 -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: gaucho-labnol) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: wmhsonline) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: leemus-net-proxy) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~proxy-goo) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: gratistelcel) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: dexapassa) - -
		www.google.com/bot.html	text/..	Mozilla/5.0 (iPhone; CPU iPhone OS 4_1 like Mac OS X; en-us) AppleWebKit/532.9 KHTML Version/4.0.5 Mobile/8B117 Safari/6531.22.7 (compatible; GoogleBot-Mobile/2.1; url) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: 12345proxy) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: kylesumrallproxy) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: computer-solutions) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: tortelliniman) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: chilla-cell) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: he4lproxy) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~sony-hack) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: openfence) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: alex2610ps) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: easypox) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: dkoxyserv) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~misterhac) - -
		www.google.com/bot.html	application/pdf	Mozilla/5.0 (compatible; GoogleBot/2.1; url) - -
		code.google.com/appengine	text/..	Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 KHTML Chrome/31.0.1650.63 Safari/537.36 AppEngine-Google; (url; appid: s~ffffnm) zh-CN,zh;q=0.8 -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: ambeaujeanc) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: lovelamp1988) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: paradigm-web-proxy) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~rennnat) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~dizykit) - -
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~vemmastar-c4) - -
	facebook
		www.facebook.com/externalhit_uatext.php	image/..	facebookexternalhit/1.1 (url) -
		www.facebook.com/externalhit_uatext.php	image/..	facebookexternalhit/1.1 (url) - -
		www.facebook.com/externalhit_uatext.php	text/..	facebookexternalhit/1.1 (url) - -
		www.facebook.com/externalhit_uatext.php	text/..	facebookexternalhit/1.1 (url) -
		www.facebook.com/externalhit_uatext.php	text/..	facebookexternalhit/1.0 (url) -
		www.facebook.com/externalhit_uatext.php	text/..	facebookexternalhit/1.0 (url) - -
		www.facebook.com/externalhit_uatext.php	image/..	facebookexternalhit/1.0 (url) -
		www.facebook.com/externalhit_uatext.php	image/..	facebookexternalhit/1.0 (url) - -
		www.facebook.com/externalhit_uatext.php	application/json	facebookexternalhit/1.1 (url) - -
		developers.facebook.com	image/..	facebookplatform/1.0 (url) -
		developers.facebook.com	image/..	facebookplatform/1.0 (url) - -
	baidu
		www.baidu.com/search/spider.html	text/..	Mozilla/5.0 (compatible; Baiduspider/2.0; url) en-US -
		www.baidu.com/search/spider.html	text/..	Mozilla/5.0 (compatible; Baiduspider/2.0; url) - -
		www.baidu.com/search/spider.html	text/..	Mozilla/5.0 (compatible; Baiduspider/2.0; url) zh-cn,zh-tw -
		www.baidu.com/search/spider.htm	text/..	Baiduspider-image(url) - -
		www.baidu.com/search/spider.htm	image/..	Baiduspider-image(url) - -
		www.baidu.com/search/spider.html	text/..	Mozilla/5.0 (compatible; Baiduspider/2.0; url) -
		www.baidu.com/search/spider.html	text/..	37.58.85.180 Mozilla/5.0 (compatible; Baiduspider/2.0; url) en-US -
		www.baidu.com/search/spider.html	text/..	Mozilla/5.0 (compatible; Baiduspider/2.0; url) en-us,en;q=0.5 -
		www.baidu.com/search/spider.html	text/..	Mozilla/5.0 (Linux;u;Android/2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; url) - -
		www.baidu.com/search/spider.html	image/..	Mozilla/5.0 (Linux;u;Android/2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; url) en-US,* -
		www.baidu.com/search/spider.html	text/..	(compatible; Baiduspider/2.0; url) - -
		www.baidu.com/search/spi_der.html	text/..	Mozilla/5.0 (Linux;u;Android/2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; url) - -
		www.baidu.com/search/spider.html	text/..	Mozilla/5.0 (compatible; Baiduspider-cpro; url) - -
		www.baidu.com/search/spider.html	-	Mozilla/5.0 (Linux;u;Android/2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; url) - -
		www.baidu.com/search/spider.html	text/..	Mozilla/5.0 (compatible; Baiduspider/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~pp8hh9) en-US -
		www.baidu.com/search/spider.html	text/..	Mozilla/5.0 (compatible; Baiduspider/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: jpg8jpg) en-US -
		www.baidu.com/search/spider.html	text/..	Mozilla/5.0 (compatible; Baiduspider/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~pagedaili7) en-US -
		www.baidu.com/search/spider.html	text/..	Mozilla/5.0 (Linux;u;Android/2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; url) zh-cn,zh-tw -
		www.baidu.com/search/spider.html	application/opensearchdescription+xml	Mozilla/5.0 (Linux;u;Android/2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; url) - -
		www.baidu.com/search/spider.html	text/..	Mozilla/5.0 (compatible; Baiduspider/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~pp8hh4) en-US -
		www.baidu.com/search/spider.html	-	Mozilla/5.0 (Linux;u;Android/2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; url) en-US,* -
		www.baidu.com/search/spider.html	text/..	Mozilla/5.0 (compatible; Baiduspider/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~da8hao) en-US -
		www.baidu.com/search/spider.html	application/rsd+xml	Mozilla/5.0 (Linux;u;Android/2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; url) - -
		www.baidu.com/search/spider.html	text/..	Mozilla/5.0 (compatible; Baiduspider/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~hhff2h) en-US -
		www.baidu.com/search/spider.html	application/xml	Mozilla/5.0 (Linux;u;Android/2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; url) - -
		www.baidu.com/search/spider.html	text/..	Mozilla/5.0 (Linux;u;Android/2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; url) en-US,* -
		www.baidu.com/search/spider.html	text/..	Mozilla/5.0 (compatible; Baiduspider/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~pp8gg6) en-US -
		www.baidu.com/search/spider.html	text/..	Mozilla/5.0 (compatible; Baiduspider/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~pp8hh10) en-US -
		www.baidu.com/search/spider.html	text/..	188.129.143.73 Mozilla/5.0 (compatible; Baiduspider/2.0; url) en-US -
		www.baidu.com/search/spider.html	image/..	Mozilla/5.0 (compatible; Baiduspider/2.0; url) en-US -
		www.baidu.com/search/spider.html	text/..	(compatible; Baiduspider/2.0; url) -
	msn
		search.msn.com/msnbot.htm	text/..	msnbot-media/1.1 (url) - -
		search.msn.com/msnbot.htm	image/..	msnbot-media/1.1 (url) - -
		search.msn.com/msnbot.htm	text/..	msnbot-NewsBlogs/2.0b (url) - -
		search.msn.com/msnbot.htm	text/..	msnbot/2.0b (url) - -
		search.msn.com/msnbot.htm	text/..	msnbot-Products/1.0 (url) - -
		search.msn.com/msnbot.htm	image/..	msnbot-media/2.0b (url) - -
		search.msn.com/msnbot.htm	text/..	msnbot-UDiscovery/2.0b (url) - -
		search.msn.com/msnbot.htm	text/..	37.58.85.180 msnbot-media/1.1 (url) - -
		search.msn.com/msnbot.htm	image/..	msnbot-NewsBlogs/2.0b (url) - -
		search.msn.com/msnbot.htm	text/..	msnbot/0.01 (url) - -
	google?
		www.google.com/bot.html	text/..	Mozilla/5.0 (compatible; GoogleBot/2.1; url) - -
		www.google.com/bot.html	text/..	Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot-Mobile/2.1; url) - -
		www.google.com/bot.html	text/..	GoogleBot/2.1 (url) - -
		www.google.com/bot.html	-	Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot-Mobile/2.1; url) - -
		www.google.com/bot.html	text/..	Mozilla/5.0 (compatible; GoogleBot/2.1; url) -
		www.google.com/bot.html	text/..	(compatible; GoogleBot/2.1; url) - -
		www.google.com/bot.html	image/..	Mozilla/5.0 (compatible; GoogleBot/2.1; url) - -
		www.google.com/bot.html	text/..	37.58.85.180 Mozilla/5.0 (compatible; GoogleBot/2.1; url) - -
		www.google.com/bot.html	application/json	Mozilla/5.0 (compatible; GoogleBot/2.1; url) - -
		www.google.com/bot.html	text/..	Mozilla/5.0 (compatible; GoogleBot/2.0; url) en-us;q=0.7, en;q=0.3 -
		www.google.com/bot.html	image/..	Mozilla/5.0 (compatible; GoogleBot/2.1; url) en-US,en;q=0.5 -
		www.google.com/bot.html	text/..	Mozilla/5.0 (compatible; GoogleBot/2.1; url) en-US,en;q=0.5 -
		www.google.com/bot.html	text/..	Mozilla/5.0 (compatible; GoogleBot/2.1; url) en-us,en;q=0.5 -
		www.google.com/bot.html	text/..	Mozilla/5.0 (compatible; GoogleBot/2.1; url) bg -
		www.google.com/bot.html	text/..	DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; GoogleBot-Mobile/2.1; url) - -
		www.google.com/bot.html	text/..	SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; GoogleBot-Mobile/2.1; url) - -
		www.google.com/bot.html	-	SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; GoogleBot-Mobile/2.1; url) - -
		www.google.com/bot.html	text/..	Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot-Mobile/2.1; url) -
		www.google.com/bot.html	-	DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; GoogleBot-Mobile/2.1; url) - -
		www.google.com/bot.html	text/..	Mozilla/5.0 (compatible; GoogleBot/2.1; url) zh-cn -
		www.google.com/bot.html	text/..	(compatible; GoogleBot/2.1; url) -
	yandex
		yandex.com/bots	text/..	Mozilla/5.0 (compatible; YandexBot/3.0; url) ru, uk;q=0.8, be;q=0.8, en;q=0.7, *;q=0.01 -
		yandex.com/bots	text/..	Mozilla/5.0 (compatible; YandexImages/3.0; url) ru, uk;q=0.8, be;q=0.8, en;q=0.7, *;q=0.01 -
		yandex.com/bots	text/..	Mozilla/5.0 (compatible; YandexImages/3.0; url) - -
		yandex.com/bots	text/..	Mozilla/5.0 (compatible; YandexDirect/3.0; url) ru, uk;q=0.8, be;q=0.8, en;q=0.7, *;q=0.01 -
		yandex.com/bots	image/..	Mozilla/5.0 (compatible; YandexImages/3.0; url) ru, uk;q=0.8, be;q=0.8, en;q=0.7, *;q=0.01 -
		yandex.com/bots	text/..	Mozilla/5.0 (compatible; YandexBot/3.0; url) - -
		yandex.com/bots	image/..	Mozilla/5.0 (compatible; YandexImages/3.0; url) - -
		yandex.com/bots	image/..	Mozilla/5.0 (compatible; YandexImageResizer/2.0; url) -
		yandex.com/bots	text/..	Mozilla/5.0 (compatible; YandexBot/3.0; url) en-us, en;q=0.7, *;q=0.01 -
		yandex.com/bots	image/..	Mozilla/5.0 (compatible; YandexBot/3.0; url) ru, uk;q=0.8, be;q=0.8, en;q=0.7, *;q=0.01 -
		yandex.com/bots	text/..	(compatible; YandexBot/3.0; url) - -
		yandex.com/bots	image/..	Mozilla/5.0 (compatible; YandexImages/3.0; url) en-us, en;q=0.7, *;q=0.01 -
		yandex.com/bots	text/..	Mozilla/5.0 (compatible; YandexDirect/3.0; url) - -
		yandex.com/bots	image/..	Mozilla/5.0 (compatible; YandexImages/3.0; url) -
		yandex.com/bots	application/json	Mozilla/5.0 (compatible; YandexBot/3.0; url) - -
	digplanet
		www.digplanet.com/wiki	application/vnd.php.serialized	Digplanet/1.0 (url; mail address ) PHP/5.4 - -
	orange
		wikipedia.orange.fr/	text/..	API/1.0 (url) - -
		wikipedia.orange.fr/	text/..	WikipediaApp_svc/1.5.13 (url; mail address ) com.orange.mmp/1.7.0 - -
		wikipedia.orange.fr/	application/xml	API/1.0 (url) - -
	youdao
		www.youdao.com/help/webmaster/spider/	text/..	Mozilla/5.0 (compatible; YoudaoBot/1.0; url; ) - -
	http:
		http://alm.labs.crossref.org	application/json	Article Level Metrics - url - -
		http://alm.labs.crossref.org	application/json	Article Level Metrics - url -
		http://alm.example.org	application/json	Article Level Metrics - url - -
	ahrefs
		ahrefs.com/robot/	text/..	Mozilla/5.0 (compatible; AhrefsBot/5.0; url) - -
		ahrefs.com/robot/	text/..	37.58.85.180 Mozilla/5.0 (compatible; AhrefsBot/5.0; url) - -
		ahrefs.com/robot/	image/..	Mozilla/5.0 (compatible; AhrefsBot/5.0; url) - -
		ahrefs.com/robot/	text/..	Mozilla/5.0 (compatible; AhrefsBot/5.0; url) -
		ahrefs.com/robot/	text/..	Mozilla/5.0 (compatible; AhrefsBot.FreshPages/0.1; url) - -
		ahrefs.com/	application/xml	AhrefsBot.Feeds v0.1; url - -
	genieo
		www.genieo.com/webfilter.html	text/..	Mozilla/5.0 (compatible; Genieo/1.0 url) - -
		www.genieo.com/webfilter.html	application/xml	Mozilla/5.0 (compatible; Genieo/1.0 url) - -
		www.genieo.com/webfilter.html	image/..	Mozilla/5.0 (compatible; Genieo/1.0 url) - -
		www.genieo.com/webfilter.html	image/..	Mozilla/5.0 (compatible; Genieo/1.0 url) en,*
	sogou
		www.sogou.com/docs/help/webmasters.htm#07	text/..	Sogou web spider/4.0(url) zh-cn -
		www.sogou.com/docs/help/webmasters.htm#07	text/..	Sogou Pic Spider/3.0(url) zh-cn -
		www.sogou.com/docs/help/webmasters.htm#07	text/..	Sogou web spider/4.0(url) - -
		www.sogou.com/docs/help/webmasters.htm#07	application/json	Sogou web spider/4.0(url) - -
	naver
		help.naver.com/robots/	text/..	Yeti/1.0 (NHN Corp.; url) ja,en;q=0.5 -
		help.naver.com/robots/	text/..	Yeti/1.0 (NHN Corp.; url) ko,en;q=0.5 -
		help.naver.com/robots/	text/..	Yeti/1.0 (NHN Corp.; url) ko,ja,en;q=0.5 -
		help.naver.com/robots/	application/json	Yeti/1.1 (Naver Corp.; url) ko-KR,ko;q=0.8,en-US;q=0.6,en;q=0.4 -
		help.naver.com/robots/	text/..	Yeti/1.1 (NHN Corp.; url) ko-KR,ko;q=0.8,en-US;q=0.6,en;q=0.4 -
		help.naver.com/robots/	application/json	Yeti/1.1 (NHN Corp.; url) ko-KR,ko;q=0.8,en-US;q=0.6,en;q=0.4 -
		help.naver.com/robots/	text/..	Yeti/1.1 (Naver Corp.; url) ko-KR,ko;q=0.8,en-US;q=0.6,en;q=0.4 -
		help.naver.com/robots/	image/..	Yeti/1.0 (NHN Corp.; url) ja,en;q=0.5 -
		help.naver.com/robots/	image/..	Yeti/1.1 (Naver Corp.; url) ko-KR,ko;q=0.8,en-US;q=0.6,en;q=0.4 -
		help.naver.com/robots/	image/..	Yeti/1.0 (NHN Corp.; url) ko,ja,en;q=0.5 -
	cibra
		cibra.de/	text/..	CiBra Data Collector (url) - -
	mail
		go.mail.ru/help/robots	text/..	Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; url) ru,by;q=0.7,en;q=0.7,kz;q=0.7,ua;q=0.7,*;q=0.1 -
		go.mail.ru/help/robots	text/..	Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; url) ru,ua;q=0.7,by;q=0.7,*;q=0.1 -
		go.mail.ru/help/robots	image/..	Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Img/2.0; url) ru,by;q=0.7,en;q=0.7,kz;q=0.7,ua;q=0.7,*;q=0.1 -
		go.mail.ru/help/robots	text/..	Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; url) - -
		go.mail.ru/help/robots	image/..	Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Img/2.0; url) ru,ua;q=0.7,by;q=0.7,*;q=0.1 -
		go.mail.ru/help/robots	image/..	Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; url) ru,by;q=0.7,en;q=0.7,kz;q=0.7,ua;q=0.7,*;q=0.1 -
	yacy
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Windows Server 2008 R2 6.1; java 1.7.0_45; Europe/de) url en-us,en;q=0.5 -
		yacy.net/bot.html	text/..	yacybot (freeworld-global; amd64 Windows Server 2008 R2 6.1; java 1.7.0_45; Europe/de) url en-us,en;q=0.5 -
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.7.10-1.16-desktop; java 1.7.0_45; Europe/de) url en-us,en;q=0.5 -
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.11.0-12-generic; java 1.6.0_27; Europe/en) url en-us,en;q=0.5 -
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.2.0-4-amd64; java 1.7.0_25; Europe/de) url en-us,en;q=0.5 -
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.11-0.bpo.2-amd64; java 1.6.0_27; Europe/de) url en-us,en;q=0.5 -
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.2.0-4-amd64; java 1.6.0_27; Europe/de) url en-us,en;q=0.5 -
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.10-0.bpo.3-amd64; java 1.6.0_27; Europe/de) url en-us,en;q=0.5 -
		yacy.net/bot.html	text/..	yacybot (freeworld/global; i386 Linux 2.6.32-5-686; java 1.7.0_21; Europe/en) url en-us,en;q=0.5 -
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.2.41-042stab081.5; java 1.6.0_27; Europe/en) url en-us,en;q=0.5 -
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.2.0-4-amd64; java 1.7.0_25; Europe/en) url en-us,en;q=0.5 -
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.12.0-sabayon; java 1.7.0_45; Europe/nl) url en-us,en;q=0.5 -
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.12.1; java 1.7.0_25; Europe/en) url en-us,en;q=0.5 -
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.5.0-18-generic; java 1.6.0_27; Europe/ru) url en-us,en;q=0.5 -
		yacy.net/bot.html	text/..	yacybot (freeworld/global; i386 Linux 3.11-2-686-pae; java 1.7.0_21; Europe/en) url en-us,en;q=0.5 -
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Windows Server 2012 6.2; java 1.7.0_25; Europe/de) url en-us,en;q=0.5 -
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.11-2-amd64; java 1.7.0_21; Europe/en) url en-us,en;q=0.5 -
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Windows 8 6.2; java 1.7.0_21; Europe/de) url en-us,en;q=0.5 -
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.10.17-gentoo; java 1.7.0_45; UTC/en) url en-us,en;q=0.5 -
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Windows 7 6.1; java 1.7.0_04; Europe/pl) url en-us,en;q=0.5 -
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.11-2-amd64; java 1.7.0_21; Europe/pl) url en-us,en;q=0.5 -
	stackoverflow
		stackoverflow.com/questions/8956331/how-to-get-results-from-the-wikipedia-api-with-php	text/..	Testing for url - -
		stackoverflow.com/questions/8956331/how-to-get-results-from-the-wikipedia-api-with-php	text/..	Testing for url -
	sblog
		fulltext.sblog.cz/screenshot/	image/..	Mozilla/5.0 (compatible; Seznam screenshot-generator 2.0; url) cs,cz,sk;q=0.7,*;q=0.5 -
		fulltext.sblog.cz/	text/..	SeznamBot/3.0 (url) cs -
		fulltext.sblog.cz/screenshot/	text/..	Mozilla/5.0 (compatible; Seznam screenshot-generator 2.0; url) cs,cz,sk;q=0.7,*;q=0.5 -
		fulltext.sblog.cz/	text/..	Mozilla/5.0 (compatible; SeznamBot/3.1-test1; url) cs -
		fulltext.sblog.cz/screenshot/	image/..	Mozilla/5.0 (compatible; Seznam screenshot-generator 2.1; url) cs,cz,sk;q=0.7,*;q=0.5 -
		fulltext.sblog.cz/screenshot/	text/..	Mozilla/5.0 (compatible; Seznam screenshot-generator 2.1; url) cs,cz,sk;q=0.7,*;q=0.5 -
		fulltext.sblog.cz/	text/..	SeznamBot/3.0 (url) - -
		fulltext.sblog.cz/	application/ogg	SeznamBot/3.0 (url) cs -
	wordpress
		raymondpronk.wordpress.com	text/..	WordPress/3.8-RC2; url - -
		peripluscd.wordpress.com	text/..	WordPress/3.9-alpha; url - -
		bharatabharati.wordpress.com	text/..	WordPress/3.9-alpha; url - -
		peoplesadvocacycouncil.wordpress.com	text/..	WordPress/3.8-RC1; url - -
		bharatabharati.wordpress.com	text/..	WordPress/3.8-RC2; url - -
		josefboberg.wordpress.com	text/..	WordPress/3.9-alpha; url - -
		letempledejesuschrist.wordpress.com	text/..	WordPress/3.8-RC1; url - -
		peoplesadvocacycouncil.wordpress.com	text/..	WordPress/3.9-alpha; url - -
		whatownsme.wordpress.com	text/..	WordPress/3.9-alpha; url - -
		radishmag.wordpress.com	text/..	WordPress/3.9-alpha; url - -
		greatriversofhope.wordpress.com	text/..	WordPress/3.9-alpha; url - -
		dshenai.wordpress.com	text/..	WordPress/3.8-RC2; url - -
		y35pm.wordpress.com	text/..	WordPress/3.9-alpha; url - -
		whatownsme.wordpress.com	text/..	WordPress/3.8-RC1; url - -
		josefboberg.wordpress.com	text/..	WordPress/3.8-RC1; url - -
		davidderrick.wordpress.com	text/..	WordPress/3.9-alpha; url - -
		paulalexanderwolf.wordpress.com	text/..	WordPress/3.9-alpha; url - -
		02varvara.wordpress.com	text/..	WordPress/3.9-alpha; url - -
		yinwang0.wordpress.com	text/..	WordPress/3.9-alpha; url - -
		famouspeoplenews.wordpress.com	text/..	WordPress/3.9-alpha; url - -
		whatownsme.wordpress.com	text/..	WordPress/3.8-RC2; url - -
		radishmag.wordpress.com	text/..	WordPress/3.8-RC2; url - -
		halokue.wordpress.com	text/..	WordPress/3.8-RC2; url - -
	php
		pear.php.net/	application/vnd.php.serialized	PEAR HTTP_Request class ( url ) - -
		pear.php.net/	image/..	PEAR HTTP_Request class ( url ) - -
		pear.php.net/	text/..	PEAR HTTP_Request class ( url ) - -
		pear.php.net/package/http_request2	application/xml	HTTP_Request2/2.1.1 (url) PHP/5.3.15 - -
		pear.php.net/	image/..	PEAR HTTP_Request class ( url ) -
		pear.php.net/package/http_request2	image/..	HTTP_Request2/2.1.1 (url) PHP/5.3.2-1ubuntu4.18 - -
		pear.php.net/package/http_request2	text/..	HTTP_Request2/2.1.1 (url) PHP/5.3.27 - -
	www.
		www.	text/..	GoogleBot/2.1 ( urlGoogleBot.com/bot.html) - -
		www.	text/..	GoogleBot-Image/1.0 ( urlGoogleBot.com/bot.html) - -
		www.	text/..	GoogleBot/2.1 (urlGoogleBot.com/bot.html) - -
		www.	text/..	GoogleBot/2.1 (urlGoogleBot.com/bot.html) -
		www.	application/json	GoogleBot/2.1 (urlGoogleBot.com/bot.html) - -
	echonest
		the.echonest.com/reader/	application/xml	nestReader/0.3 (discovery; url; reader at echonest.com) en -
		the.echonest.com/reader/	text/..	nestReader/0.3 (discovery; url; reader at echonest.com) en -
		the.echonest.com/reader/	image/..	nestReader/0.3 (discovery; url; reader at echonest.com) en -
	nodejs
		nodejs.org	text/..	NodeJsWikipediaReader/0.1 (url; mail address ) BasedOnNodeJs/0.8.22 - -
	traslated
		mymemory.traslated.net/doc/	text/..	Mozilla/5.0 (MyMemory Bot url) - -
	easou
		www.easou.com/search/spider.html	text/..	Mozilla/5.0 (compatible; EasouSpider; url) zh;q=0.9,en;q=0.8 -
		www.easou.com/search/spider.html	application/json	Mozilla/5.0 (compatible; EasouSpider; url) - -
		www.easou.com/search/spider.html	image/..	Mozilla/5.0 (compatible; EasouSpider; url) zh;q=0.9,en;q=0.8 -
	bin-co
		www.bin-co.com/php/scripts/load/	application/vnd.php.serialized	BinGet/1.00.A (url) - -
		www.bin-co.com/php/scripts/load/	text/..	BinGet/1.00.A (url) - -
	exabot
		www.exabot.com/go/robot	text/..	Mozilla/5.0 (compatible; Exabot/3.0; url) - -
		www.exabot.com/go/robot	text/..	Mozilla/5.0 (compatible; Exabot/3.0 (BiggerBetter); url) - -
	wikipedia
		en.wikipedia.org/wiki/User:NicoV/Wikipedia_Cleaner/Documentation	text/..	WPCleaner (url) - -
		en.wikipedia.org/wiki/Wikipedia:Huggle	text/..	Huggle/2.1.21.0 url - -
		de.wikipedia.org/wiki/Benutzer:APPER/WikiHistory	text/..	WikiHistory (url) - -
		fr.wikipedia.org/wiki/Utilisateur:OrlodrimBot	text/..	OrlodrimBot/1.0 (url) - -
	majestic12
		www.majestic12.co.uk/bot.php?	text/..	Mozilla/5.0 (compatible; MJ12bot/v1.4.4; url) - -
		www.majestic12.co.uk/bot.php?	text/..	Mozilla/5.0 (compatible; MJ12bot/v1.4.4; url) en -
		www.majestic12.co.uk/bot.php?	text/..	Mozilla/5.0 (compatible; MJ12bot/v1.4.4; url) -
		www.majestic12.co.uk/bot.php?	text/..	(compatible; MJ12bot/v1.4.4; url) - -
	zipcode
		zipcode.us	text/..	Mozilla/5.0 (compatible; YourCoolBot/1.0; url) - -
	yahoo
		help.yahoo.com/help/us/ysearch/slurp	text/..	Mozilla/5.0 (compatible; Yahoo! Slurp; url) - -
		help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html	text/..	Y!J-BRJ/YATS crawler (url) - -
		help.yahoo.com/help/us/ysearch/slurp	image/..	Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; url) NOT Firefox/3.5 en-us,en;q=0.5 -
		help.yahoo.com/help/us/ysearch/slurp	text/..	Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; url) NOT Firefox/3.5 en-us,en;q=0.5 -
		help.yahoo.com/help/us/ysearch/slurp	text/..	Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; url) en-us,en;q=0.5 -
		help.yahoo.com/help/us/ysearch/slurp	text/..	Mozilla/5.0 (compatible; Yahoo! Slurp; url ) zh-cn,zh; -
		help.yahoo.com/help/us/ysearch/slurp	image/..	98.137.206.106 Mozilla/5.0 (compatible; Yahoo! Slurp; url) - -
	flipboard
		flipboard.com/browserproxy	image/..	null (FlipboardProxy/1.1; url) - -
		flipboard.com/browserproxy	image/..	Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (FlipboardProxy/1.2; url) - -
		flipboard.com/browserproxy	text/..	null (FlipboardProxy/1.1; url) - -
		flipboard.com/browserproxy	text/..	Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (FlipboardProxy/1.1; url) en-us,en;q=0.5 -
		flipboard.com/browserproxy	text/..	Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (FlipboardProxy/1.2; url) - -
		flipboard.com/browserproxy	image/..	Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (FlipboardProxy/1.1; url) en-us,en;q=0.5 -
		flipboard.com/browserproxy	text/..	Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (FlipboardProxy/2.0; url) en-us,en;q=0.5 -
	wmflabs
		tools.wmflabs.org/geohack	text/..	Geohack (url) - -
		tools.wmflabs.org/random-featured/	application/vnd.php.serialized	random-featured (Tool Labs; url) - -
	archive
		www.archive.org/details/archive.org_bot	image/..	Mozilla/5.0 (compatible; archive.org_bot url) - -
		www.archive.org/details/archive.org_bot	image/..	Mozilla/5.0 (compatible; special_archiver/3.1.1 url) - -
		www.archive.org/details/archive.org_bot	text/..	Mozilla/5.0 (compatible; special_archiver/3.1.1 url) - -
		archive.org/details/archive.org_bot	image/..	Mozilla/5.0 (compatible; heritrix/3.1.2-SNAPSHOT-20131029-0036 url) - -
		archive.org/details/archive.org_bot	text/..	Mozilla/5.0 (compatible; archive.org_bot url) - -
		www.archive.org/details/archive.org_bot	text/..	Mozilla/5.0 (compatible; archive.org_bot url) - -
		archive.org/details/archive.org_bot	text/..	Mozilla/5.0 (compatible; heritrix/3.1.2-SNAPSHOT-20131029-0036 url) - -
	blekko
		blekko.com/about/blekkobot	text/..	Mozilla/5.0 (compatible; Blekkobot; ScoutJet; url) - -
	scrapy
		scrapy.org	text/..	Scrapy/0.20.1 (url) en -
		scrapy.org	text/..	Scrapy/0.20.0 (url) en -
		scrapy.org	text/..	Scrapy/0.16.5 (url) en -
		scrapy.org	text/..	Scrapy/0.20.2 (url) en -
	webmeup-crawler
		webmeup-crawler.com/	text/..	Mozilla/5.0 (compatible; BLEXBot/1.0; url) - -
		webmeup-crawler.com/	text/..	(compatible; BLEXBot/1.0; url) - -
	dynotes
		www.dynotes.com/multi-lang-dictionary/	application/json	MLD/4.9.2 (url; mail address en-us -
		www.dynotes.com/multi-lang-dictionary/	application/json	MLD (WP 7)/1.1.2 (url); mail address - -
		www.dynotes.com/multi-lang-dictionary/	application/json	MLD/4.9.2 (url; mail address en-gb -
		www.dynotes.com/multi-lang-dictionary/	application/json	MLD/4.9.2 (url; mail address ar -
		www.dynotes.com/multi-lang-dictionary/	application/json	MLD/4.9.2 (url; mail address ru -
	zum
		help.zum.com/inquiry	text/..	ZumBot/1.0 (ZUM Search; url) - -
		help.zum.com/inquiry	text/..	Mozilla/5.0 (compatible; ZumBot/1.0; url) - -
		help.zum.com/inquiry	image/..	ZumBot/1.0 (ZUM Search; url) - -
	plos
		alm.plos.org	application/json	PLOS Article-Level Metrics - url - -
	coccoc
		help.coccoc.com/	text/..	Mozilla/5.0 (compatible; coccoc/1.0; url) en-us;q=0.7,en;q=0.3 -
		help.coccoc.com/	text/..	Mozilla/5.0 (compatible; coccoc/1.0; url) - -
	localhost
		localhost/clumpit/bot.php	text/..	Mozilla/5.0 (compatible; clumboot; url) - -
		localhost/robot/bot.php	text/..	Mozilla/5.0 (compatible; Please Name Your robot; url) - -
		localhost/znm/bot.php	text/..	Mozilla/5.0 (compatible; Please Name Your robot; url) - -
	semrush
		www.semrush.com/bot.html	text/..	Mozilla/5.0 (compatible; SemrushBot/0.97; url) - -
	phonifier
		www.phonifier.com	text/..	Mozilla/5.0 (compatible; Phonifier; url) - -
	drupal
		drupal.org/	application/json	Drupal (url) - -
		drupal.org/	text/..	Drupal (url) - -
		drupal.org/	image/..	Drupal (url) - -
		drupal.org/	text/..	User-Agent: Drupal (url) - -
	netarkivet
		netarkivet.dk/webcrawler/	text/..	Mozilla/5.0 (compatible; heritrix/1.14.4 url) - -
		netarkivet.dk/webcrawler/	image/..	Mozilla/5.0 (compatible; heritrix/1.14.4 url) - -
	toolserver
		wiki.toolserver.org/view/GeoHack	text/..	Geohack (url) - -
		wiki.toolserver.org/view/GeoHack	text/..	Geohack (url) -
		toolserver.org/~dispenser/	text/..	DispensersTools (url) -
		toolserver.org/~dispenser/	application/json	DispensersTools (url) -
		toolserver.org/~dispenser/	image/..	CacheThumbs/1.4 (url) -
		toolserver.org/~dispenser/	text/..	DispensersTools (url) - -
		toolserver.org/~para/cgi-bin/kmlexport	text/..	url libwww-perl/6.02 - -
		toolserver.org/~dispenser/	application/json	DispensersTools (url) - -
	webceo
		online.webceo.com	text/..	Mozilla/5.0 (compatible; web-ceo-online-bot/1.0; url) - -
	searchmetrics
		www.searchmetrics.com/en/searchmetrics-bot/	text/..	Mozilla/5.0 (compatible; SearchmetricsBot; url) - -
	goo
		help.goo.ne.jp/contact/	text/..	goo wikipedia (url) - -
		goo.gl/7y4SX	text/..	GoogleProducer; (url) - -
		search.goo.ne.jp/option/use/sub4/sub4-1/	text/..	DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo;url) - -
		search.goo.ne.jp/option/use/sub4/sub4-1/	-	DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo;url) - -
		search.goo.ne.jp/option/use/sub4/sub4-1/	text/..	ichiro/3.0 (url) - -
	feedly
		www.feedly.com/fetcher.html	application/xml	Feedly/1.0 (url; like FeedFetcher-Google) - -
		www.feedly.com	text/..	FeedlyApp/1.0 (url) - -
	daum
		tab.search.daum.net/aboutWebSearch.html	text/..	Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows server; url) Daumoa/3.0 ko-kr,ko;q=0.8,en-us;q=0.5,en;q=0.3 -
		tab.search.daum.net/aboutWebSearch.html	text/..	Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows server; url) Daumoa/3.0 - -
	pinterest
		pinterest.com/	text/..	Pinterest/0.1 url - -
		pinterest.com/	image/..	Pinterest/0.1 url - -
	veveo
		corporate.veveo.net/webmasters.html	text/..	Mozilla/5.0 (compatible; Veveobot; url) - -
	duckduckgo
		duckduckgo.com/duckduckbot.html	text/..	DuckDuckBot/1.1; (url) - -
		duckduckgo.com/duckduckbot.html	image/..	DuckDuckBot/1.1; (url) - -
	sanskritdictionary
		www.sanskritdictionary.com/	application/vnd.php.serialized	User-Agent: SanskritDictionary/0.1 (url) - -
	yunyun
		www.yunyun.com/spider.html	text/..	Mozilla/5.0 (compatible; YYSpider; url) zh-cn;q=0.8, *;q=0.5 -
		www.yunyun.com/SiteInfo.php?r=about	text/..	Mozilla/5.0 (compatible; YRSpider; url) zh-cn;q=0.8, *;q=0.5 -
		www.yunyun.com/SiteInfo.php?r=about	image/..	Mozilla/5.0 (compatible; YRSpider; url) zh-cn;q=0.8, *;q=0.5 -
		www.yunyun.com/spider.html	text/..	Mozilla/5.0 (compatible; YYSpider; url) - -
	wesee
		www.wesee.com/en/support/bot/	image/..	WeSEE:Search/0.1 (Alpha, url) - -
		www.wesee.com/en/support/bot/	text/..	WeSEE:Search/0.1 (Alpha, url) - -
		www.wesee.com/bot/	text/..	WeSEE:Search/0.1 (Alpha, url) - -
	yoursite
		yoursite.com/botinfo	text/..	Mozilla/5.0 (compatible; YourCoolBot/1.0; url) - -
	wikidict
		www.wikidict.de	text/..	url - -
	example
		alm.example.org	application/json	Article Level Metrics - url - -
		example.com/MyCoolToolPage/	application/json	MyCoolTool (url) - -
		alm.example.org	application/json	Article-Level Metrics - url - -
		example.com	application/json	Article-Level Metrics - url - -
	xbmc
		www.xbmc.org	image/..	XBMC/12.2 Git:20130502-32b1a5e (Windows NT 6.1;WOW64;Win64;x64; url) - -
		www.xbmc.org	image/..	XBMC/12.2 Git:20130502-32b1a5e (Windows NT 6.1; url) - -
	in
		www.m-culture.in.th	text/..	m-culture.in.th (url) - -
	sistrix
		crawler.sistrix.net/	text/..	Mozilla/5.0 (compatible; SISTRIX Crawler; url) - -
	websearchengine
		websearchengine.org	text/..	WSE/1.0 (url) en-us,en-gb,en;q=0.7,*;q=0.3 -
	speaktoit
		www.speaktoit.com	application/json	Speaktoit url - -
	saciol
		www.saciol.com/	text/..	User-Agent: Saciolbot/1.2 (url; mail address - -
	muso
		www.muso.com	text/..	Mozilla/5.0 (compatible; musobot/1.0; mail address ; url) - -
	leiki
		www.leiki.com	text/..	Leikibot/1.0 (url) - -
	copernicus
		metricus.copernicus.org	application/json	Article Level Metrics - url - -
	mytest
		www.mytest.com	text/..	Mozilla/5.0 (compatible; heritrix/3.1.2-SNAPSHOT-20131104-0244 url) - -
		www.mytest.com	image/..	Mozilla/5.0 (compatible; heritrix/3.1.2-SNAPSHOT-20131104-0244 url) - -
	tweetmeme
		tweetmeme.com/	text/..	Mozilla/5.0 (compatible; TweetmemeBot/3.0; url) en-gb,en;q=0.5 -
	weblio
		www.weblio.jp/info/crawler.jsp	image/..	Mozilla/5.0 (compatible; Webliobot/0.1; url) - -
		www.weblio.jp/info/crawler.jsp	text/..	Mozilla/5.0 (compatible; Webliobot/0.1; url) - -
		www.weblio.jp/	text/..	Mozilla/5.0 (compatible; WeblioBot; url) - -
		www.weblio.jp/	text/..	Mozilla/5.0 (compatible; WeblioBot; url) ja -
	grapeshot
		www.grapeshot.co.uk/crawler.php	text/..	Mozilla/5.0 (compatible; GrapeshotCrawler/2.0; url) - -
		www.grapeshot.co.uk/crawler.php	image/..	Mozilla/5.0 (compatible; GrapeshotCrawler/2.0; url) - -
	seoprofiler
		www.seoprofiler.com/bot	text/..	Mozilla/5.0 (compatible; spbot/4.0.4; url ) - -
	monitis
		www.monitis.com	text/..	Mozilla/5.0 (compatible; Monitis - premium monitoring service; url) - -
		www.monitis.com	text/..	Mozilla/5.0 (compatible; monitis - premium monitoring service; url) - -
		monitis.com	text/..	Mozilla/5.0 (compatible; monitis.com - free monitoring service; url) - -
	heyfeed
		www.heyfeed.com/info/bot.html	text/..	Mozilla/5.0 (compatible; HeyFeedBot/1.0 url) - -
		www.heyfeed.com/bot.html	text/..	Mozilla/5.0 (compatible; HeyFeedBot/1.0 url) - -
	holasoyramon
		www.holasoyramon.com/blog	text/..	WordPress/3.5.1; url - -
	psu
		citeseerx.ist.psu.edu	text/..	citeseerxbot (compatible; heritrix/1.14.4 url) - -
	apache
		lucene.apache.org/nutch/bot.html	text/..	NutchCVS/0.7.2 (Nutch; url; mail address ) - -
	gov
		linc.tas.gov.au	text/..	10.245.8.246 Mozilla/5.0 (compatible; heritrix/3.1.1-SNAPSHOT-20120320.221924 url) - -
		linc.tas.gov.au	text/..	10.245.8.245 Mozilla/5.0 (compatible; heritrix/3.1.1-SNAPSHOT-20120320.221924 url) - -
		linc.tas.gov.au	text/..	10.245.8.254 Mozilla/5.0 (compatible; heritrix/3.1.1-SNAPSHOT-20120320.221924 url) - -
		linc.tas.gov.au	text/..	10.245.8.249 Mozilla/5.0 (compatible; heritrix/3.1.1-SNAPSHOT-20120320.221924 url) - -
		linc.tas.gov.au	text/..	10.245.8.248 Mozilla/5.0 (compatible; heritrix/3.1.1-SNAPSHOT-20120320.221924 url) - -
	web
		www.web.nl/	text/..	web.nl spider/1.7; url - -
	embed
		support.embed.ly/	image/..	Mozilla/5.0 (compatible; Embedly/0.2; snap; url) - -
		support.embed.ly/	text/..	Mozilla/5.0 (compatible; Embedly/0.2; url) - -
	seokicks
		www.seokicks.de/robot.html	text/..	Mozilla/5.0 (compatible; SEOkicks-Robot; url) - -
	80legs
		www.80legs.com/webcrawler.html	text/..	Mozilla/5.0 (compatible; 008/0.85; url) Gecko/2008032620 - -
	FeedBurner
		www.FeedBurner.com	text/..	FeedBurner/1.0 (url) - -
	msai
		www.msai.in/uaprof/micromax/X455.xml	image/..	url en,hi -
		www.msai.in/uaprof/micromax/X455.xml	text/..	url en,hi -
		www.msai.in/uaprof/micromax/X455.xml	-	url en,hi -
		www.msai.in/uaprof/micromax/X1i_Extra.xml	image/..	url en,hi -
	nvdev
		qa.nvdev.com	text/..	Netvibes (url) - -
	site
		www.site.com/	application/json	Bot/2.0 (url) - -
		www.site.com/	application/json	Bot/2.0 (url) -
	rockpeaks
		www.rockpeaks.com/contact	text/..	RockPeaks/0.1 (url) - -
	paper
		support.paper.li/entries/20023257-what-is-paper-li	text/..	Mozilla/5.0 (compatible; PaperLiBot/2.1; url) en;q=0.8, * -
	github
		github.com/pauldix/feedzirra/tree/master	application/xml	feedzirra url - -
		github.com/pauldix/typhoeus/tree/master	text/..	Typhoeus - url - -
		github.com/pauldix/feedzirra/tree/master	text/..	feedzirra url - -
		github.com/sparklemotion/mechanize/	text/..	Mechanize/2.7.1 Ruby/2.0.0p247 (url) en-us,en;q=0.5 -
		wiki.github.com/bixo/bixo/bixocrawler	text/..	Mozilla/5.0 (compatible; pub-crawler; url; mail address ) en-us,en-gb,en;q=0.7,*;q=0.3 -
	Anonymouse
		Anonymouse.org/	text/..	url (Unix) - -
		Anonymouse.org/	image/..	url (Unix) - -
	moviecus
		www.moviecus.com/botcontactinfo.php	application/yaml	moviecus bot (url) - -
		www.moviecus.com/botcontactinfo.php	application/yaml	moviecus bot (url) -
	plagiarismcheck
		plagiarismcheck.org	application/json	WikiCrawl 1.0b (url contact-mail: mail address ) - -
	proximic
		www.proximic.com/info/spider.php	text/..	Mozilla/5.0 (compatible; proximic; url) - -
		www.proximic.com/info/spider.php	image/..	Mozilla/5.0 (compatible; proximic; url) - -
	hatena
		a.hatena.ne.jp/help	text/..	Hatena Antenna/0.5 (url) - -
	zeebox
		www.zeebox.com	text/..	Zeebox (url) en-us,en;q=0.5 -
		www.zeebox.com	application/json	Zeebox (url) en-us,en;q=0.5 -
	okian
		www.okian.ro/	text/..	MyBot/1.0 (url) - -
	trendiction
		www.trendiction.de/bot	text/..	Mozilla/5.0 (Windows; Windows NT 6.0; en-GB; rv:1.0; trendictionbot0.5.0; trendiction search; url; please let us know of any problems; web at trendiction.com) Gecko/20071127 Firefox/3.0.0.11 en-gb,en;q=0.5 -
		www.trendiction.de/bot	image/..	Mozilla/5.0 (Windows; Windows NT 6.0; en-GB; rv:1.0; trendictionbot0.5.0; trendiction search; url; please let us know of any problems; web at trendiction.com) Gecko/20071127 Firefox/3.0.0.11 en-gb,en;q=0.5 -
	turnitin
		www.turnitin.com/robot/crawlerinfo.html	text/..	TurnitinBot/2.1 (url) - -
	gulliway
		gulliway.org	text/..	Mozzila/5.0 (Windows NT 5.1; GulliwayBot/01 url) - -
		gulliway.org	application/xml	Mozzila/5.0 (Windows NT 5.1; GulliwayBot/01 url) - -
	topsy
		labs.topsy.com/butterfly/	text/..	Mozilla/5.0 (compatible; Butterfly/1.0; url) Gecko/2009032608 Firefox/3.0.8 - -
		labs.topsy.com/butterfly/	text/..	Mozilla/5.0 (Macintosh; Butterfly/1.0; url) Gecko/2009032608 Firefox/3.0.8 - -
	voedselkollektief
		voedselkollektief.nl/site2	text/..	WordPress/3.7.1; url - -
		voedselkollektief.nl/site2	text/..	WordPress/3.8; url - -
	bsurprised
		bsurprised.com/	text/..	BSurprised WikiBox 0.1.3 (url) it -
		bsurprised.com/	text/..	BSurprised WikiBox 0.1.3 (url) en -
		bsurprised.com/	text/..	BSurprised WikiBox 0.1.3 (url) hu -
	netvibes
		www.netvibes.com	text/..	Netvibes (url) - -
		www.netvibes.com	application/json	Netvibes (url) en-us -
		www.netvibes.com	application/json	Netvibes (url) de-de -
		www.netvibes.com	application/json	Netvibes (url) fr-fr -
	alexa
		www.alexa.com/site/help/webmasters	text/..	ia_archiver (url; mail address ) - -
	spinn3r
		spinn3r.com/robot	text/..	Mozilla/5.0 (X11; Linux x86_64; en-US; rv:1.9.0.19; aggregator:Spinn3r (Spinn3r 3.1); url) Gecko/2010040121 Firefox/3.0.19 - -
		spinn3r.com/robot	application/xml	Mozilla/5.0 (X11; Linux x86_64; en-US; rv:1.9.0.19; aggregator:Spinn3r (Spinn3r 3.1); url) Gecko/2010040121 Firefox/3.0.19 - -
	com?type=714647&fr=spigot-yhp-ch
		es.search.yahoo.com?type=714647&fr=spigot-yhp-ch	image/..	Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 KHTML Chrome/31.0.1650.63 Safari/537.36 es-ES,es;q=0.8,en;q=0.6,homepage;q=0.4,homepage_is_newtabpage;q=0.2,url;q=0.2,session;q=0.2 -
	creativecommons
		wiki.creativecommons.org/Metadata_Scraper	text/..	CC Metadata Scaper url - -
	linkdex
		www.linkdex.com/about/bots/	text/..	Mozilla/5.0 (compatible; linkdexbot/2.0; url) - -
	searchtechnologies
		www.searchtechnologies.com	text/..	Mozilla/5.0 (compatible; heritrix/1.14.3 url) - -
	qbqm
		www.qbqm.fr/	text/..	QBQM/1.0 (url) fr -
	archive-it
		archive-it.org/files/site-owners.html	image/..	Mozilla/5.0 (compatible; archive.org_bot; Archive-It; url) * -
		archive-it.org/files/site-owners.html	text/..	Mozilla/5.0 (compatible; archive.org_bot; Archive-It; url) * -
	vk
		vk.com/dev/Share	text/..	Mozilla/5.0 (compatible; vkShare; url) - -
		vk.com/dev/Share	text/..	Mozilla/5.0 (compatible; vkShare; url) -
		vk.com/dev/Share	image/..	Mozilla/5.0 (compatible; vkShare; url) -
	a6corp
		www.a6corp.com/a6-web-scraping-policy/	text/..	A6-Indexer/1.0 (url) - -
	picsearch
		www.picsearch.com/bot.html	text/..	psbot/0.1 (url) - -
		www.picsearch.com/bot.html	image/..	psbot/0.1 (url) - -
	easybib
		content.easybib.com/autocite/	text/..	EasyBib AutoCite (url) - -
		content.easybib.com/autocite/	application/json	EasyBib AutoCite (url) - -
	loopj
		loopj.com/android-async-http	image/..	android-async-http/1.4.1 (url) - -
		loopj.com/android-async-http	text/..	android-async-http/1.4.1 (url) - -
	gravity
		www.gravity.com/	text/..	Mozilla/5.0 (compatible; Gravitybot/1.0; url) - -
		www.gravity.com/	image/..	Mozilla/5.0 (compatible; Gravitybot/1.0; url) - -
	netnewswireapp
		netnewswireapp.com/mac/	application/xml	NetNewsWire/4.0.0 (Mac OS X; url; gzip-happy) en-us -
	textdigger
		textdigger.com	text/..	Mozilla/5.0 (url) Gecko/20061208 Firefox/2.0.0.1 en-us,en;q=0.5 -
	superfeedr
		superfeedr.com	text/..	Superfeedr bot/2.0 url - Make your feeds realtime: get in touch! - -
		superfeedr.com	application/xml	Superfeedr bot/2.0 url - Make your feeds realtime: get in touch! - -
	ac
		www.ninjal.ac.jp/corpus_center/ulc/crawl-en	text/..	Mozilla/5.0 (compatible; heritrix/3.1.1 url) - -
		www.clips.ua.ac.be/pattern	application/json	Pattern/2.6 url - -
		webarchiv.onb.ac.at	text/..	Mozilla/5.0 (compatible; htrix/1.14.4 url) - -
	bnf
		www.bnf.fr/fr/outils/a.dl_web_capture_robot.html	image/..	Mozilla/5.0 (compatible; bnf.fr_bot; url) fr, en; q=0.3 -
		www.bnf.fr/fr/outils/a.dl_web_capture_robot.html	text/..	Mozilla/5.0 (compatible; bnf.fr_bot; url) fr, en; q=0.3 -
	bl
		www.bl.uk/aboutus/legaldeposit/websites/websites/faqswebmaster/index.html	text/..	bl.uk_lddc_bot/3.1.1 (url) - -
		www.bl.uk/aboutus/legaldeposit/websites/websites/faqswebmaster/index.html	image/..	bl.uk_lddc_bot/3.1.1 (url) - -
	sentymetr
		sentymetr.pl/bot.html	text/..	Mozilla/5.0 (compatible; SentymetrBot 1.0; url) - -
		sentymetr.pl/bot.html	application/json	Mozilla/5.0 (compatible; SentymetrBot 1.0; url) - -
	diffbot
		www.diffbot.com	text/..	Mozilla/5.0 (Windows; Windows NT 5.1; en-US; rv:1.9.1.2) Gecko/20090729 Firefox/3.5.2 (Diffbot/0.1; url) en-us,en;q=0.5 -
		www.diffbot.com	text/..	Mozilla/5.0 (Windows NT 6.2; WOW64) AppleWebKit/537.36 KHTML Chrome/29.0.1547.66 Safari/537.36 crawlbot/1.0 (url) - -
	simplepie
	fotopedia
		www.fotopedia.com	application/json	Picor (url) - -
	backgroundswitcher
		www.backgroundswitcher.com/	image/..	John's Background Switcher 4.7 (url) - -
		www.backgroundswitcher.com/	text/..	John's Background Switcher 4.4 (url) - -
		www.backgroundswitcher.com/	image/..	John's Background Switcher 4.4 (url) - -
	automoveisnaweb
		automoveisnaweb.com.br/uk4	text/..	WordPress/3.6.1; url - -
		automoveisnaweb.com.br/uk1	text/..	WordPress/3.7.1; url - -
		automoveisnaweb.com.br/uk3	text/..	WordPress/3.7.1; url - -
		automoveisnaweb.com.br/uk2	text/..	WordPress/3.5.2; url - -
	edu
		ws.nju.edu.cn/falcons/	text/..	Mozilla/5.0 (compatible; Falconsbot; url) - -
		wing.comp.nus.edu.sg/~tanyeefa/downloads/searchenginewrapper/	application/json	Search Engine Wrapper (url) - -
	thinglink
		www.thinglink.com/	application/json	Mozilla/5.0 (compatible; Thinglink/1.0; url, mail address ) - -
	image2play
		image2play.com/	image/..	Mozilla/5.0 (compatible; Image2play/0.1; url) - -
	bibalex
		archive.bibalex.org/bot/	text/..	Mozilla/5.0 (compatible; archive.bibalex.org_bot; url) - -
		archive.bibalex.org/bot/	image/..	Mozilla/5.0 (compatible; archive.bibalex.org_bot; url) - -
	yougorhymes
		www.yougorhymes.com/site/rhyme-bot	text/..	RhymeBot/0.3 (url) - -
		www.yougorhymes.com/site/rhyme-bot	text/..	RhymeBot/0.3 (url) -
	go
		kc.nict.go.jp/project1/crawl.html	text/..	ICC-Crawler/2.0 (Mozilla-compatible; ; url) ja -
	siteexplorer
		siteexplorer.info/	text/..	Mozilla/5.0 (compatible; SiteExplorer/1.0b; url) - -
	ourherstory
		ourherstory.net	text/..	WordPress/3.8-RC1; url - -
		ourherstory.net	text/..	WordPress/3.9-alpha; url - -
	store4us
		garden.store4us.com	text/..	WordPress/3.8; url - -
	watchmouse
	js-kit
		js-kit.com/	text/..	JS-Kit URL Resolver, url - -
	wotbox
		www.wotbox.com/bot/	text/..	Wotbox/2.01 (url) - -
	gg
		gg.pl/	text/..	GG PeekBot 2.0 ( url http://info.gadu-gadu.pl/praca ) - -
		gg.pl/	image/..	GG PeekBot 2.0 ( url http://info.gadu-gadu.pl/praca ) - -
	jetsli
		jetsli.de/crawler	text/..	Mozilla/5.0 (compatible; Jetslide; url) en-us -
	wikimedia
		meta.wikimedia.org/wiki/User:Tietew	text/..	Cheebot/0.5.7 (url) - -
	fueto
		fueto.com	application/json	Fueto (url) - -
	pingdom
		www.pingdom.com/	text/..	Pingdom.com_bot_version_1.4_(url) - -
		www.pingdom.com	text/..	Pingdom.com_bot_version_1.4_(url) - -
	tt-rss
		tt-rss.org/	application/xml	Tiny Tiny RSS/1.10 (url) - -
	federatedmedia
		federatedmedia.net	text/..	Mozilla/5.0 (url) Gecko/20061208 Firefox/2.0.0.1 en-us,en;q=0.5 -
	zite
		zite.com	text/..	Mozilla/5.0 (compatible; woriobot mail address url) - -
145079.129999983	total

Page requests for probable crawlers, recognized by keyword
Count x 1000	Agent string
		Mime type (count ≥ 3)
	Peachy MediaWiki Bot API Version 2.0 (alpha 6) - -
		application/vnd.php.serialized
		text/..
	GoogleBot-Image/1.0 - -
		text/..
		image/..
		-
		application/pdf
		audio/webm
		application/ogg
	MediaWikiCrawler-Google/2.0 ( mail address ) - -
		text/..
	php wikibot classes - -
		application/vnd.php.serialized
		text/..
		application/json
	LinkParser/2.0 - -
		text/..
	DotNetWikiBot/2.101 (Microsoft Windows NT 6.1.7601 Service Pack 1; ) - -
		text/..
		application/xml
	ClueBot/1.1 - -
		application/vnd.php.serialized
	pywikipedia-rad1.py/r10269 Pywikipediabot/1.0 - -
		application/json
		application/xml
	tigerbot - -
		application/json
		text/..
		image/..
		application/ogg
		application/xml
	CCBot/2.0 en-us,en-gb,en;q=0.7,*;q=0.3 -
		text/..
		image/..
		audio/webm
		video/webm
	gsa-crawler (Enterprise; T4-KAWM9JCULZJS9; mail address , mail address ) - -
		text/..
	wikiwix-bot-3.0 - -
		text/..
	GoogleBot-Image/1.0 - -
		text/..
		image/..
	PythonWikipediaBot/1.0 - -
		application/json
		text/..
		application/xml
	pywikipedia-rad1.py/r10582 Pywikipediabot/1.0 - -
		application/json
		application/xml
		application/pdf
	maj_articles_recents/r2311 Pywikipediabot/2.0 - -
		application/json
	Mozilla/5.0 (Windows; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 ( mail address ) fr; q=1.0, en; q=0.5, *; q=0.1 -
		text/..
	Mozilla/5.0 (Windows; Windows NT 5.1; zh-CN; ) Firefox/1.5.0.11; 360Spider zh-CN -
		text/..
		image/..
		application/xml
	YisouSpider zh-cn,en-us,zh-tw,en-gb,en; -
		text/..
		image/..
		application/ogg
	Mozilla/5.0 (compatible; SputnikBot/2.2) ru,en;q=0.1,*;q=0.01 -
		text/..
	pywikipedia-redirect.py/r11168 Pywikipediabot/1.0 - -
		application/json
		text/..
	ClueBot/2.0 - -
		application/vnd.php.serialized
	BOT/0.1 (BOT for JCE) - -
		text/..
	DotNetWikiBot/2.101 (Microsoft Windows NT 6.2.9200.0; ) - -
		text/..
	MediaWiki::Bot/5.005006 - -
		application/json
	My Nutch Spider/Nutch-1.7 en-us,en-gb,en;q=0.7,*;q=0.3 -
		text/..
		image/..
		application/ogg
		audio/midi
	pywikipedia-rad1.py/r10694 Pywikipediabot/1.0 - -
		application/json
		application/xml
	maj_articles_recents/r2501 Pywikipediabot/2.0 - -
		application/json
		text/..
	freebasemappingupload/r2403 Pywikipediabot/2.0 - -
		application/json
	MediaWiki::Bot/3.2.6 - -
		application/json
		text/..
	Semantix Bot 0.1 - -
		text/..
	DotNetWikiBot/2.99 (Microsoft Windows NT 6.1.7601 Service Pack 1; ) - -
		text/..
		application/xml
	WikiTrans.net Bot (User:WikiTransBot; Contact: mail address ) - -
		text/..
		application/json
	DigitalsmithsBot - -
		text/..
	Addbot Wikimedia Bot - -
		text/..
	maj_articles_recents/r2523 Pywikipediabot/2.0 - -
		application/json
	360spider-image - -
		image/..
		text/..
	qic2/r2522 Pywikipediabot/2.0 - -
		application/json
	WorldOfMusicBetaBot/1.0 - -
		text/..
	maj_articles_recents/r2459 Pywikipediabot/2.0 - -
		application/json
	pywikipedia-featured.py/r-1 (unknown) Pywikipediabot/1.0 - -
		application/json
		application/xml
	maj_articles_recents/r2468 Pywikipediabot/2.0 - -
		application/json
	AnomieBOT 1.0 (TagDater; see [[User:AnomieBOT]]) - -
		application/json
	pywikibot-compat-interwiki.py/r10250 Pywikipediabot/1.0 - -
		application/xml
		application/json
	pyiw-redirectns0.py/r11641 Pywikipediabot/1.0 - -
		application/json
	pywikipedia-redirect.py/r10311 Pywikipediabot/1.0 - -
		application/json
	pywikipedia-welcome.py/r11533 Pywikipediabot/1.0 - -
		application/json
	Twitterbot/1.0 - -
		text/..
		image/..
		application/pdf
		application/json
		audio/webm
		application/ogg
	CorenSearchBot/1.7 en libwww-perl/6.04 - -
		text/..
	milog_bot/1.0 ( mail address ) - -
		text/..
	hivaBot/hivaBot-0.2 en-us,en-gb,en;q=0.7,*;q=0.3 -
		text/..
		application/ogg
		image/..
	pwb/r-1 (unknown) Pywikipediabot/2.0 - -
		application/json
	welcome-welcome-w-bn-core.py/r11692 Pywikipediabot/1.0 - -
		application/json
	fa-welcome.py/r11054 Pywikipediabot/1.0 -
		application/json
	DotNetWikiBot/2.100 (Unix 3.2.0.54; ) - -
		text/..
		application/xml
	compat-featured.py/r10417 Pywikipediabot/1.0 - -
		application/json
		application/xml
	"Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534 KHTML MsnBot-Media /1.0b" en-US -
		image/..
		text/..
	welcome-welcome-w-bn-core.py/r11692 Pywikipediabot/1.0 -
		application/json
	DotNetWikiBot/2.102 (Microsoft Windows NT 6.1.7601 Service Pack 1; ) - -
		text/..
		application/xml
	AniBot/0.9 php/curl - -
		application/vnd.php.serialized
	MediaWiki::Bot/3.005002 - -
		application/json
	svnpywikipedia-interwiki.py/r11270 Pywikipediabot/1.0 - -
		text/..
		application/json
	PythonWikipediaBot/1.0 -
		application/json
		text/..
		application/xml
	unknown Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (Exabot-Thumbnails) en,*
		image/..
		text/..
		application/json
	pywikipedia-git-wdph661.py/r90 Pywikipediabot/1.0 - -
		application/json
	pywikipedia2-redirect.py/r11775 Pywikipediabot/1.0 - -
		application/json
	WikidataBot framework - -
		application/json
	pywikipedia-redirect.py/r11775 Pywikipediabot/1.0 - -
		application/json
	python-wikitools/1.2 (User:Irclogbot) - -
		application/json
	compat-checkimages.py/r-1 (unknown) Pywikipediabot/1.0 - -
		application/json
	spider - -
		text/..
		application/json
		application/vnd.php.serialized
		image/..
	bot-newar.py/r10578 Pywikipediabot/1.0 - -
		application/json
		application/xml
	wikiparser/1 CFNetwork/673.0.3 Darwin/13.0.0 (x86_64) (MacPro5,1) en-us -
		image/..
		text/..
	GermCrawler - -
		application/json
		text/..
	new2-zzdi1.py/r10269 Pywikipediabot/1.0 - -
		application/json
		application/xml
		application/pdf
	pywikipedia-dave_sezioni.py/r-1 (unknown) Pywikipediabot/1.0 - -
		application/json
		application/xml
	mail address mail address – MediaWiki Tcl Bot Framework 0.5 - -
		application/json
	mijnbots-RedirDiakriet.py/r-1 (unknown) Pywikipediabot/1.0 - -
		application/json
		application/xml
	BeneBot*/1.0 WikibasePhpLib/0.1 - -
		application/json
	Webbot - -
		text/..
	bot-nullref.py/r11330 (wikipedia.py) Pywikipediabot/1.0 - -
		application/json
	calpoly wikibot - -
		application/json
		text/..
	Mozilla/5.0 (compatible; Nigma.ru/3.0; mail address ) - -
		text/..
	Mozilla/5.0 (Macintosh; Intel Mac OS X 10_8_2) AppleWebKit/537.13 KHTML Chrome/24.0.1290.2 Safari/537.13 Lumibot/2.0 en-US,en;q=0.8 -
		image/..
		text/..
		application/json
	pywikipedia3-MakeScoreTable_test3.py/r11448 Pywikipediabot/1.0 - -
		application/json
	bot-newar.py/r10540 Pywikipediabot/1.0 - -
		application/json
		application/xml
	iw2data/r-1 (unknown) Pywikipediabot/2.0 - -
		application/json
	wiktionary-z_paginasrequeridas.py/r10529 Pywikipediabot/1.0 - -
		application/json
	German Wikipedia Dead Weblinks Checker Bot; contact: mail address - -
		text/..
	pywikipedia-dobrodoslice.py/r11775 Pywikipediabot/1.0 - -
		application/json
	DotNetWikiBot/2.102 (Microsoft Windows NT 6.2.9200.0; ) - -
		text/..
		application/xml
	Peachy MediaWiki Bot API Version 1.0 - -
		application/vnd.php.serialized
	pywikipedia-rad1.py/r10560 Pywikipediabot/1.0 - -
		application/json
		application/xml
	pyreza-mianwi.py/r11775 Pywikipediabot/1.0 - -
		application/json
		application/xml
		text/..
	Bot-interwiki.py/r10581 Pywikipediabot/1.0 - -
		application/json
		application/xml
	bot-newar.py/r10716 Pywikipediabot/1.0 - -
		application/json
		application/xml
	Mozilla/5.0 (compatible; UnisterBot; mail address ) de-DE;q=0.9,de;q=0.8,en;q=0.7,* -
		text/..
	dikantenyvaovao/r-1 (unknown) Pywikipediabot/2.0 - -
		application/json
	SineBot/1.5.19(User:SineBot) - -
		application/vnd.php.serialized
		text/..
	Wikibot/2.1.1 CFNetwork/672.0.8 Darwin/14.0.0 en-us -
		image/..
		text/..
	compat-welcome-custom.py/r10249 Pywikipediabot/1.0 - -
		application/json
	bot-newar.py/r10589 Pywikipediabot/1.0 - -
		application/json
		application/xml
	pywikipedia-dave_sezioni_test1.py/r10718 Pywikipediabot/1.0 - -
		application/json
		application/xml
	pywikipedia-git-wdph57.py/r90 Pywikipediabot/1.0 - -
		application/json
	qic2/r2549 Pywikipediabot/2.0 - -
		application/json
	Webwiki Search Engine Bot - www.webwiki.de - -
		text/..
	pywikipedia-dobrodoslice.py/r11775 Pywikipediabot/1.0 -
		application/json
	pywikipedia-radeh.py/r10582 Pywikipediabot/1.0 - -
		application/json
		application/xml
	wikidata-sitelinks.py/r11618 Pywikipediabot/1.0 - -
		application/json
	pywikibot-compat-reportCatLoops.py/r10494 Pywikipediabot/1.0 - -
		application/json
	pywikipedia-17-progreso1911.py/r10311 Pywikipediabot/1.0 - -
		application/json
		application/xml
	MyCuteBot/0.1 - -
		text/..
		application/json
		application/vnd.php.serialized
	pywikipedia-welcome.py/r11252 Pywikipediabot/1.0 - -
		application/json
	pywikipedia-git-featured.py/r90 Pywikipediabot/1.0 - -
		application/json
	SentiBot mail address (compatible with GoogleBot) - -
		text/..
		application/xml
	Python27-pythonw.exe/r-1 (unknown) Pywikipediabot/1.0 - -
		application/json
		application/xml
	maj_articles_recents/r2493 Pywikipediabot/2.0 - -
		application/json
	Mozilla/5.0 (Windows; Windows NT 5.1; zh-CN; rv:1.8.0.11) Firefox/1.5.0.11 360Spider; zh-CN -
		text/..
		image/..
		application/ogg
	AnomieBOT 1.0 (FlagIconRemover; see [[User:AnomieBOT]]) - -
		application/json
	pywiki-cfd.py/r10360 Pywikipediabot/1.0 - -
		application/json
	pyreza-mianwi.py/r11775 Pywikipediabot/1.0 -
		application/json
		application/xml
		text/..
	pywikipedia-zzredirectyeh.py/r10269 Pywikipediabot/1.0 - -
		application/json
		application/xml
	MediaWiki::Bot/3.1.6 (User:SporkBot) - -
		application/json
	dikantenyvaovao_beta/r-1 (unknown) Pywikipediabot/2.0 - -
		application/json
	pwb-reportCatLoops.py/r-1 (unknown) Pywikipediabot/1.0 - -
		application/json
		text/..
	DotNetWikiBot/2.100 (Unix 5.10.0.0; ) - -
		text/..
		application/xml
	AnomieBOT 1.0 (OrphanReferenceFixer; see [[User:AnomieBOT]]) - -
		application/json
	bot-newar.py/r10694 Pywikipediabot/1.0 - -
		application/json
	cwikt-interwiki.py/r10585 Pywikipediabot/1.0 - -
		application/json
		application/xml
	AnomieBOT 1.0 (PERTableUpdater; see [[User:AnomieBOT]]) - -
		application/json
		text/..
	pywikipedia-git-importwdcat.py/r90 Pywikipediabot/1.0 - -
		application/json
	maj_articles_recents/r2488 Pywikipediabot/2.0 - -
		application/json
	pywikipedia-git-wdlabel.py/r90 Pywikipediabot/1.0 - -
		application/json
	web-crawler en-US,en;q=0.8 -
		text/..
	python-wikitools/1.2 (User:Mr.Z-bot) -
		application/json
	redirect/r2522 Pywikipediabot/2.0 - -
		application/json
	python-wikitools/1.2 (User:Mr.Z-bot) - -
		application/json
	compat-basictemplatedisamblist.py/r10590 Pywikipediabot/1.0 - -
		application/json
	pwb/r2510 Pywikipediabot/2.0 - -
		application/json
	fa-welcome.py/r11054 Pywikipediabot/1.0 - -
		application/json
	Lynx Spider/Nutch-1.7 en-us,en-gb,en;q=0.7,*;q=0.3 -
		text/..
		application/ogg
	redirect/r2523 Pywikipediabot/2.0 - -
		application/json
	www.monit24.pl-m24Bot/4.1- - -
		image/..
		text/..
	g13bot_tools-g13_nudge_bot.py/r-1 (unknown) Pywikipediabot/1.0 - -
		application/json
	pywikipedia-interwiki.py/r-1 (unknown) Pywikipediabot/1.0 - -
		application/json
		application/xml
	AnomieBOT 1.0 (TemplateSubster; see [[User:AnomieBOT]]) - -
		application/json
	PHPCrawl - -
		text/..
		image/..
		application/xml
	redirect/r2461 Pywikipediabot/2.0 - -
		application/json
	hardingbot - -
		text/..
	pywikipedia3-MakeScoreTable_10000.py/r11448 Pywikipediabot/1.0 - -
		application/json
	bot-newar.py/r10655 Pywikipediabot/1.0 - -
		application/json
	Crawler/1.2 - -
		text/..
	redirect/r2554 Pywikipediabot/2.0 - -
		application/json
	Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (Exabot-Thumbnails) en,*
		image/..
		text/..
	commons_galleries_same_name/r2506 Pywikipediabot/2.0 - -
		application/json
	pywikipedia-amb_mehrdadbot.py/r11775 Pywikipediabot/1.0 - -
		application/json
	ko_missing/r-1 (unknown) Pywikipediabot/2.0 - -
		application/json
	Mozilla/5.0 (compatible; Ezooms/1.0; mail address ) - -
		text/..
		application/json
		image/..
	pywikipedia-git-wdph73.py/r90 Pywikipediabot/1.0 - -
		application/json
	compat-commonscat.py/r10560 Pywikipediabot/1.0 - -
		application/json
		application/xml
	pywikipedia-radeh.py/r10694 Pywikipediabot/1.0 - -
		application/json
	logpatrol/r-1 (unknown) Pywikipediabot/2.0 - -
		application/json
	bot-pluralof.py/r11330 (wikipedia.py) Pywikipediabot/1.0 - -
		application/json
	Screaming Frog SEO Spider/2.22 - -
		text/..
		image/..
	bot-newar.py/r10610 Pywikipediabot/1.0 - -
		application/json
		application/xml
	Goalkeeperbot(User:Beetstra)/1.0 - -
		text/..
	bot-newar.py/r10617 Pywikipediabot/1.0 - -
		application/json
		application/xml
	User:WP 1.0 bot (operated by User:Theopolisme on enwiki) - -
		text/..
	Mozilla/5.0 (compatible; MyBot/1.0;) - -
		application/json
	pywikibot-compat-aaa_elenco.py/r10250 Pywikipediabot/1.0 - -
		application/json
	compat-featured.py/r10444 Pywikipediabot/1.0 - -
		application/json
		application/xml
	wAPI/1.1 (Bot: Cyberbot I Operator: Cyberpower678) - -
		application/vnd.php.serialized
	DanmicholoBot - -
		application/json
	ContextAd Bot 1.0 - -
		text/..
		image/..
	wikidata-coords_ghel.py/r10301 Pywikipediabot/1.0 - -
		application/json
	BotReversor-BotReversor.py/r11775 Pywikipediabot/1.0 -
		application/json
	SiocWikiBot/1.0 - -
		application/vnd.php.serialized
		text/..
	wikidata-sitelinks.py/r11176 Pywikipediabot/1.0 - -
		application/json
	redirect/r-1 (unknown) Pywikipediabot/2.0 - -
		application/json
	compat-commonscat.py/r10550 Pywikipediabot/1.0 - -
		application/json
		application/xml
	Mozilla/5.0 (Unknown; Linux x86_64) AppleWebKit/534.34 KHTML PhantomJS/1.9.0 Safari/534.34 CasperJS/1.0.2 ve-dirtydiffbot en,* -
		image/..
		text/..
		application/json
	HTMLParser/2.0 - -
		text/..
		image/..
	Mozilla/5.0 (Windows; Windows NT 5.1; zh-CN; ) Firefox/1.5.0.11; 360Spider - -
		text/..
		application/xml
		application/json
	ko_missing2/r-1 (unknown) Pywikipediabot/2.0 - -
		application/json
	compat-featured.py/r10441 Pywikipediabot/1.0 - -
		application/json
		application/xml
	DotNetWikiBot/2.101 (Unix 3.1.9.0; ) - -
		text/..
		application/xml
	cwikt-interwiki.py/r10708 Pywikipediabot/1.0 - -
		application/json
		application/xml
	run/r-1 (unknown) Pywikipediabot/2.0 - -
		application/json
	redirect/r2503 Pywikipediabot/2.0 - -
		application/json
	BotReversor-BotReversor.py/r11775 Pywikipediabot/1.0 - -
		application/json
	redirect/r2458 Pywikipediabot/2.0 - -
		application/json
	pywikirish-welcome.py/r11215 Pywikipediabot/1.0 - -
		application/json
	SurakWare MediaWiki Bot/1.0 - -
		text/..
		application/xml
	compat-commonscat.py/r10581 Pywikipediabot/1.0 - -
		application/json
		application/xml
	createHierarchy/r2067 Pywikipediabot/2.0 - -
		application/json
	Mozilla/4.0 (compatible; MT search portal spider/3.0; mail address )" - -
		application/xml
		text/..
	pywikibot-compat-commonscat.py/r10617 Pywikipediabot/1.0 - -
		application/json
	pywikipedia-zz_make_cat.py/r10569 Pywikipediabot/1.0 - -
		application/json
	pywikipedia-zztakhasosi.py/r10269 Pywikipediabot/1.0 - -
		application/json
	pywikibot-compat-aaa_categorieAutori.py/r10250 Pywikipediabot/1.0 - -
		application/json
	pyiw-redirectns1.py/r11641 Pywikipediabot/1.0 - -
		application/json
	redirect/r2485 Pywikipediabot/2.0 - -
		application/json
	pywikipedia-zzinter.py/r10582 Pywikipediabot/1.0 - -
		application/json
		application/xml
	Peachy MediaWiki Bot API Version 1.0 -
		application/vnd.php.serialized
	ac_redirectfromfile2/r-1 (unknown) Pywikipediabot/2.0 - -
		application/json
	commons_categories_same_name/r2506 Pywikipediabot/2.0 - -
		application/json
	redirect/r2480 Pywikipediabot/2.0 - -
		application/json
	redirect/r2510 Pywikipediabot/2.0 - -
		application/json
	DotNetWikiBot/2.103 (Microsoft Windows NT 6.1.7601 Service Pack 1; ) - -
		text/..
		application/xml
	Mozilla/5.0 (Windows; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 ( mail address ) - -
		text/..
		application/json
	pywikipedia-wikifyer.py/r10582 Pywikipediabot/1.0 - -
		application/json
		application/xml
	pywikirish-welcome.py/r11215 Pywikipediabot/1.0 -
		application/json
	php wikibot classes -
		application/vnd.php.serialized
		text/..
	redirect/r2549 Pywikipediabot/2.0 - -
		application/json
	py-new_iw6.py/r-1 (unknown) Pywikipediabot/1.0 - -
		application/json
		application/xml
	BotMapBeta/2.7.0.1330 CFNetwork/672.0.8 Darwin/13.0.0 de-de -
		image/..
		text/..
		application/rsd+xml
		application/opensearchdescription+xml
	porzucone/r2488 Pywikipediabot/2.0 - -
		application/json
	HosiryuhosiBot IRC-RecentChanges Checker ja -
		text/..
	Inlibris.com XMLBot/1.0 - -
		text/..
	redirect/r2460 Pywikipediabot/2.0 - -
		application/json
	redirect/r2459 Pywikipediabot/2.0 - -
		application/json
	voverb/r-1 (unknown) Pywikipediabot/2.0 - -
		application/json
	AdMedia bot - -
		text/..
	redirect/r2488 Pywikipediabot/2.0 - -
		application/json
	HTMLParser/1.6 - -
		text/..
	Projet Sport-Projetsportliste2.py/r-1 (unknown) Pywikipediabot/1.0 - -
		application/json
	pywikibot-compat-commonscat.py/r10723 Pywikipediabot/1.0 - -
		application/json
	cc_to_sitelinks/r2506 Pywikipediabot/2.0 - -
		application/json
	compat-fromwdcat.py/r10334 Pywikipediabot/1.0 - -
		application/json
	User-Agent Baiduspider - -
		text/..
		image/..
	AnomieBOT 1.0 (BAGBot; see [[User:AnomieBOT]]) - -
		application/json
		text/..
	pywikibot-compat-commonscat.py/r10582 Pywikipediabot/1.0 - -
		application/json
		application/xml
	compat-commonscat.py/r10567 Pywikipediabot/1.0 - -
		application/json
		application/xml
	pywikibot-compat-reportUsers.py/r10494 Pywikipediabot/1.0 - -
		application/json
	ko_labelcheck/r-1 (unknown) Pywikipediabot/2.0 - -
		application/json
	addDescQuery/r-1 (unknown) Pywikipediabot/2.0 - -
		application/json
	redirect/r2451 Pywikipediabot/2.0 - -
		application/json
	pywikipedia-zzredirectyeh.py/r10560 Pywikipediabot/1.0 - -
		application/json
		application/xml
	37.58.85.180 GoogleBot-Image/1.0 - -
		text/..
	XLinkBot/1.00 - -
		text/..
	compat-featured.py/r10695 Pywikipediabot/1.0 - -
		application/json
	pywikipedia-radeh.py/r10569 Pywikipediabot/1.0 - -
		application/json
	replace/r-1 (unknown) Pywikipediabot/2.0 - -
		application/json
	redirect/r2539 Pywikipediabot/2.0 - -
		application/json
	pywikipedia-com_wrong_auth_rep_u.py/r10458 Pywikipediabot/1.0 - -
		application/json
	porzucone/r2522 Pywikipediabot/2.0 - -
		application/json
	porzucone/r2458 Pywikipediabot/2.0 - -
		application/json
	porzucone/r2461 Pywikipediabot/2.0 - -
		application/json
	redirect/r2528 Pywikipediabot/2.0 - -
		application/json
	svn-compat-replace.py/r-1 (unknown) Pywikipediabot/1.0 - -
		application/json
		application/xml
	gsa-crawler (Enterprise; T4-LXAU82GD3A262; mail address ) - -
		text/..
	pywikipedia-wikifyer.py/r10694 Pywikipediabot/1.0 - -
		application/json
	compat-commonscat.py/r10571 Pywikipediabot/1.0 - -
		application/json
		application/xml
	mrajedrez-category_redirect.py/r11321 Pywikipediabot/1.0 - -
		text/..
		application/json
	pywikipedia-wikifyer.py/r10461 Pywikipediabot/1.0 - -
		application/json
	bot-newar.py/r10727 Pywikipediabot/1.0 - -
		application/json
	porzucone/r-1 (unknown) Pywikipediabot/2.0 - -
		application/json
	compat-commonscat.py/r10570 Pywikipediabot/1.0 - -
		application/json
	redirect/r2513 Pywikipediabot/2.0 - -
		application/json
	compat-commonscat.py/r10578 Pywikipediabot/1.0 - -
		application/json
		application/xml
	hatnote_fix/r2459 Pywikipediabot/2.0 - -
		application/json
	Warrior Search-Stat robot - Building trusted news provider index - -
		application/json
	UKBot [[:no:Bruker:UKBot]] MwClient/0.6.6 - -
		application/json
	3372875/r11657 Pywikipediabot/2.0 -
		application/json
	pywikipedia-fr.wikt.RemiseEnForme.py/r68 Pywikipediabot/1.0 - -
		application/json
	svn-compat-commonscat.py/r-1 (unknown) Pywikipediabot/1.0 - -
		application/json
	pywikibot-compat-commonscat.py/r10567 Pywikipediabot/1.0 - -
		application/json
	pwb/r2471 Pywikipediabot/2.0 - -
		application/json
	WPBot 1.0 - -
		text/..
	add_category/r2219 Pywikipediabot/2.0 - -
		application/json
	pywikipedia-zzhayati.py/r10269 Pywikipediabot/1.0 - -
		application/json
	Empedia Bot - -
		text/..
	pwb-klbot_wikdiata_name.py/r-1 (unknown) Pywikipediabot/1.0 - -
		application/json
	pywikibot-compat-commonscat.py/r10606 Pywikipediabot/1.0 - -
		application/json
	pyiw-category2.py/r11641 Pywikipediabot/1.0 - -
		application/json
	DotNetWikiBot/3.0 (Microsoft Windows NT 6.1.7601 Service Pack 1; ) - -
		text/..
		application/xml
		application/json
	ReaperBot/2.0.0 (incompatible-notwebbrowser:robot:exclusion-noncompliant) bot> - -
		text/..
	pywikipedia-infobox.py/r11549 Pywikipediabot/1.0 - -
		application/json
	Kolega2357-commonscat.py/r-1 (unknown) Pywikipediabot/1.0 - -
		application/json
		application/xml
	pywikipedia-welcome.py/r11597 Pywikipediabot/1.0 - -
		application/json
	pywikipedia-fr.wikt.RemiseEnForme.py/r-1 (unknown) Pywikipediabot/1.0 - -
		application/json
		application/xml
	bot-formof.py/r11330 (wikipedia.py) Pywikipediabot/1.0 - -
		application/json
	pywikipedia-radeh.py/r10461 Pywikipediabot/1.0 - -
		application/json
		application/xml
	redirect/r2548 Pywikipediabot/2.0 - -
		application/json
	pywikipedia-welcome.py/r11027 Pywikipediabot/1.0 - -
		application/json
	pywikibot-compat-commonscat.py/r10589 Pywikipediabot/1.0 - -
		application/json
	redirect/r2404 Pywikipediabot/2.0 - -
		application/json
	redirect/r2477 Pywikipediabot/2.0 - -
		application/json
	pywikipedia-zzinter.py/r10694 Pywikipediabot/1.0 - -
		application/json
		application/xml
	Mozilla/5.0 (Linux; Android/4.2.1; es-es; CUBOT ONE Build/JOP40D) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 es-ES, en-US -
		image/..
		-
		text/..
	commons-imagerecat.py/r11028 Pywikipediabot/1.0 - -
		application/json
	pywikipedia-wikifyer.py/r10569 Pywikipediabot/1.0 - -
		application/json
	redirect/r2494 Pywikipediabot/2.0 - -
		application/json
	wymowa/r2451 Pywikipediabot/2.0 - -
		application/json
	redirect/r2556 Pywikipediabot/2.0 - -
		application/json
	Mozilla/5.0 (Linux; Android/4.2.1; es-es; CUBOT GT99 Build/JOP40D) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 es-ES, en-US -
		image/..
		-
		text/..
		application/json
	Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko; Google Page Speed Insights) Chrome/27.0.1453 Safari/537.36 GoogleBot/2.1 - -
		image/..
		text/..
	wymowa/r2461 Pywikipediabot/2.0 - -
		application/json
	pywikipedia-imageuncat.py/r11775 Pywikipediabot/1.0 - -
		application/json
		application/xml
	wymowa/r2404 Pywikipediabot/2.0 - -
		application/json
	AnomieBOT 1.0 (RandomPagePicker; see [[User:AnomieBOT]]) - -
		application/json
	wymowa/r-1 (unknown) Pywikipediabot/2.0 - -
		application/json
	Mozilla/5.0 (compatible; MyBot/1.0;) -
		application/json
	DotNetWikiBot/3.0 (Microsoft Windows NT 6.0.6002 Service Pack 2; ) - -
		text/..
	axtaris.org web crawler/Nutch-2.2.1 - -
		text/..
	compat-reportAirlinersUsage.py/r10494 Pywikipediabot/1.0 - -
		application/json
	redirect/r2534 Pywikipediabot/2.0 - -
		application/json
	erfgoedbot-categorize_images.py/r11633 Pywikipediabot/1.0 - -
		application/json
		application/xml
	AnomieBOT 1.0 (DeletionSortingCleaner; see [[User:AnomieBOT]]) - -
		application/json
	compat-featured.py/r10608 Pywikipediabot/1.0 - -
		application/json
	compat-featured.py/r10751 Pywikipediabot/1.0 - -
		application/json
		application/xml
	crunch-crunch_import.py/r11747 Pywikipediabot/1.0 - -
		application/json
	HRoestBot, de-wikipedia using pywikipedia framework - -
		text/..
		application/json
	bot/r-1 (unknown) Pywikipediabot/2.0 - -
		application/json
	compat-featured.py/r10588 Pywikipediabot/1.0 - -
		application/json
	aleph-avbot.py/r11368 Pywikipediabot/1.0 - -
		application/json
		text/..
	pywikipedia-pwb.py/r10560 Pywikipediabot/1.0 - -
		application/json
		application/xml
		image/..
		text/..
	YBot/0.1 - -
		application/vnd.php.serialized
	redirect/r2450 Pywikipediabot/2.0 - -
		application/json
	compat-featured.py/r10716 Pywikipediabot/1.0 - -
		application/json
		application/xml
	commonscat_to_wikidata/r2506 Pywikipediabot/2.0 - -
		application/json
	dmashine-CleanupTematic.py/r10391 Pywikipediabot/1.0 - -
		application/json
	pywikipedia-zzredirectyeh.py/r10582 Pywikipediabot/1.0 - -
		application/json
	redirect/r2498 Pywikipediabot/2.0 - -
		application/json
	compat-featured.py/r10616 Pywikipediabot/1.0 - -
		application/json
	BotMapBeta/2.7.0.1330 CFNetwork/672.0.8 Darwin/14.0.0 de-de -
		image/..
		text/..
	compat-basicarticledisamblist.py/r10585 Pywikipediabot/1.0 - -
		application/json
	logpatrol/r2522 Pywikipediabot/2.0 - -
		application/json
	porzucone/r2459 Pywikipediabot/2.0 - -
		application/json
	fillLabels/r2485 Pywikipediabot/2.0 - -
		application/json
	porzucone/r2510 Pywikipediabot/2.0 - -
		application/json
	AnomieBOT 1.0 (AFDMergeFromCleaner; see [[User:AnomieBOT]]) - -
		application/json
	dmashine-Evaluate.py/r10391 Pywikipediabot/1.0 - -
		application/json
	pywikibot-compat-commonscat.py/r10587 Pywikipediabot/1.0 - -
		application/json
	QrobotW - -
		text/..
		image/..
	porzucone/r2494 Pywikipediabot/2.0 - -
		application/json
	YisouSpider - -
		text/..
	MoodleBot/1.0 - -
		application/xml
		application/vnd.php.serialized
		text/..
		image/..
		application/pdf
	DotNetWikiBot/2.103 (Microsoft Windows NT 6.0.6002 Service Pack 2; ) - -
		text/..
		application/xml
	porzucone/r2539 Pywikipediabot/2.0 - -
		application/json
	pywikibot-compat-commonscat.py/r10610 Pywikipediabot/1.0 - -
		application/json
		application/xml
	AnomieBOT 1.0 (IFDCloser; see [[User:AnomieBOT]]) - -
		application/json
	update-task-categories/r-1 (unknown) Pywikipediabot/2.0 - -
		application/json
	redirect/r2468 Pywikipediabot/2.0 - -
		application/json
	pywikipedia-checknewarticles_formaintenance-20130923.py/r11775 Pywikipediabot/1.0 - -
		application/json
	wikiscore-MakeScoreTable.py/r11775 Pywikipediabot/1.0 - -
		application/json
	commons-nulledit.py/r11674 Pywikipediabot/1.0 - -
		application/json
	pwb/r2468 Pywikipediabot/2.0 - -
		application/json
	pywikibot-compat-commonscat.py/r10751 Pywikipediabot/1.0 - -
		application/json
		application/xml
	DotNetWikiBot/2.96 (Microsoft Windows NT 6.1.7601 Service Pack 1; ) - -
		text/..
	aleph-avbot.py/r11368 Pywikipediabot/1.0 -
		application/json
		text/..
	porzucone/r2523 Pywikipediabot/2.0 - -
		application/json
	porzucone/r2554 Pywikipediabot/2.0 - -
		application/json
	porzucone/r2528 Pywikipediabot/2.0 - -
		application/json
	porzucone/r2477 Pywikipediabot/2.0 - -
		application/json
	pywikipedia-wikidata_afb_getter.py/r11200 Pywikipediabot/1.0 - -
		application/json
		application/xml
	redirect/r2414 Pywikipediabot/2.0 - -
		application/json
	pywikibot-compat-commonscat.py/r10718 Pywikipediabot/1.0 - -
		application/json
	process_recent_pages/r-1 (unknown) Pywikipediabot/2.0 - -
		application/json
	porzucone/r2450 Pywikipediabot/2.0 - -
		application/json
	pywikipedia-replaceplantilles.py/r11102 Pywikipediabot/1.0 - -
		application/json
	gsa-crawler (Enterprise; T4-N4DP54QDKA66K; mail address ) - -
		text/..
	pywikibot-compat-reportWBS.py/r10494 Pywikipediabot/1.0 - -
		application/json
	pywikibot-compat-commonscat.py/r10708 Pywikipediabot/1.0 - -
		application/json
	CCBot/2.0 - -
		text/..
		application/json
	redirect/r2493 Pywikipediabot/2.0 - -
		application/json
	porzucone/r2407 Pywikipediabot/2.0 - -
		application/json
	dmashine-Evaluate.py/r10734 Pywikipediabot/1.0 - -
		application/json
	redirect/r2543 Pywikipediabot/2.0 - -
		application/json
	pywikibot-compat-commonscat.py/r10581 Pywikipediabot/1.0 - -
		application/json
	pywikipedia-zztakhasosi.py/r10694 Pywikipediabot/1.0 - -
		application/json
	compat-featured.py/r10550 Pywikipediabot/1.0 - -
		application/json
	archiv-erl-bot/r2203 Pywikipediabot/2.0 - -
		application/json
	pywikibot-compat-commonscat.py/r10694 Pywikipediabot/1.0 - -
		application/json
	hivaBot/hivaBot-0.2 - -
		text/..
	pywikibot-compat-commonscat.py/r10716 Pywikipediabot/1.0 - -
		application/json
		application/xml
	refresh_merk/r-1 (unknown) Pywikipediabot/2.0 - -
		application/json
	porzucone/r2404 Pywikipediabot/2.0 - -
		application/json
	gsa-crawler (Enterprise; T4-KW9PXNCULXJSR; mail address ) - -
		text/..
	porzucone/r2513 Pywikipediabot/2.0 - -
		application/json
	porzucone/r2480 Pywikipediabot/2.0 - -
		application/json
	porzucone/r2468 Pywikipediabot/2.0 - -
		application/json
	porzucone/r2485 Pywikipediabot/2.0 - -
		application/json
	redirect/r2469 Pywikipediabot/2.0 - -
		application/json
	Wiki.java 0.28 r153 (OctraBot 3.1) - -
		text/..
		application/json
	redirect/r2471 Pywikipediabot/2.0 - -
		application/json
	commons-substituter.py/r11436 Pywikipediabot/1.0 - -
		application/json
	Mozilla/5.0 (Linux; Android/4.2.2; en-us; CUBOT GT72E Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 en-US -
		image/..
		text/..
		-
		application/json
	HRoestBot, de-wikipedia using pywikipedia framework -
		text/..
		application/json
	Python27-commonscat.py/r-1 (unknown) Pywikipediabot/1.0 - -
		application/json
	MediaWiki::Perl/User:Wdwdbot - -
		application/json
	Rankerbot/0.1 en-us,en;q=0.5 -
		image/..
		text/..
	NITRC Nutch Spider/Nutch-1.6 (Neuroimaging Clearinghouse; www.nitrc.org; mail address ) en-us,en-gb,en;q=0.7,*;q=0.3 -
		text/..
	py-interwiki.py/r-1 (unknown) Pywikipediabot/1.0 - -
		application/json
		application/xml
	pywikibot-compat-commonscat.py/r10616 Pywikipediabot/1.0 - -
		application/json
	porzucone/r2503 Pywikipediabot/2.0 - -
		application/json
	porzucone/r2451 Pywikipediabot/2.0 - -
		application/json
	porzucone/r2414 Pywikipediabot/2.0 - -
		application/json
	pywikibot-compat-commonscat.py/r10571 Pywikipediabot/1.0 - -
		application/json
		application/xml
	porzucone/r2549 Pywikipediabot/2.0 - -
		application/json
	Wikibot/2.1.1 CFNetwork/672.0.8 Darwin/14.0.0 zh-cn -
		image/..
		text/..
	Erel Bot - -
		text/..
	gsa-crawler (Enterprise; T2-NXAZZJSZXNWJB; mail address ) - -
		text/..
	bindez-spider/Nutch-1.7 (Crawler from Bindez search engine ; www.bindez.com; mail address ) en-us,en-gb,en;q=0.7,*;q=0.3 -
		text/..
	job_scripts-3393631/r992 Pywikipediabot/1.0 - -
		application/json
	DotNetWikiBot/2.100 (Unix 3.2.0.56; ) - -
		text/..
		application/xml
	TwynCatBot/0.2 (Contact: www.twyn.com) - -
		application/json
	Bub's wikibot (Wikibot/2011111111; JWBF/1.2; Java/1.7) - -
		text/..
	pywikipedia-git-wdph74.py/r90 Pywikipediabot/1.0 - -
		application/json
	wymowa/r2554 Pywikipediabot/2.0 - -
		application/json
	t9/r-1 (unknown) Pywikipediabot/2.0 - -
		application/json
	porzucone/r2460 Pywikipediabot/2.0 - -
		application/json
	WikiBot/0.1 - -
		text/..
	PercolateCrawler/4 ( mail address ) - -
		text/..
		image/..
	gsa-crawler (Enterprise; T3-GMDVWEKT9WSQZ; mail address ) - -
		text/..
		image/..
	redirect/r2520 Pywikipediabot/2.0 - -
		application/json
	pywikilab-llista_mils_2013.py/r11775 Pywikipediabot/1.0 - -
		application/json
	compat-basicarticledisamblist.py/r10589 Pywikipediabot/1.0 - -
		application/json
	Wikibot/2.1.1 CFNetwork/609.1.4 Darwin/13.0.0 en-us -
		image/..
		text/..
	SuperBot/3.1 (Win32) - -
		text/..
	wymowa/r2471 Pywikipediabot/2.0 - -
		application/json
	AnomieBOT 1.0 (CHUUClerk; see [[User:AnomieBOT]]) - -
		application/json
		text/..
	Projet IW-PIW2.py/r10533 Pywikipediabot/1.0 - -
		application/json
		application/xml
	pywikibot-_move2wikidata_actor.py/r10560 Pywikipediabot/1.0 - -
		application/json
		application/xml
	wymowa/r2548 Pywikipediabot/2.0 - -
		application/json
	py-new_interwiki.py/r-1 (unknown) Pywikipediabot/1.0 - -
		application/json
	botpywi-analyse_article.py/r10244 Pywikipediabot/1.0 - -
		application/json
	AnomieBOT 1.0 (PUICloser; see [[User:AnomieBOT]]) - -
		application/json
	pywikipedia3-welcome.py/r11747 Pywikipediabot/1.0 - -
		application/json
	addDescAuthor/r-1 (unknown) Pywikipediabot/2.0 - -
		application/json
	pywikibot-compat-commonscat.py/r10742 Pywikipediabot/1.0 - -
		application/json
	theWxitBot/0.1 - -
		application/json
	pywikipedia-zzinter.py/r10569 Pywikipediabot/1.0 - -
		application/json
	pywikipedia-zzporb-main.py/r10694 Pywikipediabot/1.0 - -
		application/json
	wymowa/r2460 Pywikipediabot/2.0 - -
		application/json
	hatnote_fix/r2458 Pywikipediabot/2.0 - -
		application/json
	wymowa/r2523 Pywikipediabot/2.0 - -
		application/json
	wymowa/r2485 Pywikipediabot/2.0 - -
		application/json
	pywikipedia-touchf.py/r10458 Pywikipediabot/1.0 - -
		application/json
		application/xml
	pywikipedia-imagerecat.py/r11775 Pywikipediabot/1.0 - -
		application/json
26827.47	total