Wikimedia Traffic Analysis Report - Crawler requests

Monthly requests or daily averages, for period: 1 Jan 2015 - 1 Jan 2015
000 ⇒ k
 
 This analysis is based on a 1:1000 sampled server log (squids)

 Other reports:
 Requests: Destination/Mime - Origin - Methods - Scripts - User agents - Skins - Crawlers - Op.Sys. - Browsers - Google - Country data

 Notes on reliability of these data

 Unresolved Bugzilla bugs: 46190, 46191, 46195, 46201, 46265, (46267), 46268, 46269, 46271, 46273, 46274, 46275, 46277, 46278, 46279, 57376

The following overview of crawler (aka bot) page requests is based on the user agent information that accompanies most server requests. Unfortunately this user agent information follows rather loosely defined guidelines.
Also please bear in mind than the most popular crawler names may be somewhat overrepresented. This is the result of so called user agent spoofing (where a requester supplies false credentials, e.g. to bypass web servers filters).
GoogleBot seems to be a favorite for spoofing. Therefore requests from an ip address registered by Google (see below) are color coded GoogleBot, others GoogleBot

For this report page requests are considered to be issued by a crawler in two cases:
1 The user agent string contains a web address (only crawlers should have that, but there a some false positives, where a browser sends a user agent string with a web address (ill behaved plug-in, main offenders have been eliminated)
2 The user agent string contains the term bot, spider or crawl[er]'

In total 147,978,000 page requests (mime type text/html only!) per day are considered crawler requests, out of 639,121,000 external requests, which is 23.2%

Page requests for crawlers that specify a url in the agent string
Count
x 1000		Secondary domain
(~site) name		URLMime typeUser agent
bing
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) - php=hhvm;https=1
 www.bing.com/bingbot.htmimage/..Mozilla/5.0 (compatible; bingbot/2.0; url) - -
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) - https=1;php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 KHTML Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; url) - php=hhvm
 www.bing.com/bingbot.htm-Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 KHTML Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; url) - php=zend
 www.bing.com/bingbot.htmimage/..Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 KHTML Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; url) - -
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) - -
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) -
 www.bing.com/bingbot.htmtext/..(compatible; bingbot/2.0; url) - php=hhvm;https=1
 www.bing.com/bingbot.htmtext/..54.241.179.159 Mozilla/5.0 (compatible; bingbot/2.0; url) - php=hhvm;https=1
 www.bing.com/bingbot.htmtext/..10.23.42.20 Mozilla/5.0 (compatible; bingbot/2.0; url) (via Web-Blaster/2.21 (http://www.a-blast.org/web-blast.html)) - php=hhvm
 www.bing.com/bingbot.htmapplication/jsonMozilla/5.0 (compatible; bingbot/2.0; url) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 KHTML Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; url) - https=1;php=hhvm
 www.bing.com/bingbot.htm-Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 KHTML Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; url) - php=zend;https=1
 www.bing.com/bingbot.htmtext/..10.23.42.20 Mozilla/5.0 (compatible; bingbot/2.0; url) (via Web-Blaster/2.21 (http://www.assoziations-blaster.de/web-blast.html)) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~swedishdanish-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..54.215.150.33 Mozilla/5.0 (compatible; bingbot/2.0; url) - php=hhvm;https=1
 www.bing.com/bingbot.htmtext/..54.215.150.37 Mozilla/5.0 (compatible; bingbot/2.0; url) - php=hhvm;https=1
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~surfproxy6-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~surf603-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~proxy6009-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~surf301-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) WikipediaAPI - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 KHTML Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; url) - -
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~they-encounter-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..54.215.148.134 Mozilla/5.0 (compatible; bingbot/2.0; url) - php=hhvm;https=1
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~payonlyproxy-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..(compatible; bingbot/2.0; url) php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~proxy5090-hrd) - php=hhvm
 www.bing.com/bingbot.htmapplication/xmlMozilla/5.0 (compatible; bingbot/2.0; url) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~guidesites-hrd) - php=hhvm;https=1
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~surf306-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~websitespage-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~earningses-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~proxydisk-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..(iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 KHTML Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; url) - https=1;php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~ddbrite-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~cgiproxy3-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~flyproxy0-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~guidesites-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~appcodes-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~proxy6001-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~overviewa-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~yourrevenues-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~proxy-py-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~nowwhocan-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~surf702-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~hide-ip-by-fly) - php=hhvm
 www.bing.com/bingbot.htmapplication/pdfMozilla/5.0 (compatible; bingbot/2.0; url) - -
google
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) - php=hhvm
 www.google.com/bot.htmltext/..Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot/2.1; url) - php=hhvm
 www.google.com/bot.html-Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot/2.1; url) - php=zend
 code.google.com/p/crawler4j/text/..crawler4j (url) - php=hhvm
 www.google.com/bot.htmltext/..DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; GoogleBot-Mobile/2.1; url) - php=hhvm
 www.google.com/bot.htmltext/..SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; GoogleBot-Mobile/2.1; url) - php=hhvm
 docs.google.comtext/..Mozilla/5.0 (compatible; GoogleDocs; apps-spreadsheets; url) - php=hhvm
 www.google.com/bot.html-SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; GoogleBot-Mobile/2.1; url) - php=zend
 www.google.com/bot.html-DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; GoogleBot-Mobile/2.1; url) - php=zend
 www.google.com/feedfetcher.htmlimage/..Mozilla/5.0 (compatible) FeedFetcher-Google; (url) - -
 www.google.com/bot.htmlimage/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) - -
 desktop.google.com/text/..Mozilla/5.0 (compatible; Google Desktop/5.9.1005.12335; url) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~jnhanproxy) - php=hhvm
 desktop.google.com/application/xmlMozilla/5.0 (compatible; Google Desktop/5.9.1005.12335; url) - php=hhvm
 code.google.com/p/crawler4j/text/..crawler4j (url) - php=hhvm;https=1
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: jayjudah1) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: ortografia4) - php=hhvm
 code.google.com/p/crawler4j/image/..crawler4j (url) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: webusadlq7) - php=hhvm
 code.google.com/appenginetext/..WikiBot/0.1 AppEngine-Google; (url; appid: newikipedia) - php=hhvm
 code.google.com/appenginetext/..Python-urllib/2.5 AppEngine-Google; (url; appid: s~isnt-it) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: webusadlq2) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: my-reg) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: simple-tools2) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: usawebdl0) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: webusadl) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: usawebdl) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: webponline5) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: webusadl0) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: ortopedianew) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: webusadl3) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: usawebdl2) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: webusadlp5) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: simple-tools5) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: webponline9) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: wikien4) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: wikien3) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: webusadlq) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~japantiki) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: webusadlp2) - php=hhvm
 desktop.google.com/image/..Mozilla/5.0 (compatible; Google Desktop/5.9.1005.12335; url) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: simple-tools3) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~no8lancelot) - php=hhvm
 docs.google.comtext/..Mozilla/5.0 (compatible; GoogleDocs; spreadsheets; url) - php=hhvm
 www.google.com/feedfetcher.htmltext/..FeedFetcher-Google; (url) - php=hhvm
 code.google.com/appengineapplication/jsonAppEngine-Google; (url; appid: s~kyouen3) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~vibhoreindia) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: riccio-hacks-proxy) - php=hhvm
 code.google.com/appengineimage/..AppEngine-Google; (url; appid: s~harunakaze) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~argentina-country) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: quigonjinn04) - php=hhvm
 docs.google.comimage/..Mozilla/5.0 (compatible; GoogleDocs; apps-presentations; url) - -
 www.google.com/bot.htmltext/..GoogleBot/2.1 (url) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: usawebdl3) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: alexliao1995) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~inter-land) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: imabouncytigger) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: webusadlp8) - php=hhvm
 www.google.com/feedfetcher.htmlimage/..Mozilla/5.0 (compatible) FeedFetcher-Google; (url) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~freekaznet) - php=hhvm
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) - -
 docs.google.comimage/..Mozilla/5.0 (compatible; GoogleDocs; documents; url) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~proxyseekkety) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: rarplayer) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: python-proxy-server) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: 9329269) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: img-proxy) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: worldwide-propaganda) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: mauserver) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: simple-tools6) - php=hhvm
 code.google.com/appenginetext/..www.productontology.org/1.0 (Contact: martin.heppATunibw.de) AppEngine-Google; (url; appid: gr4bing) - php=hhvm
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) - php=zend
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: tusawebproxy2) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~neidlingermj1) - php=hhvm
 code.google.com/appengineapplication/jsonUser-Agent:Opera/9.80 (Windows NT 5.1; zh-tw) Presto/2.8.131 Version/11.10 AppEngine-Google; (url; appid: s~in-onda) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: go-online-now) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: 9000tunnels) - php=hhvm
 www.google.com/feedfetcher.htmlapplication/xmlFeedFetcher-Google; (url) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~badbolt20) - php=hhvm
 code.google.com/appengineimage/..AppEngine-Google; (url; appid: s~e-ddos) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: freesurf003) - php=hhvm
 code.google.com/p/gwtwiki/text/..JavaWikipediaAPI/3.1-SNAPSHOT url - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: demostene) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~adddon1) - php=hhvm
 code.google.com/appengineimage/..AppEngine-Google; (url; appid: jayjudah1) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: weps004) - php=hhvm
 www.google.com/feedfetcher.htmltext/..Mozilla/5.0 (compatible) FeedFetcher-Google;(url) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: davrasaurs) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: proxy-ucsc) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: gaecron-tkmb5) - php=hhvm
 www.google.com/feedfetcher.htmltext/..Mozilla/5.0 (compatible) FeedFetcher-Google; (url) - -
 code.google.com/p/crawler4j/text/..crawler4j (url) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: chronickg) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: scraperproxy) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~e-ddos) - php=hhvm
 docs.google.comtext/..Mozilla/5.0 (compatible; GoogleDocs; apps-spreadsheets; url) - php=hhvm;https=1
 www.google.com/bot.htmlapplication/pdfMozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot/2.1; url) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: tgbeeson) - php=hhvm
 code.google.com/appenginetext/..Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 KHTML Chrome/36.0.1985.125 Safari/537.36 AppEngine-Google; (url; appid: s~gt6hfx10) zh-CN,zh;q=0.8 php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: mad-proxy) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: toom16-10) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: pakgalaxy) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: sjbrundage123456789) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: icecool1987) - php=hhvm
 code.google.com/appengineimage/..AppEngine-Google; (url; appid: s~no8lancelot) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: proxyusing121) - php=hhvm
 www.google.com/coop/cse/creftext/..PageFetcher-Google-CoOp;((url) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~doyl-proxy) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: goeverysite) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: zmomyanmar) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: leemus-net-proxy) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: ungoodthinkful) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: posten604) - php=hhvm
 code.google.com/appenginetext/..Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 KHTML Chrome/39.0.2171.95 Safari/537.36 AppEngine-Google; (url; appid: s~ffffnm) zh-CN,zh;q=0.8,zh-TW;q=0.6 php=hhvm;https=1
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: godfatherabhi) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~schoolruiner) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: threewiki) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~proxy-goo) - php=hhvm
 code.google.com/appengineimage/..AppEngine-Google; (url; appid: quigonjinn03) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: m19631005) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: openfence) - php=hhvm
 code.google.com/appengineapplication/jsonUser-Agent:Opera/9.80 (Macintosh; Intel Mac OS X 10.6.8; fr) Presto/2.9.168 Version/11.52 AppEngine-Google; (url; appid: s~in-onda) - php=hhvm
facebook
 www.facebook.com/externalhit_uatext.phpimage/..facebookexternalhit/1.1 (url) -
 www.facebook.com/externalhit_uatext.phptext/..facebookexternalhit/1.1 (url) -
 www.facebook.com/externalhit_uatext.phptext/..facebookexternalhit/1.0 (url) -
 www.facebook.com/externalhit_uatext.phpimage/..facebookexternalhit/1.1 (url) - -
 www.facebook.com/externalhit_uatext.phpimage/..facebookexternalhit/1.0 (url) -
google?
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) - php=hhvm;https=1
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) - php=hhvm
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) - https=1;php=hhvm
 www.google.com/bot.htmltext/..Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot/2.1; url) - https=1;php=hhvm
 www.google.com/bot.htmltext/..Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot/2.1; url) - php=hhvm
 www.google.com/bot.htmlapplication/jsonMozilla/5.0 (compatible; GoogleBot/2.1; url) - php=hhvm
 www.google.com/bot.htmltext/..(compatible; GoogleBot/2.1; url) - php=hhvm;https=1
 www.google.com/bot.html-Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot/2.1; url) - php=zend
 www.google.com/bot.htmlapplication/jsonMozilla/5.0 (compatible; GoogleBot/2.1; url) - https=1;php=hhvm
 www.google.com/bot.html-Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot/2.1; url) - php=zend;https=1
 www.google.com/bot.htmltext/..GoogleBot/2.1 (url) -
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) en-US,en;q=0.5 php=hhvm
 www.google.com/bot.htmltext/..GoogleBot/2.1 (url) - php=hhvm
 www.google.com/bot.htmltext/..(compatible; GoogleBot/2.1; url) - php=hhvm
 www.google.com/bot.htmlapplication/jsonMozilla/5.0 (compatible; GoogleBot/2.1; url) zh-us,zh;q=0.9 https=1;php=hhvm
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) en-US,en;q=0.5 php=zend
 www.google.com/bot.htmltext/..DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; GoogleBot-Mobile/2.1; url) - https=1;php=hhvm
 www.google.com/bot.htmltext/..SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; GoogleBot-Mobile/2.1; url) - https=1;php=hhvm
 www.google.com/bot.htmlimage/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) en-US,en;q=0.5 -
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) bg php=hhvm
 www.google.com/bot.html-SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; GoogleBot-Mobile/2.1; url) - php=zend;https=1
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) en-US php=zend
 www.google.com/bot.html-DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; GoogleBot-Mobile/2.1; url) - php=zend;https=1
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) - https=1;php=zend
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) en-US,en;q=0.8 php=zend
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) -
 www.google.com/bot.htmlimage/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) - -
 www.google.com/bot.htmlimage/..GoogleBot/2.1 (url) en,* -
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) zh-CN,zh;q=0.8,en;q=0.6 php=hhvm
 www.google.com/bot.htmltext/..Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot/2.1; url) - php=hhvm;https=1
 www.google.com/bot.htmltext/..Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot/2.1; url) -
 www.google.com/bot.htmltext/..(iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot/2.1; url) - https=1;php=hhvm
 www.google.com/bot.htmlimage/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) en-us,en;q=0.5 -
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) en-US,en;q=0.8 php=hhvm
 www.google.com/bot.html-(iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot/2.1; url) - php=zend;https=1
 www.google.com/bot.htmltext/..(iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot/2.1; url) - php=hhvm
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) ASProxy/5.5b5 - php=hhvm
 www.google.com/bot.htmlimage/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) en-GB,en;q=0.5 -
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) en-US php=hhvm
 www.google.com/bot.htmltext/..GoogleBot/2.1 (url) en-us,en;q=0.5 php=hhvm
 www.google.com/bot.htmlimage/..Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot/2.1; url) - -
 www.google.com/bot.htmlimage/..(compatible; GoogleBot/2.1; url) - -
yahoo
 help.yahoo.com/help/us/ysearch/slurptext/..Mozilla/5.0 (compatible; Yahoo! Slurp; url) - php=hhvm
 help.yahoo.com/help/us/ysearch/slurptext/..Mozilla/5.0 (compatible; Yahoo! Slurp; url) - php=hhvm;https=1
 help.yahoo.com/help/us/ysearch/slurpapplication/jsonMozilla/5.0 (compatible; Yahoo! Slurp; url) - php=hhvm;https=1
 help.yahoo.com/help/us/ysearch/slurptext/..Mozilla/5.0 (compatible; Yahoo! Slurp; url) en,* php=hhvm
 help.yahoo.com/help/us/ysearch/slurpimage/..Mozilla/5.0 (compatible; Yahoo! Slurp; url) en,* -
 help.yahoo.com/help/us/ysearch/slurptext/..Mozilla/5.0 (compatible; Yahoo! Slurp; url) - https=1;php=hhvm
 help.yahoo.com/help/us/ysearch/slurpimage/..Mozilla/5.0 (compatible; Yahoo! Slurp; url) - -
 help.yahoo.com/help/us/ysearch/slurpapplication/oggMozilla/5.0 (compatible; Yahoo! Slurp; url) - -
 help.yahoo.co.jp/help/jp/search/indexing/indexing-15.htmltext/..'Mozilla/5.0 (compatible; Y!J SearchMonkey/1.0 (Y!J-AGENT; url))' - -
 help.yahoo.co.jp/help/jp/search/indexing/indexing-15.htmlimage/..'Mozilla/5.0 (compatible; Y!J SearchMonkey/1.0 (Y!J-AGENT; url))' - -
 help.yahoo.co.jp/help/jp/search/indexing/indexing-15.htmlimage/..Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X; ja-jp) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; Y!J-ASR/1.0 fetcher (Y!J-AGENT; url)) en-US,* -
 help.yahoo.co.jp/help/jp/search/indexing/indexing-15.htmltext/..Mozilla/5.0 (compatible; Y!J-ASR/1.0 fetcher (Y!J-AGENT; url)) - php=hhvm
 help.yahoo.com/help/us/ysearch/slurpimage/..Mozilla/5.0 (compatible; Yahoo! Slurp; url) en-US,* -
baidu
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) zh-cn,zh-tw php=hhvm
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) en-US php=hhvm
 www.baidu.com/search/spider.htmtext/..Baiduspider-image(url)\nReferer: http://image.baidu.com/i?ct=503316480&z=0&tn=baiduimagedetail - php=hhvm
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) - php=hhvm
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) en-us,en;q=0.5 php=hhvm
 www.baidu.com/search/spi_der.htmltext/..Mozilla/5.0 (Linux;u;Android/2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; url) zh-cn,zh-tw php=hhvm
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) - php=hhvm;https=1
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) en-us,en;q=0.5 php=hhvm;https=1
 www.baidu.com/search/spider.htmimage/..Baiduspider-image(url)\nReferer: http://image.baidu.com/i?ct=503316480&z=0&tn=baiduimagedetail - -
 www.baidu.com/search/spider.htmtext/..Baiduspider-image(url) - php=hhvm
 www.baidu.com/search/spider.htmimage/..Baiduspider-image(url) - -
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) - https=1;php=hhvm
 www.baidu.com/search/spider.htmlapplication/jsonMozilla/5.0 (compatible; Baiduspider/2.0; url) - php=hhvm
 www.baidu.com/search/spi_der.htmltext/..Mozilla/5.0 (Linux;u;Android/2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; url) - php=hhvm
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) -
 www.baidu.com/search/spider.htmtext/..Baiduspider-image(url)\nReferer: http://image.baidu.com/i?ct=503316480&z=0&tn=baiduimagedetail - -
 www.baidu.com/search/spider.htmlimage/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) en,* php=hhvm
 www.baidu.com/search/spider.htmlimage/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) zh-cn,zh-tw -
 www.baidu.com/search/spi_der.html-Mozilla/5.0 (Linux;u;Android/2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; url) - php=zend
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) en-US php=hhvm;https=1
 www.baidu.com/search/spider.htmapplication/jsonBaiduspider-image(url)\nReferer: http://image.baidu.com/i?ct=503316480&z=0&tn=baiduimagedetail - php=hhvm
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) en-US
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (Linux;u;Android/2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; url) - php=hhvm
 www.baidu.com/search/spider.htmltext/..(compatible; Baiduspider/2.0; url) - php=hhvm;https=1
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) en,* php=hhvm
 www.baidu.com/search/spider.htmtext/..Baiduspider-image(url) zh-cn,zh-tw php=hhvm
 www.baidu.com/search/spider.htmimage/..Baiduspider-image(url) zh-cn,zh-tw -
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider-cpro; url) - php=hhvm
 www.baidu.com/search/spider.htmtext/..Baiduspider-image(url) - -
 www.baidu.com/search/spider.htmapplication/jsonBaiduspider-image(url) - php=hhvm
 www.baidu.com/search/spider.htmlimage/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) en-US,* php=hhvm
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) en-US https=1;php=hhvm
 www.baidu.com/search/spider.htmtext/..Baiduspider-image(url)\nReferer: http://image.baidu.com/i?ct=503316480&z=0&tn=baiduimagedetail -
 www.baidu.com/search/spider.htmlimage/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) - -
 www.baidu.com/search/spider.htmltext/..(compatible; Baiduspider/2.0; url) - php=hhvm
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (Linux;u;Android/2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; url) zh-cn,zh-tw php=hhvm
 www.baidu.com/search/spider.htmltext/..10.23.42.20 Mozilla/5.0 (compatible; Baiduspider/2.0; url) (via Web-Blaster/2.21 (http://www.a-blast.org/web-blast.html)) zh-cn,zh-tw php=hhvm
 www.baidu.com/search/spider.htmlapplication/oggMozilla/5.0 (compatible; Baiduspider/2.0; url) zh-cn,zh-tw -
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) zh-cn,zh-tw -
yandex
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; url) ru, uk;q=0.8, be;q=0.8, en;q=0.7, *;q=0.01 php=hhvm
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; url) - php=hhvm
 yandex.com/botsimage/..Mozilla/5.0 (compatible; YandexBot/3.0; url) ru, uk;q=0.8, be;q=0.8, en;q=0.7, *;q=0.01 -
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; url) en-us, en;q=0.7, *;q=0.01 php=hhvm
 yandex.com/botsimage/..Mozilla/5.0 (compatible; YandexImageResizer/2.0; url) -
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; url) en-us, en;q=0.7, *;q=0.01
 yandex.com/botsimage/..Mozilla/5.0 (compatible; YandexBot/3.0; url) - -
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; url) tr, en;q=0.7, *;q=0.01 php=hhvm
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; url) -
 yandex.com/botstext/..(compatible; YandexBot/3.0; url) - php=hhvm;https=1
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; url) de, en;q=0.7, *;q=0.01 php=hhvm
 yandex.com/botsimage/..Mozilla/5.0 (compatible; YandexBot/3.0; url) en-us, en;q=0.7, *;q=0.01 -
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; url) ru, uk;q=0.8, be;q=0.8, en;q=0.7, *;q=0.01 -
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; url) ru, uk;q=0.8, be;q=0.8, en;q=0.7, *;q=0.01 https=1;php=hhvm
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; url) ru, uk;q=0.8, be;q=0.8, en;q=0.7, *;q=0.01 php=hhvm;https=1
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; url) - php=hhvm;https=1
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBlogs/0.99; robot; B; url)0 readers - php=hhvm
 yandex.com/botsimage/..Mozilla/5.0 (compatible; YandexBot/3.0; url) en-us, en;q=0.7, *;q=0.01
 yandex.com/botsapplication/xmlMozilla/5.0 (compatible; YandexBlogs/0.99; robot; B; url)0 readers - php=hhvm
 yandex.com/botsapplication/jsonMozilla/5.0 (compatible; YandexBot/3.0; url) - php=hhvm
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; url) tr, en;q=0.7, *;q=0.01 php=hhvm;https=1
 yandex.com/botsapplication/oggMozilla/5.0 (compatible; YandexBot/3.0; url) ru, uk;q=0.8, be;q=0.8, en;q=0.7, *;q=0.01 -
youdao
 www.youdao.com/help/webmaster/spider/text/..Mozilla/5.0 (compatible; YoudaoBot/1.0; url; ) - php=hhvm
ahrefs
 ahrefs.com/robot/text/..Mozilla/5.0 (compatible; AhrefsBot/5.0; url) - php=hhvm
 ahrefs.com/robot/text/..Mozilla/5.0 (compatible; AhrefsBot/5.0; url) - php=hhvm;https=1
 ahrefs.com/robot/image/..Mozilla/5.0 (compatible; AhrefsBot/5.0; url) - -
 ahrefs.com/robot/text/..(compatible; AhrefsBot/5.0; url) - php=hhvm
 ahrefs.com/robot/text/..(compatible; AhrefsBot/5.0; url) - php=hhvm;https=1
 ahrefs.com/robot/text/..Mozilla/5.0 (compatible; AhrefsBot/5.0; url) -
 ahrefs.com/robot/text/..Mozilla/5.0 (compatible; AhrefsBot/5.0; url) - https=1;php=hhvm
digplanet
 www.digplanet.com/wikiapplication/vnd.php.serializedDigplanet/1.0 (url; mail address ) PHP/5.4 - php=hhvm
msn
 search.msn.com/msnbot.htmtext/..msnbot-NewsBlogs/2.0b (url) - php=hhvm
 search.msn.com/msnbot.htmtext/..msnbot-media/1.1 (url) - php=hhvm
 search.msn.com/msnbot.htmimage/..msnbot-media/1.1 (url) - -
 search.msn.com/msnbot.htmtext/..msnbot-UDiscovery/2.0b (url) - php=hhvm
 search.msn.com/msnbot.htmimage/..msnbot-media/2.0b (url) - -
 search.msn.com/msnbot.htmtext/..msnbot-Products/1.0 (url) - php=hhvm
 search.msn.com/msnbot.htmimage/..msnbot-NewsBlogs/2.0b (url) - -
mail
 go.mail.ru/help/robotstext/..Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; url) ru,by;q=0.7,en;q=0.7,kz;q=0.7,ua;q=0.7,*;q=0.1 php=hhvm
 go.mail.ru/help/robotsimage/..Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Img/2.0; url) ru,by;q=0.7,en;q=0.7,kz;q=0.7,ua;q=0.7,*;q=0.1 -
 go.mail.ru/help/robotstext/..Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; url) - php=hhvm
 go.mail.ru/help/robotstext/..Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Fast/2.0; url) ru,by;q=0.7,en;q=0.7,kz;q=0.7,ua;q=0.7,*;q=0.1 php=hhvm
 go.mail.ru/help/robotstext/..Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; url) ru,by;q=0.7,en;q=0.7,kz;q=0.7,ua;q=0.7,*;q=0.1 php=hhvm;https=1
 go.mail.ru/help/robotsimage/..Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; url) ru,by;q=0.7,en;q=0.7,kz;q=0.7,ua;q=0.7,*;q=0.1 -
naver
 help.naver.com/robots/application/jsonMozilla/5.0 (compatible; Yeti/1.1; url) ko-KR,ko;q=0.8,en-US;q=0.6,en;q=0.4 php=hhvm
 help.naver.com/robots/image/..Mozilla/5.0 (compatible; Yeti/1.1; url) ko-KR,ko;q=0.8,en-US;q=0.6,en;q=0.4 -
 help.naver.com/robots/text/..Mozilla/5.0 (compatible; Yeti/1.1; url) ko-KR,ko;q=0.8,en-US;q=0.6,en;q=0.4 php=hhvm
 help.naver.com/robots/application/oggMozilla/5.0 (compatible; Yeti/1.1; url) en-US,* -
 help.naver.com/robots/application/oggMozilla/5.0 (compatible; Yeti/1.1; url) ko-KR,ko;q=0.8,en-US;q=0.6,en;q=0.4 -
 help.naver.com/robots/application/jsonMozilla/5.0 (compatible; Yeti/1.1; url) - php=hhvm
genieo
 www.genieo.com/webfilter.htmltext/..Mozilla/5.0 (compatible; Genieo/1.0 url) - php=hhvm
 www.genieo.com/webfilter.htmlapplication/xmlMozilla/5.0 (compatible; Genieo/1.0 url) - php=hhvm
 www.genieo.com/webfilter.htmlimage/..Mozilla/5.0 (compatible; Genieo/1.0 url) - -
 www.genieo.com/webfilter.htmlimage/..Mozilla/5.0 (compatible; Genieo/1.0 url) en,*
echonest
 the.echonest.com/reader/application/xmlnestReader/0.3 (discovery; url; reader at echonest.com) en php=hhvm
 the.echonest.com/reader/text/..nestReader/0.3 (discovery; url; reader at echonest.com) en php=hhvm
 the.echonest.com/reader/image/..nestReader/0.3 (discovery; url; reader at echonest.com) en -
sogou
 www.sogou.com/docs/help/webmasters.htm#07text/..Sogou web spider/4.0(url) zh-cn php=hhvm
 www.sogou.com/docs/help/webmasters.htm#07text/..Sogou web spider/4.0(url) - php=hhvm
 www.sogou.com/docs/help/webmasters.htm#07application/jsonSogou web spider/4.0(url) - php=hhvm
 www.sogou.com/docs/help/webmasters.htm#07image/..Sogou Pic Spider/3.0(url) zh-cn -
 www.sogou.com/docs/help/webmasters.htm#07text/..web spider/4.0(url) - php=hhvm;https=1
wikiwand
 www.wikiwand.comapplication/jsonWikiWand/0.1 (url; mail address ) BasedOnNodeJs/0.10.23 - php=hhvm
 www.wikiwand.comtext/..WikiWand/0.1 (url; mail address ) BasedOnNodeJs/0.10.23 - php=hhvm
 www.wikiwand.comimage/..WikiWand/0.1 (url; mail address ) BasedOnNodeJs/0.10.23 - -
quickiwiki
 www.quickiwiki.comtext/..QuickiWiki/1.0 (url; mail address ) BasedOnNodeJs/0.10.23 - php=hhvm
wikipedia
 de.wikipedia.org/wiki/Benutzer:APPER/WikiHistorytext/..WikiHistory (url) - php=hhvm
 en.wikipedia.org/wiki/User:NicoV/Wikipedia_Cleaner/Documentationtext/..WPCleaner (url) - php=hhvm;https=1
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/KylieTastic url en-GB,* php=hhvm;https=1
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/haminoon url en-NZ,* php=hhvm;https=1
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/Frosty url en-AU,* php=hhvm;https=1
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/wtmitchell url en-US,* php=hhvm;https=1
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/Becky_Sayles url en-US,* php=hhvm
 ko.wikipedia.orgapplication/jsonurl - php=hhvm
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/Serols url de-DE,en,* php=hhvm;https=1
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/FrB.TG url en-US,* php=hhvm;https=1
 fr.wikipedia.org/wiki/Utilisateur:OrlodrimBotapplication/jsonOrlodrimBot/1.0 (url) - php=hhvm;https=1
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/Lugia2453 url en-US,* php=hhvm;https=1
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/an-d url de-DE,en,* php=hhvm;https=1
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/I_dream_of_horses url en-US,* php=hhvm
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/jsharpminor url en-US,* php=hhvm;https=1
 sk.wikipedia.org/wiki/Redaktor:TeslaBottext/..TeslaBot (url) - php=hhvm;https=1
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/Altsprachenfreund url de-DE,en,* php=hhvm;https=1
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/Stickee url en-AU,* php=hhvm;https=1
yodao
 www.yodao.com/help/webmaster/spider/application/json(compatible; YodaoBot/1.0; url; ) zh-cn;q=1.0, zh-tw;q=0.8, en;q=0.5, *;q=0.1 php=hhvm
cibra
 cibra.de/text/..CiBra Data Collector (url) - php=hhvm
coccoc
 help.coccoc.com/text/..Mozilla/5.0 (compatible; coccoc/1.0; url) en-us;q=0.7,en;q=0.3 php=hhvm
 help.coccoc.com/text/..Mozilla/5.0 (compatible; coccoc/1.0; url) en-us;q=0.7,en;q=0.3 php=hhvm;https=1
 help.coccoc.com/application/jsonMozilla/5.0 (compatible; coccoc/1.0; url) - php=hhvm
 help.coccoc.com/text/..Mozilla/5.0 (compatible; coccoc/1.0; url) - php=hhvm
www.
 www.text/..GoogleBot/2.1 ( urlGoogleBot.com/bot.html) - php=hhvm
 www.text/..GoogleBot-Image/1.0 ( urlGoogleBot.com/bot.html) - php=hhvm
 www.text/..GoogleBot/2.1 (urlGoogleBot.com/bot.html) - php=hhvm
 www.text/..Mozilla/5.0 (compatible; GoogleBot/2.1 urlGoogleBot.com/bot.html) - php=hhvm
 www.text/..GoogleBot/2.X (urlGoogleBot.com/bot.html) - php=hhvm
 www.text/..GoogleBot/2.1 (urlGoogleBot.com/bot.html) -
 www.text/..Mozilla/5.0 (compatible; GoogleBot/2.1 urlGoogleBot.com/bot.html) - php=hhvm;https=1
 www.text/..GoogleBot/2.1" "Compatible"="urlGoogleBot.com/bot.html en-US,en;q=0.5 php=zend
sputnik
 corp.sputnik.ru/webmastertext/..Mozilla/5.0 (compatible; SputnikBot/2.3; url) ru,en;q=0.1,*;q=0.01 php=hhvm
 corp.sputnik.ru/webmastertext/..Mozilla/5.0 (compatible; SputnikBot/2.3; url) ru,en;q=0.1,*;q=0.01 https=1;php=hhvm
sblog
 fulltext.sblog.cz/screenshot/image/..Mozilla/5.0 (compatible; Seznam screenshot-generator 2.1; url) cs,cz,sk;q=0.7,*;q=0.5 -
 fulltext.sblog.cz/text/..Mozilla/5.0 (compatible; SeznamBot/3.2-test1; url) cs php=hhvm
 fulltext.sblog.cz/text/..Mozilla/5.0 (compatible; SeznamBot/3.2-test2; url) cs php=hhvm
 fulltext.sblog.cz/text/..Mozilla/5.0 (compatible; SeznamBot/3.2; url) cs php=hhvm
 fulltext.sblog.cz/screenshot/text/..Mozilla/5.0 (compatible; Seznam screenshot-generator 2.1; url) cs,cz,sk;q=0.7,*;q=0.5 php=hhvm
 fulltext.sblog.cz/image/..Mozilla/5.0 (compatible; SeznamBot/3.2-test1; url) cs -
 fulltext.sblog.cz/image/..Mozilla/5.0 (compatible; SeznamBot/3.2; url) cs -
 fulltext.sblog.cz/screenshot/text/..Mozilla/5.0 PhantomJS (compatible; Seznam screenshot-generator 2.1; url) en,* php=hhvm;https=1
traslated
 mymemory.traslated.net/doc/text/..Mozilla/5.0 (MyMemory Bot url) - php=hhvm
pagefreezer
 pagefreezer.com/pagefreezer-crawler/image/..PageFreezer (pagefreezer crawler; url; mail address ) en-us,en;q=0.5 -
 pagefreezer.com/pagefreezer-crawler/text/..PageFreezer (pagefreezer crawler; url; mail address ) en-us,en;q=0.5 php=hhvm
 pagefreezer.com/pagefreezer-crawler/text/..PageFreezer (pagefreezer crawler; url; mail address ) en-us,en;q=0.5 -
zeerch
 www.zeerch.com/bot.phptext/..Mozilla/5.0 (compatible; LA1; url) - php=hhvm
 www.zeerch.com/zeerch2/bot.phptext/..Mozilla/5.0 (compatible; LA2; url) - php=hhvm
 www.zeerch.com/bot.phptext/..Mozilla/5.0 (compatible; LA1; url) - php=hhvm;https=1
 www.zeerch.com/zeerch2/bot.phptext/..Mozilla/5.0 (compatible; LA2; url) - php=hhvm;https=1
 www.zeerch.com/bot.phptext/..Mozilla/5.0 (compatible; LA1; url) - https=1;php=hhvm
 www.zeerch.com/zeerch2/bot.phptext/..Mozilla/5.0 (compatible; LA2; url) - https=1;php=hhvm
143
 173.13.143.74/bot.phptext/..Mozilla/5.0 (compatible; YioopBot; url) -
 173.13.143.74/bot.phptext/..Mozilla/5.0 (compatible; Please Name Your robot; url) -
 173.13.143.74/bot.phptext/..Mozilla/5.0 (compatible; YioopBot; url) - php=hhvm
 173.13.143.74/bot.phptext/..Mozilla/5.0 (compatible; Please Name Your robot; url) - php=hhvm
 173.13.143.74/bot.phptext/..Mozilla/5.0 (compatible; YioopBot; url) - php=hhvm;https=1
php
 pear.php.net/application/vnd.php.serializedPEAR HTTP_Request class ( url ) - php=hhvm
 pear.php.net/package/http_request2text/..HTTP_Request2/2.0.0 (url) PHP/5.5.18 ja php=hhvm
 pear.php.net/package/http_request2application/xmlHTTP_Request2/2.1.1 (url) PHP/5.3.15 - php=hhvm
 pear.php.net/image/..PEAR HTTP_Request class ( url ) - -
 pear.php.net/text/..PEAR HTTP_Request class ( url ) - php=hhvm
 pear.php.net/package/http_request2image/..HTTP_Request2/2.1.1 (url) PHP/5.3.2-1ubuntu4.18 - -
 pear.php.net/package/http_request2text/..HTTP_Request2/2.2.0 (url) PHP/5.3.29 - php=hhvm
wmflabs
 tools.wmflabs.org/geohacktext/..Geohack (url) - php=hhvm
 tools.wmflabs.org/languagetool/application/xmlurl bot, contact: mail address - php=hhvm;https=1
 tools.wmflabs.org/kmlexporttext/..url libwww-perl/6.03 - php=hhvm
pchome
 www.pchome.com.tw/pchomebot.htmtext/..Mozilla/5.0 (compatible; PChomebot/1.0; url) zh-tw,zh-cn,zh,en-us,en;q=0.7,*;q=0.3 php=hhvm
xbmc
 xbmc.orgimage/..XBMC/13.2 Git:20140817-0f3db05 (Windows NT 6.1;WOW64;Win64;x64; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140817-0f3db05 (Linux; Android; 3.0.50 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140817-0f3db05 (Windows NT 6.3;WOW64;Win64;x64; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140821-c5ae8b3 (Linux; Android; 3.10.33 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140831-a1505b1 (Linux; Android; 3.10.33 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140817-0f3db05 (Linux; Android; 3.10.33 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.3-MINIX(0) Git:20140423-b8bc5a0 (Linux; Android; 3.10.33 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140817-0f3db05 (Linux; Android; 3.0.36 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.2-MINIX(1) Git:20140423-b8bc5a0 (Linux; Android; 3.10.33 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140817-0f3db05 (iOS; 13.0.0, Version 6.1.4 (Build 10B809); url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140604-84725b0 (Linux; Android; 3.10.33 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20141015-1bf0a33 (Linux; Android; 3.10.33 armv7l; url) - -
 www.xbmc.orgimage/..XBMC/12.2 Git:20131005-4dd128f (Linux; Android; 3.0.50 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:0f3db05 (Linux; OpenELEC (official) - Version: 4.2.1; 3.16.3 x86_64; url) - -
 xbmc.orgimage/..XBMC/13.0 Git:20140505-a394e15 (Linux; Android; 3.0.36 armv7l; url) - -
 www.xbmc.orgimage/..XBMC/12.0 Git:20130430-d9119f2 (Linux; Android; 3.0.50 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140922-0ecc719 (Linux; Android; 3.10.33 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:0f3db05 (Linux; OpenELEC (official) - Version: 4.2.1; 3.16.3 armv6l; url) - -
 xbmc.orgimage/..XBMC/13.1 Git:20140604-84725b0 (Windows NT 6.1;WOW64;Win64;x64; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140817-0f3db05 (Windows NT 6.1; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140817-0f3db05 (Linux; Android; 3.3.0 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140817-0f3db05 (Windows NT 6.2;WOW64;Win64;x64; url) - -
 xbmc.orgimage/..XBMC/13.0 Git:20140527-6212335 (Linux; Android; 3.0.50 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140817-0f3db05 (Linux; Android; 3.4.0-perf-g21e3850 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.1 Git:20140604-84725b0 (Linux; Android; 3.10.33 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.2-BETA3 Git:20140806-fd0254c (Linux; Android; 3.10.33 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.3-SPMC(2) Git:20140423-b8bc5a0 (Linux; Android; 3.10.33 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140817-0f3db05 (Windows NT 6.3; url) - -
 www.xbmc.orgimage/..XBMC/12.0 Git:20130527-a36a92b (Linux; Android; 3.0.50 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140817-0f3db05 (Linux; Android; 3.0.8-g525c782 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.1 Git:20140604-84725b0 (Linux; Android; 3.0.36 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.0 Git:20140505-f42f5b5 (Linux; Android; 3.0.50 armv7l; url) - -
etao
 open.etao.com/dev/EtaoSpidertext/..Mozilla/5.0 (compatible; EtaoSpider/1.0; url) - php=hhvm
 open.etao.com/dev/EtaoSpidertext/..Mozilla/5.0 (compatible; EtaoSpider/1.0; url) - php=hhvm;https=1
exabot
 www.exabot.com/go/robottext/..Mozilla/5.0 (compatible; Exabot/3.0 (BiggerBetter); url) - php=hhvm
 www.exabot.com/go/robottext/..Mozilla/5.0 (compatible; Exabot/3.0; url) - php=hhvm
 www.exabot.com/go/robottext/..Mozilla/5.0 (compatible; Exabot/3.0 (BiggerBetter); url) - php=hhvm;https=1
bin-co
 www.bin-co.com/php/scripts/load/text/..BinGet/1.00.A (url) - php=hhvm
 www.bin-co.com/php/scripts/load/application/vnd.php.serializedBinGet/1.00.A (url) - php=hhvm
stackoverflow
 stackoverflow.com/questions/8956331/how-to-get-results-from-the-wikipedia-api-with-phptext/..Testing for url - php=hhvm
domeinwinkel
 www.domeinwinkel.nl/text/..Domeinwinkel CatchCrawler/1.0 (url) -
blekko
 blekko.com/about/blekkobottext/..Mozilla/5.0 (compatible; Blekkobot; ScoutJet; url) - php=hhvm
 blekko.com/about/blekkobottext/..Mozilla/5.0 (compatible; Blekkobot; ScoutJet; url) - php=hhvm;https=1
scrapy
 scrapy.orgtext/..Scrapy/0.25.0-232-ged84231 (url) en php=hhvm;https=1
 scrapy.orgtext/..Scrapy/0.25.0-232-ged84231 (url) en php=hhvm
 scrapy.orgtext/..Scrapy/0.25.1 (url) en php=hhvm;https=1
 scrapy.orgtext/..Scrapy/0.22.2 (url) en php=hhvm
 scrapy.orgtext/..Scrapy/0.24.4 (url) en php=hhvm;https=1
 scrapy.orgtext/..Scrapy/0.24.4 (url) en php=hhvm
superfeedr
 superfeedr.comapplication/xmlSuperfeedr bot/2.0 url - Make your feeds realtime: get in touch - php=hhvm
 superfeedr.comtext/..Superfeedr bot/2.0 url - Make your feeds realtime: get in touch - php=hhvm
 superfeedr.comapplication/xmlSuperfeedr bot/2.0 url - Make your feeds realtime: get in touch - php=hhvm;https=1
 superfeedr.comtext/..Superfeedr bot/2.0 url - Make your feeds realtime: get in touch - php=hhvm;https=1
zum
 help.zum.com/inquirytext/..ZumBot/1.0 (ZUM Search; url) - php=hhvm
 help.zum.com/inquirytext/..Mozilla/5.0 (compatible; ZumBot/1.0; url) - php=hhvm
 help.zum.com/inquiryimage/..ZumBot/1.0 (ZUM Search; url) - -
uni-leipzig
 corpora.informatik.uni-leipzig.de/crawler_faq.htmltext/..Mozilla/5.0 (compatible; heritrix/3.1.1; UniLeipzigASV url) - php=hhvm
 corpora.informatik.uni-leipzig.de/crawler_faq.htmltext/..Mozilla/5.0 (compatible; heritrix/3.1.1; UniLeipzigASV url) - php=hhvm;https=1
monitis
 www.monitis.comtext/..Mozilla/5.0 (compatible; monitis - premium monitoring service; url) - php=hhvm
 monitis.comtext/..Mozilla/5.0 (compatible; monitis.com - free monitoring service; url) - php=hhvm
majestic12
 www.majestic12.co.uk/bot.php?text/..Mozilla/5.0 (compatible; MJ12bot/v1.4.5; url) en php=hhvm
 www.majestic12.co.uk/bot.php?text/..Mozilla/5.0 (compatible; MJ12bot/v1.4.5; url) - php=hhvm
 www.majestic12.co.uk/bot.php?image/..Mozilla/5.0 (compatible; MJ12bot/v1.4.5; url) - -
recuweb
 recuweb.comapplication/jsonurl en-us,en;q=0.5 php=hhvm;https=1
wordpress
 josefboberg.wordpress.comtext/..WordPress/4.1-beta2-30797; url - php=hhvm
 zeitgeist77.wordpress.comtext/..WordPress/4.1-beta2-30797; url - php=hhvm
 jochenlembke.wordpress.comtext/..WordPress/4.1-beta2-30797; url - php=hhvm
 peripluscd.wordpress.comtext/..WordPress/4.1-beta2-30797; url - php=hhvm
 multiculturalcookingnetwork.wordpress.comtext/..WordPress/4.1-beta2-30797; url - php=hhvm
 urs1798.wordpress.comtext/..WordPress/4.1-beta2-30797; url - php=hhvm
 pageofsunil.wordpress.comtext/..WordPress/4.1-beta2-30797; url - php=hhvm
drupal
 drupal.org/application/jsonDrupal (url) - php=hhvm
 drupal.org/text/..Drupal (url) - php=hhvm
 drupal.org/image/..Drupal (url) - -
yacy
 yacy.net/bot.htmltext/..yacybot (/global; amd64 Linux 3.2.0-4-amd64; java 1.7.0_65; Europe/en) url en-us,en;q=0.5 php=hhvm
 yacy.net/bot.htmltext/..yacybot (/global; amd64 Linux 3.16.7-7-desktop; java 1.8.0_40; Europe/pl) url en-us,en;q=0.5 php=hhvm
 yacy.net/bot.htmltext/..yacybot (/global; amd64 Windows 7 6.1; java 1.8.0_25; Europe/de) url en-us,en;q=0.5 php=hhvm
 yacy.net/bot.htmltext/..yacybot (/global; amd64 Linux 3.16.7-7-desktop; java 1.8.0_40; Europe/pl) url en-us,en;q=0.5 php=hhvm;https=1
 yacy.net/bot.htmltext/..yacybot (/global; amd64 Windows 7 6.1; java 1.8.0_25; Europe/en) url en-us,en;q=0.5 php=hhvm
 yacy.net/bot.htmltext/..yacybot (/global; x86 Windows 7 6.1; java 1.8.0_25; Europe/en) url en-us,en;q=0.5 php=hhvm
 yacy.net/bot.htmltext/..yacybot (/global; amd64 Linux 3.13.0-43-generic; java 1.7.0_65; Etc/en) url en-us,en;q=0.5 php=hhvm
 yacy.net/bot.htmltext/..yacybot (/global; amd64 Linux 3.12.1; java 1.7.0_65; Europe/en) url en-us,en;q=0.5 php=hhvm
 yacy.net/bot.htmltext/..yacybot (/global; i386 Linux 3.16.0-4-686-pae; java 1.7.0_65; Europe/en) url en-us,en;q=0.5 php=hhvm;https=1
 yacy.net/bot.htmltext/..yacybot (/global; i386 Linux 3.16.0-4-686-pae; java 1.7.0_65; Europe/en) url en-us,en;q=0.5 php=hhvm
meteor
 wikimedia.meteor.com/application/jsonWikiMedia Meteor DDP stream (url, mail address ) - php=hhvm
opensiteexplorer
 www.opensiteexplorer.org/dotbottext/..Mozilla/5.0 (compatible; DotBot/1.1; url, mail address ) - php=hhvm
 www.opensiteexplorer.org/dotbotapplication/jsonMozilla/5.0 (compatible; DotBot/1.1; url, mail address ) - php=hhvm
dynotes
 www.dynotes.com/multi-lang-dictionary/application/jsonMLD (WP 7)/1.1.2 (url); mail address - php=hhvm
 www.dynotes.com/multi-lang-dictionary/application/jsonMLD/5.2.2 (url; mail address en-us php=hhvm
 www.dynotes.com/multi-lang-dictionary/application/jsonMLD/5.1.2 (url; mail address en-us php=hhvm
plos
 alm.plos.orgapplication/jsonLagotto 3.11 - url - php=hhvm
 sfo-stage-alm01.int.plos.orgapplication/jsonLagotto 3.9.6 - url - php=hhvm
example
 www.example.com/text/..wikidrain/1.0 (url) - php=hhvm
 example.com/MyCoolToolPage/application/jsonMyCoolTool (url) - php=hhvm
archive
 www.archive.org/details/archive.org_botimage/..Mozilla/5.0 (compatible; special_archiver/3.1.1 url) - -
 www.archive.org/details/archive.org_bottext/..Mozilla/5.0 (compatible; special_archiver/3.1.1 url) - php=hhvm;https=1
 www.archive.org/details/archive.org_bottext/..Mozilla/5.0 (compatible; special_archiver/3.1.1 url) - php=hhvm
 www.archive.org/details/archive.org_botimage/..Mozilla/5.0 (compatible; archive.org_bot url) - -
 archive.org/details/archive.org_botimage/..Mozilla/5.0 (compatible; heritrix/3.3.0-SNAPSHOT-20140702-2247 url) - -
test
 test.co.kr/text/..xxxxxxxx/Nutch-2.2.1 (url) - php=hhvm
flipboard
 flipboard.com/browserproxytext/..Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:28.0) Gecko/20100101 Firefox/28.0 (FlipboardProxy/1.1; url) en-us,en;q=0.5 php=hhvm
 flipboard.com/browserproxyimage/..Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:28.0) Gecko/20100101 Firefox/28.0 (FlipboardProxy/1.6; url) - -
 flipboard.com/browserproxytext/..null (FlipboardProxy/1.1; url) - -
 flipboard.com/browserproxyimage/..null (FlipboardProxy/1.1; url) - -
 flipboard.com/browserproxytext/..Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:28.0) Gecko/20100101 Firefox/28.0 (FlipboardProxy/1.1; url) en-us,en;q=0.5 php=hhvm;https=1
netvibes
 www.netvibes.comtext/..Netvibes (url) - php=hhvm
 www.netvibes.comapplication/jsonNetvibes (url) en-us php=hhvm
 www.netvibes.comapplication/xmlNetvibes (url) - php=hhvm
mysite
 www.mysite.com/application/vnd.php.serializedMyBot/1.0 (url) - php=hhvm
 www.mysite.com/text/..MyBot/1.0 (url) - php=hhvm
 www.mysite.com/application/jsonMyBot/1.0 (url) - php=hhvm
feedly
 www.feedly.com/fetcher.htmlapplication/xmlFeedly/1.0 (url; like FeedFetcher-Google) - php=hhvm
 www.feedly.com/fetcher.htmlapplication/xmlFeedly/1.0 (url; like FeedFetcher-Google) - php=hhvm;https=1
github
 github.com/sparklemotion/mechanize/application/jsonMechanize/2.7.3 Ruby/2.1.0p0 (url) en-us,en;q=0.5 php=hhvm
 github.com/pauldix/feedzirra/tree/masterapplication/xmlfeedzirra url - php=hhvm
 github.com/pauldix/typhoeus/tree/mastertext/..Typhoeus - url - php=hhvm
riddler
 riddler.io/abouttext/..Riddler (url) - php=hhvm
 riddler.io/abouttext/..Riddler (url) - php=hhvm;https=1
wesee
 www.wesee.com/bot/image/..WeSEE:Ads/PictureBot (url) - -
 www.wesee.com/bot/text/..WeSEE:Ads/PageBot (url) - php=hhvm
amzn
 amzn.to/1vsZADitext/..Amazon Route 53 Health Check Service; ref:75c68de8-ca59-474b-a8a5-1bcc0ec34b5d; report url - php=hhvm;https=1
esophoria
 www.esophoria.orgtext/..WordPress/3.4.2; url - php=hhvm
creativecommons
 wiki.creativecommons.org/Metadata_Scrapertext/..CC Metadata Scaper url - php=hhvm
phonifier
 www.phonifier.comtext/..Mozilla/5.0 (compatible; Phonifier; url) - php=hhvm
 www.phonifier.comtext/..Mozilla/5.0 (compatible; Phonifier; url) - php=hhvm;https=1
FeedBurner
 www.FeedBurner.comtext/..FeedBurner/1.0 (url) - php=hhvm
embed
 support.embed.ly/image/..Mozilla/5.0 (compatible; Embedly/0.2; snap; url) - -
 support.embed.ly/text/..Mozilla/5.0 (compatible; Embedly/0.2; url) - php=hhvm
OpenLinkProfiler
 OpenLinkProfiler.org/bottext/..Mozilla/5.0 (compatible; spbot/4.4.2; url ) en-us,en;q=0.5 php=hhvm
 OpenLinkProfiler.org/bottext/..Mozilla/5.0 (compatible; spbot/4.4.2; url ) - php=hhvm
similartech
 www.similartech.com/smtbottext/..Mozilla/5.0 (compatible; SMTBot/1.0; url) - php=hhvm
alexa
 www.alexa.com/site/help/webmasterstext/..ia_archiver (url; mail address ) - php=hhvm
 www.alexa.com/help/webmasterstext/..Mozilla/5.0 (compatible; alexa site audit/1.0; url; mail address ) - php=hhvm
testomato
 www.testomato.com/testomatobottext/..Testomatobot/1.0 (Linux x86_64 url) minicrawler/3.0~beta - php=hhvm
 www.testomato.com/testomatobottext/..Testomatobot/1.0 (Linux x86_64; url) minicrawler/3.0~beta en-US,en,cs;q=0.01 php=hhvm
grapeshot
 www.grapeshot.co.uk/crawler.phptext/..Mozilla/5.0 (compatible; GrapeshotCrawler/2.0; url) - php=hhvm
grouphigh
 www.grouphigh.com/text/..Mozilla/5.0 (compatible; GroupHigh/1.0; url) - php=hhvm
 www.grouphigh.com/text/..Mozilla/5.0 (compatible; GroupHigh/1.0; url) - php=hhvm;https=1
proximic
 www.proximic.com/info/spider.phptext/..Mozilla/5.0 (compatible; proximic; url) - php=hhvm
trendiction
 www.trendiction.de/bottext/..Mozilla/5.0 (Windows; Windows NT 6.0; en-GB; rv:1.0; trendictionbot0.5.0; trendiction search; url; please let us know of any problems; web at trendiction.com) Gecko/20071127 Firefox/3.0.0.11 en-gb,en;q=0.5 php=hhvm
 www.trendiction.de/botimage/..Mozilla/5.0 (Windows; Windows NT 6.0; en-GB; rv:1.0; trendictionbot0.5.0; trendiction search; url; please let us know of any problems; web at trendiction.com) Gecko/20071127 Firefox/3.0.0.11 en-gb,en;q=0.5 -
sanskritdictionary
 www.sanskritdictionary.com/application/vnd.php.serializedUser-Agent: SanskritDictionary/0.1 (url) - php=hhvm
bl
 www.bl.uk/aboutus/legaldeposit/websites/websites/faqswebmaster/index.htmltext/..bl.uk_lddc_bot/3.1.1 (url) - php=hhvm
 www.bl.uk/aboutus/legaldeposit/websites/websites/faqswebmaster/index.htmlimage/..bl.uk_lddc_bot/3.1.1 (url) - -
 www.bl.uk/aboutus/legaldeposit/websites/websites/faqswebmaster/index.htmltext/..bl.uk_lddc_bot/3.1.1 (url) - php=hhvm;https=1
 www.bl.uk/aboutus/legaldeposit/websites/websites/faqswebmaster/index.htmltext/..bl.uk_lddc_bot/3.1.1 (url) - https=1;php=hhvm
2wap
 www.2wap.orgtext/..Mozilla/5.0 (compatible; Phonifier; url) - php=hhvm
saciol
 www.saciol.com/text/..User-Agent: Saciolbot/1.2 (url; mail address - php=hhvm
egerin
 www.egerin.comtext/..crawler (url); Kurdish search engine ku php=hhvm
SearchNearMe
 SearchNearMe.com/contact.phptext/..SearchNearMe (url) - php=hhvm
 SearchNearMe.com/contact.phpapplication/vnd.php.serializedSearchNearMe (url) - php=hhvm
easou
 www.easou.com/search/spider.htmltext/..Mozilla/5.0 (compatible; EasouSpider; url) zh;q=0.9,en;q=0.8 php=hhvm
cdlib
 webarchives.cdlib.org/p/webmasterstext/..Mozilla/5.0 (compatible; cdlwas_bot; heritrix/1.14.1 url) - php=hhvm
 webarchives.cdlib.org/p/webmastersimage/..Mozilla/5.0 (compatible; cdlwas_bot; heritrix/1.14.1 url) - -
zaigar
 lv.zaigar.infotext/..WordPress/3.2.1; url - php=hhvm
datasift
 datasift.com/bot.htmltext/..Mozilla/5.0 (TweetmemeBot/4.0; url) Gecko/20100101 Firefox/31.0 - php=hhvm
searchmetrics
 www.searchmetrics.com/en/searchmetrics-bot/text/..Mozilla/5.0 (compatible; SearchmetricsBot; url) - php=hhvm
bit
 bit.ly/1dJuuzstext/..Seobility (SEO-Check; url) de,en php=hhvm
weblio
 www.weblio.jp/info/crawler.jspimage/..Mozilla/5.0 (compatible; Webliobot/0.1; url) - -
 www.weblio.jp/text/..Mozilla/5.0 (compatible; WeblioBot; url) - php=hhvm
 www.weblio.jp/text/..Mozilla/5.0 (compatible; WeblioBot; url) ja php=hhvm
 www.weblio.jp/info/crawler.jsptext/..Mozilla/5.0 (compatible; Webliobot/0.1; url) - -
bsurprised
 bsurprised.com/text/..BSurprised WikiBox 0.1.3 (url) en
 bsurprised.com/text/..BSurprised WikiBox 0.1.3 (url) it php=hhvm
 bsurprised.com/text/..BSurprised WikiBox 0.1.3 (url) en php=hhvm
 bsurprised.com/text/..BSurprised WikiBox 0.1.3 (url) php=hhvm
wikidict
 www.wikidict.detext/..url - php=hhvm
parsijoo
 www.parsijoo.ir/text/..Mozilla/5.0 (compatible; parsijoo-bot; url; mail address ) - php=hhvm
 www.parsijoo.ir/image/..Mozilla/5.0 (compatible; parsijoo-bot; url; mail address ) - -
rockpeaks
 www.rockpeaks.com/contacttext/..RockPeaks/0.1 (url) -
pinterest
 www.pinterest.com/text/..Pinterest/0.2 (url) - php=hhvm
 www.pinterest.com/image/..Pinterest/0.2 (url) - -
 pinterest.com/image/..Pinterest/0.1 url - -
goo
 help.goo.ne.jp/contact/text/..goo wikipedia (url) - php=hhvm
 search.goo.ne.jp/option/use/sub4/sub4-1/-DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo;url) - php=zend
paper
 support.paper.li/entries/20023257-what-is-paper-litext/..Mozilla/5.0 (compatible; PaperLiBot/2.1; url) en;q=0.8, * php=hhvm
sistrix
 crawler.sistrix.net/text/..Mozilla/5.0 (compatible; SISTRIX Crawler; url) - php=hhvm
 crawler.sistrix.net/text/..Mozilla/5.0 (compatible; SISTRIX Crawler; url) -
scarecrow
 www.scarecrow.com/application/jsonScarecrow/1.0 (url; mail address ) - php=hhvm
crazywebcrawler
 www.crazywebcrawler.comtext/..CRAZYWEBCRAWLER 0.9.2, url - php=hhvm
hatena
 a.hatena.ne.jp/helptext/..Hatena Antenna/0.5 (url) - php=hhvm
metamagazine
 metamagazine.comtext/..WordPress/3.9.2; url -
grammarly
 www.grammarly.comapplication/jsonGrammarly/1.0 (url) - php=hhvm
popularmusicvid
 www.popularmusicvid.com/text/..MyBot/1.0 (url) - php=hhvm
netarkivet
 netarkivet.dk/webcrawlertext/..Mozilla/5.0 (compatible; heritrix/1.14.4 url) - php=hhvm
 netarkivet.dk/webcrawlerimage/..Mozilla/5.0 (compatible; heritrix/1.14.4 url) - -
 netarkivet.dk/webcrawlertext/..Mozilla/5.0 (compatible; heritrix/1.14.4 url) - php=hhvm;https=1
joka02
 joka02.infoimage/..WordPress/4.1; url - -
 joka02.infotext/..WordPress/4.1; url - -
daum
 tab.search.daum.net/aboutWebSearch.htmltext/..Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows server; url) Daumoa/3.0 ko-kr,ko;q=0.8,en-us;q=0.5,en;q=0.3 php=hhvm
okian
 www.okian.ro/text/..MyBot/1.0 (url) - php=hhvm
 www.okian.ro/application/jsonMyBot/1.0 (url) - php=hhvm
thinglink
 www.thinglink.com/application/jsonMozilla/5.0 (compatible; Thinglink/1.0; url, mail address ) - php=hhvm
 www.thinglink.com/help/ThinglinkImageBotimage/..Elmer, the Thinglink ImageBot (url) - -
 www.thinglink.com/help/ThinglinkImageBottext/..Elmer, the Thinglink ImageBot (url) - php=hhvm
spinn3r
 spinn3r.com/robottext/..Mozilla/5.0 (X11; Linux x86_64; en-US; rv:1.9.0.19; aggregator:Spinn3r (Spinn3r 3.1); url) Gecko/2010040121 Firefox/3.0.19 - php=hhvm
pingdom
 www.pingdom.com/text/..Pingdom.com_bot_version_1.4_(url) - php=hhvm
 www.pingdom.comtext/..Pingdom.com_bot_version_1.4_(url) - php=hhvm
colnaghi
 colnaghi.me/wmapplication/jsonWikiMag/1.0 (url) - php=hhvm
gulliway
 gulliway.orgtext/..Mozzila/5.0 (Windows NT 5.1; GulliwayBot/01 url) - php=hhvm
 gulliway.orgapplication/xmlMozzila/5.0 (Windows NT 5.1; GulliwayBot/01 url) - php=hhvm
ireplay
 ireplay.fr/text/..iReplay/1.0 (url) -
loopj
 loopj.com/android-async-httpapplication/jsonandroid-async-http/1.4.4 (url) - php=hhvm
 loopj.com/android-async-httpapplication/jsonandroid-async-http/1.4.4 (url) -
havos
dailyyogavid
 www.dailyyogavid.com/text/..MyBot/1.0 (url) - php=hhvm
image2play
 image2play.com/image/..Mozilla/5.0 (compatible; Image2play/0.1; url) - -
linkdex
 www.linkdex.com/bots/text/..Mozilla/5.0 (compatible; linkdexbot/2.0; url) - php=hhvm
webmeup-crawler
 webmeup-crawler.com/text/..Mozilla/5.0 (compatible; BLEXBot/1.0; url) - php=hhvm
creativepulses
 creativepulses.nlapplication/jsonCreativePulses Crawler (url) - php=hhvm
watchmouse
 watchmouse.com/image/..WatchMouse (url ; HQ) en-us,en;q=0.5 -
tt-rss
 tt-rss.org/application/xmlTiny Tiny RSS/1.15.3 (url) - php=hhvm;https=1
yoursite
 yoursite.com/botinfotext/..Mozilla/5.0 (compatible; YourCoolBot/1.0; url) - php=hhvm
squirro
 intro.squirro.com/squirrobot/text/..squirrobot/1.0 (url) - php=hhvm
 intro.squirro.com/squirrobot/text/..squirrobot/1.0 (url) - php=hhvm;https=1
 intro.squirro.com/squirrobot/image/..squirrobot/1.0 (url) - -
hiergehtslos
 www.hiergehtslos.deimage/..Mozilla/5.0 (Windows NT 6.1; Trident/7.0; url; rv:11.0) like Gecko de-DE -
moviecus
 www.moviecus.com/botcontactinfo.phpapplication/yamlmoviecus bot (url) -
 www.moviecus.com/botcontactinfo.phpapplication/jsonmoviecus bot (url) -
idmarch
 www.idmarch.org/bot.htmltext/..Mozilla/5.0 (compatible; idmarch Automatic.beta/1.2; url) en-us,en-gb,en;q=0.7,*;q=0.3 php=hhvm
inagist
 inagist.comtext/..InAGist URL Resolver (url) en-us,en;q=0.5 php=hhvm
homenet
 dispenser.homenet.org/~dispenser/application/jsonDispensersTools (url) - php=hhvm
 dispenser.homenet.org/~dispenser/text/..DispensersTools (url) - php=hhvm
netseer
 www.netseer.com/crawler.htmltext/..Mozilla/5.0 (compatible; NetSeer crawler/2.0; url; mail address ) - php=hhvm
johnooms
 johnooms.nltext/..WordPress/4.1; url - php=hhvm
duckduckgo
 duckduckgo.com/duckduckbot.htmltext/..DuckDuckBot/1.1; (url) - php=hhvm
verizon
 www.verizon.comapplication/jsonCrawler/1.0 (url; mail address ) Custom/1.0 - php=hhvm
simplepie
 simplepie.orgapplication/xmlSimplePie/1.3.1 (Feed Parser; url; Allow like Gecko) Build/20140530114908 - php=hhvm
stad
 stad.comtext/..Mozilla/5.0 (compatible; stadbot/1.0; url) - php=hhvm
gorgor
 gorgor.irtext/..hivaBot/hivaBot-1.0 (Iranian Search Engine bot; url; mail address ) en-us,en-gb,en;q=0.7,*;q=0.3 php=hhvm
 gorgor.irapplication/jsonhivaBot/hivaBot-1.0 (Iranian Search Engine bot; url; mail address ) - php=hhvm
edu
 ws.nju.edu.cn/falcons/text/..Mozilla/5.0 (compatible; Falconsbot; url) - php=hhvm
 ws.nju.edu.cn/falcons/image/..Mozilla/5.0 (compatible; Falconsbot; url) - -
vk
 vk.com/dev/Sharetext/..Mozilla/5.0 (compatible; vkShare; url) - php=hhvm;https=1
 vk.com/dev/Sharetext/..Mozilla/5.0 (compatible; vkShare; url) -
zeebox
 www.zeebox.comtext/..Zeebox (url) en-us,en;q=0.5 php=hhvm
Anonymouse
 Anonymouse.org/text/..url (Unix) - php=hhvm
 Anonymouse.org/image/..url (Unix) - -
jetsli
 jetsli.de/crawlertext/..Mozilla/5.0 (compatible; Jetslide; url) en-us php=hhvm
topworldvid
 www.topworldvid.com/text/..MyBot/1.0 (url) - php=hhvm
diffbot
 www.diffbot.comtext/..Mozilla/5.0 (Windows; Windows NT 5.1; en-US; rv:1.9.1.2) Gecko/20090729 Firefox/3.5.2 (Diffbot/0.1; url) en-us,en;q=0.5 php=hhvm
site-shot
 www.site-shot.com/image/..Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/534.34 KHTML Chromium/31.0.1650.63 Site-Shot/2.1 (url) Safari/534.34 en-US,* -
knowly
 www.knowly.net/application/jsonUser-Agent: Saciolbot/1.2 (url; mail address - php=hhvm
crowsnest
 www.crowsnest.tv/text/..Crowsnest/0.5 (url) - php=hhvm
rcdtokyo
 www.rcdtokyo.com/pc2m/text/..Mozilla/5.0 (compatible; PEAR HTTP_Request class; url) ja php=hhvm
plagiarismcheck
 plagiarismcheck.orgapplication/jsonWikiCrawl 1.0b (url contact-mail: mail address ) - php=hhvm
qsensei
 feeds.qsensei.comapplication/xmlMozilla/5.0 (compatible; FeedBooster; url) - php=hhvm
 feeds.qsensei.comtext/..Mozilla/5.0 (compatible; FeedBooster; url) - php=hhvm
thecardb
 thecardb.comtext/..theCarDB/1.1 (url; mail address ) - php=hhvm
friedemann-vogel
 friedemann-vogel.de/forschung/konfliktlinguistik-20application/jsonTalksCrawler/2.0 (url) - php=hhvm
picsearch
 www.picsearch.com/bot.htmltext/..psbot-image (url) - php=hhvm
 www.picsearch.com/bot.htmltext/..psbot/0.1 (url) - php=hhvm
ac
 webarchiv.onb.ac.atimage/..Mozilla/5.0 (compatible; htrix/1.14.4 url) - -
wikiapiary
 wikiapiary.com/wiki/User:Bumble_Beeapplication/jsonBumble Bee/1.0 (WikiApiary; url) -
cm-tuguan
 best.cm-tuguan.comtext/..WordPress/4.1; url - php=hhvm
187,049total

Page requests for probable crawlers, recognized by keyword
Count
x 1000		Agent string
  Mime type (count ≥ 3)
Peachy MediaWiki Bot API Version 2.0 (alpha 8) - php=hhvm
 application/vnd.php.serialized
GoogleBot-Image/1.0 - -
 image/..
 text/..
WikiGameBot/0.2 ( mail address ) - php=hhvm
 application/json
php wikibot classes - php=hhvm
 application/vnd.php.serialized
 application/json
 text/..
ClueBot/2.0 - php=hhvm
 application/vnd.php.serialized
LinkParser/2.0 - php=hhvm
 text/..
wikiwix-bot-3.0 - php=hhvm
 text/..
MediaWikiCrawler-Google - php=hhvm
 text/..
 application/json
py-radehh.py/rg11106 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
welcome (wikinews:es; User:Ralgisbot) Pywikibot/2.0b1 (g4173) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
pwb/rg3113 Pywikipediabot/2.0 - php=hhvm;https=1
 application/json
pywikipedia-addzumra.py/r10860 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
 application/xml
pywikipedia-zzfatranslator.py/r10843 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
pywikipedia-newar4ur.py/r10843 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
inspect/r2160 Pywikipediabot/2.0 - php=hhvm;https=1
 application/json
maj_articles_recents (wikipedia:fr; User:ZéroBot) Pywikibot/2.0b3 (g4795) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
welcome (wikipedia:ru; User:Dima_st_bk_bot) Pywikibot/2.0b3 (g3) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
GoogleBot-Image/1.0 - php=hhvm
 text/..
welcome (wikipedia:ru; User:Dima_st_bk_bot) Pywikibot/2.0b3 (g2) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
pywikibot-1newar25.py/rg11120 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
MediaWiki::Bot/3.2.6 - php=hhvm
 application/json
YisouSpider zh-cn,en-us,zh-tw,en-gb,en; php=hhvm
 text/..
addLabel (wikidata:wikidata; User:PLbot) Pywikibot/2.0b3 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
adddescralbum (wikidata:wikidata; User:RobotMichiel1972) Pywikibot/2.0b3 (s5895) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
wymowa (commons:commons; User:Alkamid) Pywikibot/2.0b3 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
HTMLParser/2.0 - php=hhvm
 text/..
AniBot/0.9 php/curl - php=hhvm
 application/vnd.php.serialized
Hoo Bot (https://meta.wikimedia.org/wiki/User:Hoo_man) - php=hhvm;https=1
 application/json
 text/..
Mozilla/5.0 (compatible; OrangeBot/2.0; mail address ) fr; q=1.0, en; q=0.5, *; q=0.1 php=hhvm
 text/..
adddescr (wikidata:wikidata; User:RobotMichiel1972) Pywikibot/2.0b3 (s5895) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
GoogleBot-Image/1.0 - -
 image/..
 text/..
Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.1 KHTML Chrome/21.0.1180.89 Safari/537.1; 360Spider zh-CN php=hhvm
 text/..
unknown Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (Exabot-Thumbnails) en,* -
 image/..
tigerbot - php=hhvm;https=1
 application/json
 text/..
MediaWiki::Bot/5.005006 - php=hhvm
 application/json
addbot (commons:commons; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
Twitterbot/1.0 - php=hhvm
 text/..
DigitalsmithsBot - php=hhvm
 text/..
adddescrauteur (wikidata:wikidata; User:RobotMichiel1972) Pywikibot/2.0b3 (s5895) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
RBot/0.3 ( mail address ) -
 application/json
 image/..
 text/..
pywikibot-compat-commonscat.py/rg11120 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
pywikipedia-newinterwiki-fa.py/rg11077 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
porzucone (wiktionary:pl; User:AlkamidBot) Pywikibot/2.0b3 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
pywikipedia-zz_make_cat.py/rg11084 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
pywikipedia-radeh.py/rg11084 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
DotNetWikiBot/3.11 (Microsoft Windows NT 6.2.9200.0; ) - php=hhvm
 text/..
iw2data/r-1 (unknown) Pywikipediabot/2.0 - php=hhvm;https=1
 application/json
addbot (wikidata:wikidata; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
adddescralbum (wikipedia:en) Pywikibot/2.0b3 (s5895) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
run_pagefromfile.3/r-1 (unknown) Pywikipediabot/2.0 - php=hhvm;https=1
 application/json
UAA-UAA.py/r10417 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
GoogleBot-Video/1.0 - php=hhvm
 text/..
MediaWiki::Bot/3.005002 - php=hhvm
 application/json
PythonWikipediaBot/1.0 - php=hhvm
 application/json
 text/..
welcome (wikipedia:lt; User:Homobot) Pywikibot/2.0b3 (3) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
LTBot en-us,en;q=0.5
 text/..
run_pagefromfile.2/r-1 (unknown) Pywikipediabot/2.0 - php=hhvm;https=1
 application/json
mussol-mussol.py/r-1 (unknown) Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
mrmetadata (wikipedia:en) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
AnomieBOT/1.0 (TagDater; see [[User:AnomieBOT]]) - php=hhvm
 application/json
compat-checkimages.py/rs11096 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
DotNetWikiBot/2.100 (Unix 3.2.0.59; ) - php=hhvm;https=1
 text/..
 application/xml
MediaWiki::Bot/3.1.6 (User:SporkBot) - php=hhvm
 application/json
pywiki-newar25.py/rg11120 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
python-wikitools/1.2 (User:DickensBot) -
 application/json
interwiki (wikinews:es; User:Ralgisbot) Pywikibot/2.0b1 (g4173) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
compat-label_bot.py/rg11051 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
gnd2 (wikidata:wikidata; User:PLbot) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.5.final.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.1 KHTML Chrome/21.0.1180.89 Safari/537.1; 360Spider zh-CN php=hhvm;https=1
 text/..
YisouSpider - php=hhvm
 text/..
 application/json
mrmetadata (commons:commons; User:Seven-League_Bot) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
pywikibot-compat-abi-17-progreso1911.py/rg10993 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
indexer2 (wikipedia:en; User:Legobot) Pywikibot/2.0b3 (g4842) httplib2/0.9 Python/3.4.0.final.0 - php=hhvm;https=1
 application/json
WorldOfMusicBetaBot/1.0 - php=hhvm
 text/..
mail address mail address – MediaWiki Tcl Bot Framework 1.0 - php=hhvm;https=1
 application/json
pywikipedia-com_cat.py/r10809 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
LRI.fr bot mail address - php=hhvm
 application/json
Owlin Bot v. 3.0 - php=hhvm
 text/..
 -
DotNetWikiBot/3.11 (Microsoft Windows NT 6.2.9200.0; ) - php=hhvm;https=1
 text/..
spider - php=hhvm
 text/..
 application/json
GoogleBot (gocrawl v0.4) - php=hhvm
 text/..
pywikibot-compat-aaa_elenco.py/rg10952 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
redirect (wikipedia:en; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
compat-redirect.py/rs11099 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
 text/..
Bub's wikibot (Wikibot/2011111111; JWBF/1.2; Java/1.8) - php=hhvm;https=1
 text/..
refreshfeeds (wikinews:ru; User:AKBot) Pywikibot/2.0b3 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
GermCrawler - php=hhvm
 application/json
 text/..
gsa-crawler (Enterprise; T2-KPTYDNBXJWWKK; mail address ) - php=hhvm;https=1
 text/..
DotNetWikiBot/2.101 (Microsoft Windows NT 6.1.7601 Service Pack 1; ) - php=hhvm
 text/..
MediaWiki::Bot/5.005006 (User:lustiger_seth) - php=hhvm;https=1
 application/json
py-navbox.py/rg11106 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
 application/xml
pywikipedia-interwiki.py/rg18 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
 application/xml
YisouSpider zh-cn,en-us,zh-tw,en-gb,en; php=hhvm;https=1
 text/..
Twitterbot/1.0 - -
 image/..
 text/..
 application/pdf
pywikibot-compat-aaa_categorieAutori.py/rg10952 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
addbot (wikipedia:en; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
unknown Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (Exabot-Thumbnails) en,* php=hhvm
 text/..
 image/..
 application/json
cat_finder-core (wikipedia:fa; User:Rezabot) Pywikibot/2.0b2 (g4582) httplib2/0.8 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
redirect (wikipedia:en; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
ContextAd Bot 1.0 - php=hhvm
 text/..
Spiderbot/Nutch-1.7 en-us,en-gb,en;q=0.7,*;q=0.3 php=hhvm
 text/..
Nutch Spider/Nutch-2.2.1 - php=hhvm
 text/..
pywikipedia-rad1.py/r10582 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (Linux; Android/4.3; zh-CN; SCH-N719 Build/JSS15J) AppleWebKit/533.1 KHTML Version/4.0 YisouSpider/1.0.0 Mobile Safari/533.1 - php=hhvm
 text/..
LTBot en-us,en;q=0.5 php=hhvm;https=1
 text/..
WPendata-importcategoryDEFAULT.py/r11052 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
SineBot/1.5.19(User:SineBot) - php=hhvm
 application/vnd.php.serialized
pywikipedia-commonscat.py/rg10961 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
wymowa (wiktionary:pl; User:AlkamidBot) Pywikibot/2.0b3 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
bot-07-fix-language-mappings (wikidata:wikidata; User:AkkakkBot) Pywikibot/2.0b3 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
addbot (wikipedia:de; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
clean_sandbox (wikinews:es; User:Ralgisbot) Pywikibot/2.0b1 (g4173) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
AnomieBOT/1.0 (PERTableUpdater; see [[User:AnomieBOT]]) - php=hhvm
 application/json
compat-interwiki.py/rg11111 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
 application/xml
TicketsBot/0.1 - php=hhvm
 text/..
svnpywikipedia-interwiki.py/r11270 Pywikipediabot/1.0 - php=hhvm
 application/json
cat_finder-core (wikidata:wikidata; User:Rezabot) Pywikibot/2.0b2 (g4582) httplib2/0.8 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
wikiparser/1 CFNetwork/673.5 Darwin/13.4.0 (x86_64) (MacPro5,1) en-us
 image/..
 text/..
SurakWare MediaWiki Bot/1.0 - php=hhvm;https=1
 text/..
AnomieBOT/1.0 (OrphanReferenceFixer; see [[User:AnomieBOT]]) - php=hhvm
 application/json
adddescrgebouw (wikidata:wikidata; User:RobotMichiel1972) Pywikibot/2.0b3 (s5895) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
Webbot - php=hhvm
 text/..
AnomieBOT/1.0 (FlagIconRemover; see [[User:AnomieBOT]]) - php=hhvm
 application/json
sport (wikipedia:fr; User:NaggoBot) Pywikibot/2.0b2 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
pywikipedia3-MakeScoreTable_test3.py/r11448 Pywikipediabot/1.0 - php=hhvm
 application/json
DotNetWikiBot/2.102 (Microsoft Windows NT 6.2.9200.0; ) - php=hhvm;https=1
 text/..
 application/xml
pywikipedia3-MakeScoreTable_10000.py/r11448 Pywikipediabot/1.0 - php=hhvm
 application/json
CorenSearchBot/1.7 en libwww-perl/6.05 - php=hhvm;https=1
 text/..
MyCuteBot/0.1 - php=hhvm
 text/..
SearchBot/Nutch-1.9 en-us,en-gb,en;q=0.7,*;q=0.3 php=hhvm
 text/..
AnomieBOT/1.0 (TemplateSubster; see [[User:AnomieBOT]]) - php=hhvm
 application/json
Bot at mysite.com - php=hhvm
 text/..
py-interwiki.py/rg11047 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
welcome-c (wikipedia:fr; User:Loveless) Pywikibot/2.0b2 (g4566) httplib2/0.9 Python/2.7.6.final.0 - php=hhvm;https=1
 application/json
GoogleBot/Nutch-1.9-SNAPSHOT en-us,en-gb,en;q=0.7,*;q=0.3 php=hhvm
 text/..
GoogleBot-Image/1.0 - https=1;php=hhvm
 text/..
Mozilla/5.0 (compatible; uMBot-LN/1.0; mailto: mail address ) - php=hhvm
 text/..
redirect (wikinews:es; User:Ralgisbot) Pywikibot/2.0b1 (g4173) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
compat-redirect.py/rg10957 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
ifd-hoobot (wikidata:wikidata; User:PLbot) Pywikibot/2.0b3 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
GoogleBot-Video/1.0 - -
 application/ogg
SPIupdater-globalfunc.py/r10417 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
dikantenyvaovao (wiktionary:mg; User:Bot-Jagwar) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (Linux; Android/4.3; zh-CN; SCH-N719 Build/JSS15J) AppleWebKit/533.1 KHTML Version/4.0 YisouSpider/1.0.0 Mobile Safari/533.1 zh-cn,en-us,zh-tw,en-gb,en; php=hhvm
 text/..
Mozilla/5.0 (Linux; Android/4.2.2; es-es; CUBOT P9 Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 es-ES, en-US -
 image/..
pywikipedia-zzfawikipatroler.py/rg11084 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
DotNetWikiBot/2.103 (Microsoft Windows NT 6.1.7601 Service Pack 1; ) - php=hhvm;https=1
 text/..
 application/xml
GoogleBot-Image/1.0 - php=hhvm;https=1
 text/..
pywikipedia-zzpurging.py/rg11084 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (Linux; Android/4.2.1; es-es; CUBOT ONE Build/JOP40D) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 es-ES, en-US -
 image/..
Peachy MediaWiki Bot API Version 1.0 - php=hhvm
 application/vnd.php.serialized
node-crawler/0.2.5 - php=hhvm
 text/..
pwb/rg3009 Pywikipediabot/2.0 - php=hhvm;https=1
 application/json
GoogleBot/Nutch-1.7 en-us,en-gb,en;q=0.7,*;q=0.3 php=hhvm
 text/..
ko_newpage/r-1 (unknown) Pywikipediabot/2.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (X11; compatible; semantic-visions.com crawler; HTTPClient 3.1) - php=hhvm
 text/..
mrmetadata (wikipedia:de) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
DotNetWikiBot/2.100 (Unix 3.2.0.60; ) - php=hhvm;https=1
 text/..
 application/xml
Twitterbot/1.0 - php=hhvm;https=1
 text/..
pywikipedia-zzaddnavebox.py/rg11084 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
gsa-crawler (Enterprise; T2-KPTYDNBXJWWKK; mail address ) - php=hhvm
 text/..
moveClaims (wikidata:wikidata; User:PLbot) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.5.final.0 - php=hhvm;https=1
 application/json
addbot (wikipedia:ru; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (Linux; Android/4.2.2; en-us; CUBOT P9 Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 en-US -
 image/..
pywikibot-compat-dobrodoslice.py/rg11089 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (compatible; uMBot-FC/1.0; mailto: mail address ) - php=hhvm
 text/..
addbot (wikipedia:it; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
My Nutch Spider/Nutch-2.2.1 - php=hhvm
 text/..
redirect (wikipedia:nl; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
FP (commons:commons; User:SteinsplitterBot) Pywikibot/2.0b2 httplib2/0.8 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (Apibot Browser) - -
 image/..
unknown Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (Exabot-Thumbnails) en;q=0.9,*;q=0.8 php=hhvm
 text/..
mrmetadata (wikipedia:ru) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
mrmetadata (wikipedia:id) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
YandexExtdataBot/1.0 ( mail address ) - php=hhvm
 application/json
redirect (wikipedia:sv; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
BeneBot*/1.0 WikibasePhpLib/0.1 - php=hhvm
 application/json
fixing_redirects (wikipedia:sr; User:MilicevicBot) Pywikibot/2.0b2 (3) httplib2/0.9 Python/2.7.6.final.0 - php=hhvm;https=1
 application/json
com.apple.Safari.WebFeedParser/600.1.4 CFNetwork/711.1.16 Darwin/14.0.0 en-us php=hhvm
 application/xml
RSS Bot/1.9 (Mac OS X Version 10.10.1 (Build 14B25)) en;q=1 php=hhvm;https=1
 application/xml
category_redirect (wikipedia:ar; User:ZkBot) Pywikibot/2.0b3 (g4872) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
addbot (wikipedia:fr; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
AnomieBOT/1.0 (DeletionSortingCleaner; see [[User:AnomieBOT]]) - php=hhvm
 application/json
Wikibot/2.1.1 CFNetwork/711.1.16 Darwin/14.0.0 en-us -
 image/..
php wikibot classes - php=hhvm;https=1
 application/vnd.php.serialized
Mozilla/5.0 (Linux; Android/4.3; ru-ru; Spider Build/JLS36C) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 ru-RU, en-US -
 image/..
Mozilla/5.0 (Linux; Android/4.2.2; it-it; CUBOT P9 Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 it-IT, en-US -
 image/..
DotNetWikiBot/2.101 (Unix 3.1.9.0; ) - php=hhvm;https=1
 text/..
Mozilla/5.0 (Linux; Android/4.2.2; de-de; CUBOT P9 Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 de-DE, en-US -
 image/..
redirect (wikipedia:nl; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
pywikibot-compat-sichteroptin.py/r10883 Pywikipediabot/1.0 - php=hhvm;https=1
 text/..
 application/json
PHPCrawl - php=hhvm
 text/..
Mozilla/5.0 (Linux; Android/4.2.2; es-es; CUBOT X6 Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 es-ES, en-US -
 image/..
AnomieBOT/1.0 (BAGBot; see [[User:AnomieBOT]]) - php=hhvm
 application/json
 text/..
t9/rg2816 Pywikipediabot/2.0 - php=hhvm;https=1
 application/json
mrmetadata (wikipedia:it) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
addbot (wikipedia:es; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
ArchiveTeam ArchiveBot/20141230.01 (wpull 0.1005a1) and not Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 KHTML Chrome/39.0.2171.95 Safari/537.36 - php=hhvm
 text/..
dikantenyvaovao (wiktionary:en) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (Linux; Android/4.2.1; en-us; CUBOT ONE Build/JOP40D) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 en-US -
 image/..
redirect (wikipedia:fr; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
canvi (wikipedia:ca; User:JoRobot) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
addbot (wikipedia:pt; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
redirect (wikipedia:vi; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
vm-auto-erl-neu (wikipedia:de; User:Xqbot) Pywikibot/2.0b3 (s5878) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
pywikipedia-bot_rss.py/rg14444 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
addbot (wikipedia:fa; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
addbot (wikipedia:sv; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (compatible; MojeekBot/0.6; https://www.mojeek.com/bot.html) - php=hhvm
 text/..
robospider/1.0 - php=hhvm
 text/..
pywikipedia-zziwneededpage.py/rg11084 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
compat-pwb.py/rg11092 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
 text/..
Mozilla/5.0 (Linux; Android/4.2.1; de-de; CUBOT ONE Build/JOP40D) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 de-DE, en-US -
 image/..
addbot (wikipedia:tr; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
pywikipedia-amb_mehrdadbot.py/r2 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
AnomieBOT/1.0 (RandomPagePicker; see [[User:AnomieBOT]]) - php=hhvm
 application/json
EarwigBot/0.2.devgit-b87d5ac6 (Python/2.7.3; https://github.com/earwig/earwigbot; mail address ) - php=hhvm;https=1
 application/json
addbot (wikipedia:ca; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
MoodleBot/1.0 -
 text/..
 application/xml
RokaSpider/Nutch-1.9 (' mail address ') de-de,de,en-us,en-gb,en;q=0.7,*;q=0.3 php=hhvm
 text/..
Update_cats_and_iwiki (commons:commons) Pywikibot/2.0b3 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
redirect (wikipedia:sv; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
Goalkeeperbot(User:Beetstra)/1.0 - php=hhvm
 text/..
bar (wikipedia:it; User:IncolaBot) Pywikibot/2.0b3 (g2) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
milog_bot/1.0 ( mail address ) - php=hhvm
 text/..
YOUBot (Youniversal Media Bot) - php=hhvm
 text/..
redirect (wikipedia:es; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
pywikipedia-wikifyer.py/rg11084 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
YOUBot (Youniversal Media Bot) - -
 image/..
"Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534 KHTML MsnBot-Media /1.0b" en-US -
 image/..
MoodleBot/1.0 - php=hhvm
 application/xml
 text/..
 application/vnd.php.serialized
Mozilla/5.0 (Linux; Android/4.2.1; it-it; CUBOT ONE Build/JOP40D) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 it-IT, en-US -
 image/..
Mozilla/5.0 (Linux; Android/4.2.1; es-es; CUBOT GT99 Build/JOP40D) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 es-ES, en-US -
 image/..
mrmetadata (wikipedia:fr) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
redirect/-1 (unknown) Pywikibot/2.0 (User:Rahl43bot) - php=hhvm;https=1
 application/json
redirect (wikipedia:pt; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
addbot (wikipedia:cs; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
adddescralbum (wikipedia:nl; User:RobotMichiel1972) Pywikibot/2.0b3 (s5895) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
MWFeedParser de-de php=hhvm;https=1
 application/xml
tdrx-location-image-crawler: one-time crawl, about 100,000 images; please contact mail address and temporarily block if this causes any inconvenience to the site. I am using a single thread. - -
 image/..
SearchBot/Nutch-1.9 en-us,en-gb,en;q=0.7,*;q=0.3 php=hhvm;https=1
 text/..
Inlibris.com XMLBot/1.0 - php=hhvm
 text/..
Mozilla/5.0 (Linux; Android/4.2.1; it-it; CUBOT GT99 Build/JOP40D) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 it-IT, en-US -
 image/..
update-regular-users (wikipedia:en; User:SuggestBot) Pywikibot/2.0b2 httplib2/0.9 Python/2.7.1.final.0 - php=hhvm;https=1
 application/json
pywikibot-compat-redirect.py/rg10993 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
redirect (wikipedia:pl; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
botpywi-analyse_article.py/rg11108 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
redirect (wikipedia:es; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
setup (wikipedia:en; User:Pywikibot-test) Pywikibot/2.0b3 (g1784) httplib2/0.9 Python/2.6.9.final.0 - php=hhvm;https=1
 application/json
pywikilab-llista_mils.py/r-1 (unknown) Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
p3 (wikipedia:en; User:InwBot) Pywikibot/2.0b2 httplib2/0.9 Python/2.7.8.final.0 - php=hhvm;https=1
 application/json
wikt-es-nom-forma.py/rg10914 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
GoogleBot-Image/1.0 - php=hhvm
 text/..
harvest_template (wikidata:wikidata; User:BotMultichill) Pywikibot/2.0b3 (g4813) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
com.apple.Safari.WebFeedParser/600.1.4 CFNetwork/711.1.16 Darwin/14.0.0 ja-jp php=hhvm
 application/xml
 text/..
addbot (wikipedia:pl; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
touch (wikipedia:sr; User:MilicevicBot) Pywikibot/2.0b2 (3) httplib2/0.9 Python/2.7.6.final.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (Linux; Android/4.2.2; de-de; CUBOT GT72E Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 de-DE, en-US -
 image/..
PythonWikipediaBot/1.0 - php=hhvm;https=1
 text/..
redirect (wikipedia:zh; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
redirect (wikipedia:war; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
mrmetadata (wikipedia:ja) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
archiv-erl-bot (wikipedia:de; User:SpBot) Pywikibot/2.0b2 (g4674) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
redirect (wikipedia:fr; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
rapid-miner-crawler - php=hhvm
 text/..
DotNetWikiBot/2.101 (Microsoft Windows NT 6.1.7601 Service Pack 1; ) - php=hhvm;https=1
 application/xml
 text/..
XLinkBot/1.00 - php=hhvm
 text/..
Mozilla/5.0 (Linux; Android/4.2.2; de-de; CUBOT X6 Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 de-DE, en-US -
 image/..
redirect (wikipedia:ja; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
transferbot (wikipedia:co) Pywikibot/2.0b2 (g4618) httplib2/0.9 Python/2.7.8.final.0 - php=hhvm;https=1
 application/json
addbot (wikipedia:nl; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
mrmetadata (wikipedia:uk) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
redirect (wikipedia:it; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
redirect (wikipedia:ru; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
redirect (wikipedia:no; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (Linux; Android/4.2.2; en-us; CUBOT GT72E Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 en-US -
 image/..
create_gregorian_date_pages (wikinews:bs) Pywikibot/2.0b3 (g4864) httplib2/0.9 Python/2.7.5.final.0 - php=hhvm;https=1
 application/json
redirect (wikipedia:vi; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
CaBot Script (running on nightshade.toolserver.org) - php=hhvm
 application/vnd.php.serialized
6951784 (commons:commons; User:RussBot) Pywikibot/2.0b3 (g3) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
redirect (wikipedia:de; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
badge_good_new (wikipedia:en; User:Dexbot) Pywikibot/2.0b2 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
AnomieBOT/1.0 (AFDMergeFromCleaner; see [[User:AnomieBOT]]) - php=hhvm
 application/json
adddescrauteur (wikipedia:en) Pywikibot/2.0b3 (s5895) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
getpages (wikipedia:de; User:Wolfgang_Liebig) Pywikibot/2.0b2 (-1 (unknown)) httplib2/0.8 Python/2.7.8.final.0 - php=hhvm;https=1
 application/json
addbot (wikipedia:la; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
cd-delinker.py/r11775 Pywikipediabot/1.0 - php=hhvm
 application/json
dikantenyvaovao (wiktionary:ca) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
dikantenyvaovao (wiktionary:pl) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko; Google Page Speed Insights) Chrome/27.0.1453 Safari/537.36 GoogleBot/2.1 - -
 image/..
mrmetadata (wikipedia:ro) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
Dalvik/1.6.0 (Linux; Android/4.2.1; CUBOT ONE Build/JOP40D) - -
 image/..
 text/..
webcrawler - php=hhvm
 text/..
CheMoBot/1.00 - php=hhvm
 text/..
Mozilla/5.0 (compatible; MyBot/1.0;) -
 application/json
redirect (wikipedia:war; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
redirect (wikipedia:de; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
RSS Bot/1.9 (Mac OS X Version 10.10.1 (Build 14B25)) en;q=1 php=zend;https=1
 -
Webwiki Search Engine Bot - www.webwiki.de - php=hhvm
 text/..
replace (wikipedia:fr; User:Escarbot) Pywikibot/2.0b3 (g4872) httplib2/0.9 Python/2.7.9.final.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (Linux; Android/4.3; Spider Build/JLS36C) AppleWebKit/537.36 KHTML Chrome/39.0.2171.93 Mobile Safari/537.36 ru-RU,ru;q=0.8,en-US;q=0.6,en;q=0.4 -
 image/..
bitlybot - php=hhvm
 text/..
dikantenyvaovao (wiktionary:ko) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
('python-wikitools/1.1.1 (User:GrantsBot)',) - php=hhvm
 application/json
Peachy MediaWiki Bot API Version 2.0 (alpha 8) - php=hhvm;https=1
 application/vnd.php.serialized
 text/..
Mozilla/5.0 (Linux; Android/4.2.2; it-it; S308 Build/CUBOT) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 it-IT, en-US -
 image/..
User-Agent Baiduspider - php=hhvm
 text/..
COIBot/1.00 - php=hhvm
 text/..
g13bot_tools-g13_nudge_bot.py/r-1 (unknown) Pywikipediabot/1.0 - php=hhvm
 application/json
BuiBui-Bot/1.0 (3m4il: buibui[dot]bot[à7]moquadv[dot]com) - php=hhvm
 text/..
redirect (wikipedia:ja; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
addbot (wikipedia:sh; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
ArchiveTeam ArchiveBot/20141229.01 (wpull 0.1005a1) and not Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 KHTML Chrome/39.0.2171.95 Safari/537.36 * -
 image/..
create_gregorian_date_pages (wikidata:wikidata; User:Mjbmrbot) Pywikibot/2.0b3 (g4864) httplib2/0.9 Python/2.7.5.final.0 - php=hhvm;https=1
 application/json
dikantenyvaovao (wiktionary:hu) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (Linux; Android/4.2.2; ru-ru; CUBOT X6 Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 ru-RU, en-US -
 image/..
pywikipedia-zzgallery.py/rg11084 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
com.apple.Safari.WebFeedParser/600.1.4 CFNetwork/711.1.12 Darwin/14.0.0 en-us php=hhvm
 application/xml
 text/..
MaxPointCrawler/Nutch-1.1 (maxpoint.crawler at maxpointinteractive dot com) en-us,en-gb,en;q=0.7,*;q=0.3 php=hhvm
 text/..
"Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534 KHTML MsnBot-Media /1.0b" - -
 image/..
redirect (wikipedia:zh; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
DotNetWikiBot/2.102 (Microsoft Windows NT 6.1.7601 Service Pack 1; ) - php=hhvm;https=1
 text/..
 application/xml
COIBot/2.0 - php=hhvm
 text/..
addbot (wikipedia:uk; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
addbot (wikipedia:ar; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
mrmetadata (wikipedia:gl) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
ifd-empty (wikidata:wikidata; User:PLbot) Pywikibot/2.0b3 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
addbot (wikipedia:eo; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (Linux; Android/4.2.1; CUBOT GT99 Build/JOP40D) AppleWebKit/535.19 KHTML Chrome/18.0.1025.166 Mobile Safari/535.19 es-ES,es;q=0.8 -
 image/..
mail address mail address – MediaWiki Tcl Bot Framework 0.5 - php=hhvm;https=1
 application/json
badge_good_new (wikipedia:el; User:Dexbot) Pywikibot/2.0b2 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
Yeobot/1.1 Contact: mail address ) - php=hhvm
 text/..
mrmetadata (wikipedia:fi) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
badge_good_new (wikidata:wikidata; User:Dexbot) Pywikibot/2.0b2 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (Linux; Android/4.2.2; en-us; S222 Build/CUBOT) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 en-US -
 image/..
WikiBot/0.1 - php=hhvm
 text/..
Webwiki Search Engine Bot - www.webwiki.de -
 text/..
redirect (wikipedia:ko; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
DotNetWikiBot/3.12 (Unix 3.2.0.59; ) - php=hhvm;https=1
 text/..
AnomieBOT/1.0 (NewArticleAFDTagger; see [[User:AnomieBOT]]) - php=hhvm
 application/json
SNK Screenshot Bot/0.20 ( mail address ) en,* -
 image/..
TFAdefenderbot/rg3077 Pywikipediabot/2.0 - php=hhvm;https=1
 application/json
RavenCrawler - php=hhvm
 text/..
My bot mail address - php=hhvm
 text/..
MediaWiki::Bot/dev - php=hhvm
 application/json
redirect (wikipedia:ar; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
addbot (wikipedia:vi; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
addbot (wikipedia:hu; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
cocytus-output (wikidata:wikidata) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.6.final.0 - php=hhvm;https=1
 application/json
mrmetadata (wikipedia:lt) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 MaboMwFramework/1.2 (w:de:MerlBot) - php=hhvm
 text/..
Mozilla/5.0 (Linux; Android/4.2.2; fr-fr; CUBOT P9 Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 fr-FR, en-US -
 image/..
node.js - nodemw - mail address - Maintainer: Rainer Rillke - mail address - [[:commons:User:Rillke]] - php=hhvm
 application/json
AnomieBOT/1.0 (BAGBot; see [[User:AnomieBOT]]) - php=hhvm;https=1
 text/..
create_gregorian_date_pages (wikinews:he) Pywikibot/2.0b3 (g4864) httplib2/0.9 Python/2.7.5.final.0 - php=hhvm;https=1
 application/json
addbot (wikipedia:fi; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
pagefromfile (wikisource:en; User:MpaaBot) Pywikibot/2.0b3 (g4863) httplib2/0.9 Python/2.7.6.final.0 - php=hhvm;https=1
 application/json
addbot (wikipedia:war; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
mrmetadata (wikipedia:sr) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
cat (wikipedia:pt; User:Alch_Bot) Pywikibot/2.0b3 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (Linux; Android/4.2.2; de-de; S308 Build/CUBOT) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 de-DE, en-US -
 image/..
Wikibot/2.1.1 CFNetwork/672.1.15 Darwin/14.0.0 en-us -
 image/..
Mozilla/5.0 (Linux; Android/4.2.2; en-us; S308 Build/CUBOT) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 en-US -
 image/..
mrmetadata (wikipedia:th) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
dikantenyvaovao (wiktionary:de) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
geni 3.0-bot.py/r-1 (unknown) Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
redirect (wikipedia:pl; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
request-daemon (wikipedia:sv; User:FörslagsBot) Pywikibot/2.0b2 httplib2/0.9 Python/2.7.1.final.0 - php=hhvm;https=1
 application/json
bible-genealogy (wikidata:wikidata; User:Karan85) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.8.final.0 - php=hhvm;https=1
 application/json
sandbot/r2631 Pywikipediabot/2.0 - php=hhvm;https=1
 application/json
ArchiveTeam ArchiveBot/20141229.01 (wpull 0.1005a1) and not Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 KHTML Chrome/39.0.2171.95 Safari/537.36 - -
 image/..
com.apple.Safari.WebFeedParser/600.1.4 CFNetwork/711.1.16 Darwin/14.0.0 zh-cn php=hhvm
 text/..
 application/xml
newitem (wikidata:wikidata; User:JAnDbot) Pywikibot/2.0b3 (s5906) httplib2/0.8 Python/2.7.6.final.0 - php=hhvm;https=1
 application/json
ifd-category (wikidata:wikidata; User:PLbot) Pywikibot/2.0b3 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
addbot (wikipedia:nn; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
mrmetadata (wikipedia:he) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
Screaming Frog SEO Spider/2.55 - php=hhvm
 text/..
redirect (wikipedia:hu; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
PseudoBot (based on perl 5.010001 and MediaWiki::Bot 5.005006) - php=hhvm
 application/json
redirect (wikipedia:new; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
redirect (wikipedia:eo; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
mrmetadata (wikipedia:ms) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
erfgoedbot-update_database.py/rg10979 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
 application/xml
Mozilla/5.0 (Linux; Android/4.2.2; de-at; CUBOT X6 Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 de-AT, en-US -
 image/..
redirect (wikipedia:ms; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (Linux; Android/4.2.2; de-de; CUBOT P9 Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 de-DE, en-US
 image/..
 -
create_gregorian_date_pages (wikinews:cs) Pywikibot/2.0b3 (g4864) httplib2/0.9 Python/2.7.5.final.0 - php=hhvm;https=1
 application/json
dikantenyvaovao (wiktionary:te) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (Linux; Android/4.2.2; fa-ir; GLX SpiderI Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 fa-IR, en-US -
 image/..
Mozilla/5.0 (Linux; Android/4.2.2; en-us; CUBOT P9 Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 en-US php=hhvm
 text/..
 image/..
dikantenyvaovao (wiktionary:es) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
datetemplates (wikipedia:en; User:Cerabot) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
create_gregorian_date_pages (wikinews:ko) Pywikibot/2.0b3 (g4864) httplib2/0.9 Python/2.7.5.final.0 - php=hhvm;https=1
 application/json
pywikipedia-clean_sandbox.py/r10582 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
addbot (wikipedia:ko; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
badge_new (wikipedia:el; User:Dexbot) Pywikibot/2.0b2 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
Phantom.js bot cs-CZ,en,* -
 image/..
bot-loose_category_from_gallery.py/rg10972 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (compatible; uMBot-IC/1.0; mailto: mail address ) - php=hhvm
 application/xml
 text/..
dikantenyvaovao (wiktionary:ml) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
mrmetadata (wikipedia:fa) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
create_gregorian_date_pages (wikinews:sr) Pywikibot/2.0b3 (g4864) httplib2/0.9 Python/2.7.5.final.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (Linux; Android/4.2.2; it-it; CUBOT P9 Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 it-IT, en-US php=hhvm
 text/..
 application/json
com.apple.Safari.WebFeedParser/600.1.4 CFNetwork/711.1.16 Darwin/14.0.0 es-es php=hhvm
 application/xml
 text/..
redirect (wikipedia:it; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
BOT/0.1 (BOT for JCE) - php=zend
 text/..
AnomieBOT/1.0 (PUICloser; see [[User:AnomieBOT]]) - php=hhvm
 application/json
dikantenyvaovao (wiktionary:sv) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
Wikibot/2.1.3 CFNetwork/711.1.16 Darwin/14.0.0 en-us -
 image/..
cocytus-output (commons:commons) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.6.final.0 - php=hhvm;https=1
 application/json
dikantenyvaovao (wiktionary:fr; User:Bot-Jagwar) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
addbot (wikipedia:lv; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
mjbmrbot-most_viewed_articles.py/rg11110 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
mrmetadata (wikipedia:vi) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
create_gregorian_date_pages (wikinews:en; User:Mjbmrbot) Pywikibot/2.0b3 (g4864) httplib2/0.9 Python/2.7.5.final.0 - php=hhvm;https=1
 application/json
create_gregorian_date_pages (wikinews:fa; User:Mjbmrbot) Pywikibot/2.0b3 (g4864) httplib2/0.9 Python/2.7.5.final.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (compatible; SputnikImageBot/2.2) - -
 text/..
pywikipedia-replace.py/r11775 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
pywikibot-compat-reportBLP.py/r10494 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
ArchiveTeam ArchiveBot/20141230.01 (wpull 0.1005a1) and not Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 KHTML Chrome/39.0.2171.95 Safari/537.36 - -
 image/..
Baidu-YunGuanCe-Bot(ce.baidu.com) zh-CN,zh;q=0.8,zh-TW;q=0.6 php=hhvm
 text/..
notabilityCheck (wikidata:wikidata; User:PLbot) Pywikibot/2.0b3 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
redirect (wikipedia:ceb; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
setup (wikipedia:en; User:Pywikibot-test) Pywikibot/2.0b3 (g1855) httplib2/0.9 Python/2.7.9.final.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (Linux; Android/4.2.2; es-es; S308 Build/CUBOT) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 es-ES, en-US -
 image/..
mrmetadata (wikiversity:en) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
39,802total

IP ranges: known ip ranges for Google are 64.233.[160.0-191.255], 66.249.[64.0-95.255], 66.102.[0.0-15.255], 72.14.[192.0-255.255],
74.125.[0.0-255.255], 209.085.[128.0-255.255], 216.239.[32.0-63.255] and a few minor other subranges

Errata: WMF traffic logging service suffered from server capacity problems in Aug/Sep/Oct 2011.
Absolute traffic counts for October 2011 are approximatly 7% too low.
Data loss only occurred during peak hours. It therefore may have had somewhat different impact for traffic from different parts of the world.
and may have also skewed relative figures like share of traffic per browser or operating system.

From mid September till late November squid log records for mobile traffic were in invalid format.
Data could be repaired for logs from mid October onwards. Older logs were no longer available.

In a an unrelated server outage precisely half of traffic to WMF mobile sites was not counted from Oct 16 - Nov 29 (one of two load-balanced servers did not report traffic).
WMF has since improved server monitoring, so that similar outages should be detected and fixed much faster from now on.

Generated on Wed, Apr 8, 2015 16:28
Author:Erik Zachte (Web site)
Mail: ezachte@### (no spam: ### = wikimedia.org)
All data and images on this page are in the public domain.

Note: page may load slower on Microsoft Internet explorer than on other major browsers