Wikimedia Traffic Analysis Report - Crawler requests

Monthly requests or daily averages, for period: 1 Jan 2015 - 1 Jan 2015
000 ⇒ k
 

 This analysis is based on a 1:1000 sampled server log (squids)

 Other reports:
 Requests: Destination/Mime - Origin - Methods - Scripts - User agents - Skins - Crawlers - Op.Sys. - Browsers - Google - Country data

 Notes on reliability of these data

 Unresolved Bugzilla bugs: 46190, 46191, 46195, 46201, 46265, (46267), 46268, 46269, 46271, 46273, 46274, 46275, 46277, 46278, 46279, 57376

The following overview of crawler (aka bot) page requests is based on the user agent information that accompanies most server requests. Unfortunately this user agent information follows rather loosely defined guidelines.
Also please bear in mind than the most popular crawler names may be somewhat overrepresented. This is the result of so called user agent spoofing (where a requester supplies false credentials, e.g. to bypass web servers filters).
GoogleBot seems to be a favorite for spoofing. Therefore requests from an ip address registered by Google (see below) are color coded GoogleBot, others GoogleBot

For this report page requests are considered to be issued by a crawler in two cases:
1 The user agent string contains a web address (only crawlers should have that, but there a some false positives, where a browser sends a user agent string with a web address (ill behaved plug-in, main offenders have been eliminated)
2 The user agent string contains the term bot, spider or crawl[er]'

In total 148,508,000 page requests (mime type text/html only!) per day are considered crawler requests, out of 640,052,000 external requests, which is 23.2%

Page requests for crawlers that specify a url in the agent string
Count
x 1000
Secondary domain
(~site) name
URLMime typeUser agent
bing
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) - php=hhvm;https=1 (null)
 www.bing.com/bingbot.htmimage/..Mozilla/5.0 (compatible; bingbot/2.0; url) - -
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) - https=1;php=hhvm (null)
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 KHTML Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; url) - php=hhvm
 www.bing.com/bingbot.htm-Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 KHTML Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; url) - php=zend
 www.bing.com/bingbot.htmimage/..Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 KHTML Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; url) - -
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) - -
 www.bing.com/bingbot.htmimage/..Mozilla/5.0 (compatible; bingbot/2.0; url) - - (null)
 www.bing.com/bingbot.htmtext/..54.241.179.159 Mozilla/5.0 (compatible; bingbot/2.0; url) - php=hhvm;https=1 (null)
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 KHTML Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; url) - https=1;php=hhvm (null)
 www.bing.com/bingbot.htmtext/..10.23.42.20 Mozilla/5.0 (compatible; bingbot/2.0; url) (via Web-Blaster/2.21 (http://www.a-blast.org/web-blast.html)) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~surf603-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~proxy6009-hrd) - php=hhvm
 www.bing.com/bingbot.htm-Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 KHTML Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; url) - php=zend;https=1 (null)
 www.bing.com/bingbot.htmapplication/jsonMozilla/5.0 (compatible; bingbot/2.0; url) - php=hhvm
 www.bing.com/bingbot.htmtext/..54.215.150.37 Mozilla/5.0 (compatible; bingbot/2.0; url) - php=hhvm;https=1 (null)
 www.bing.com/bingbot.htmtext/..10.23.42.20 Mozilla/5.0 (compatible; bingbot/2.0; url) (via Web-Blaster/2.21 (http://www.assoziations-blaster.de/web-blast.html)) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) WikipediaAPI - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~proxydisk-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~they-encounter-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~surfproxy6-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~surf301-hrd) - php=hhvm
 www.bing.com/bingbot.htmimage/..Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 KHTML Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; url) - - (null)
 www.bing.com/bingbot.htmtext/..54.215.150.33 Mozilla/5.0 (compatible; bingbot/2.0; url) - php=hhvm;https=1 (null)
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) - php=hhvm;https=1
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~earningses-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~swedishdanish-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~ddbrite-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..54.215.148.134 Mozilla/5.0 (compatible; bingbot/2.0; url) - php=hhvm;https=1 (null)
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) - https=1;php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 KHTML Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; url) - -
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~flyproxy0-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~cgiproxy3-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~guidesites-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~guidesites-hrd) - php=hhvm;https=1 (null)
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~proxy6001-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~yourrevenues-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~proxydisk9-hrd) - php=hhvm
 www.bing.com/bingbot.htmapplication/oggMozilla/5.0 (compatible; bingbot/2.0; url) - -
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~proxy5090-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~proxyfile8-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~usethisproxy-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: my-api) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~payonlyproxy-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~appcodes-hrd) - php=hhvm
 www.bing.com/bingbot.htmapplication/xmlMozilla/5.0 (compatible; bingbot/2.0; url) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~proxy-py-hrd) - php=hhvm
 www.bing.com/bingbot.htmtext/..Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: s~proxy6000-hrd) - php=hhvm
google
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) - php=hhvm
 www.google.com/bot.htmltext/..Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot/2.1; url) - php=hhvm
 www.google.com/bot.html-Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot/2.1; url) - php=zend
 code.google.com/p/crawler4j/text/..crawler4j (url) - php=hhvm
 www.google.com/bot.htmltext/..SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; GoogleBot-Mobile/2.1; url) - php=hhvm
 docs.google.comtext/..Mozilla/5.0 (compatible; GoogleDocs; apps-spreadsheets; url) - php=hhvm
 www.google.com/bot.htmltext/..DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; GoogleBot-Mobile/2.1; url) - php=hhvm
 www.google.com/bot.html-SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; GoogleBot-Mobile/2.1; url) - php=zend
 www.google.com/bot.html-DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; GoogleBot-Mobile/2.1; url) - php=zend
 www.google.com/feedfetcher.htmlimage/..Mozilla/5.0 (compatible) FeedFetcher-Google; (url) - -
 www.google.com/bot.htmlimage/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) - -
 desktop.google.com/application/xmlMozilla/5.0 (compatible; Google Desktop/5.9.1005.12335; url) - php=hhvm
 desktop.google.com/text/..Mozilla/5.0 (compatible; Google Desktop/5.9.1005.12335; url) - php=hhvm
 code.google.com/p/crawler4j/text/..crawler4j (url) - php=hhvm;https=1
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~jnhanproxy) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: ortografia4) - php=hhvm
 code.google.com/p/crawler4j/image/..crawler4j (url) - -
 code.google.com/appenginetext/..WikiBot/0.1 AppEngine-Google; (url; appid: newikipedia) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: jayjudah1) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: webusadl3) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: webusadl) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: webponline5) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: webusadlq2) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: usawebdl) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: wikien3) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: webusadlq7) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: webusadlp2) - php=hhvm
 code.google.com/appenginetext/..Python-urllib/2.5 AppEngine-Google; (url; appid: s~isnt-it) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: webusadlq) - php=hhvm
 desktop.google.com/image/..Mozilla/5.0 (compatible; Google Desktop/5.9.1005.12335; url) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: webusadl0) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: usawebdl0) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: simple-tools2) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: usawebdl2) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: webponline9) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: my-reg) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~argentina-country) - php=hhvm
 docs.google.comtext/..Mozilla/5.0 (compatible; GoogleDocs; spreadsheets; url) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: worldwide-propaganda) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: simple-tools3) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~vibhoreindia) - php=hhvm
 docs.google.comimage/..Mozilla/5.0 (compatible; GoogleDocs; documents; url) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: simple-tools5) - php=hhvm
 www.google.com/feedfetcher.htmlapplication/xmlFeedFetcher-Google; (url) - php=hhvm
 code.google.com/p/crawler4j/text/..crawler4j (url) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: ortopedianew) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: rarplayer) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: weps004) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: usawebdl3) - php=hhvm
 code.google.com/appengineapplication/jsonAppEngine-Google; (url; appid: s~kyouen3) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: webusadlp5) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: wikien4) - php=hhvm
 docs.google.comimage/..Mozilla/5.0 (compatible; GoogleDocs; apps-presentations; url) - -
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) - php=zend
 www.google.com/bot.html-Mozilla/5.0 (compatible; GoogleBot/2.1; url) - php=zend
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: 9000tunnels) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: imabouncytigger) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~japantiki) - php=hhvm
 www.google.com/bot.htmltext/..GoogleBot/2.1 (url) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: simple-tools6) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: mauserver) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: proxyusing121) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~proxyseekkety) - php=hhvm
 code.google.com/appenginetext/..www.productontology.org/1.0 (Contact: martin.heppATunibw.de) AppEngine-Google; (url; appid: gr4bing) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~badbolt20) - php=hhvm
 www.google.com/feedfetcher.htmltext/..FeedFetcher-Google; (url) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~nyinayminproxy9) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: webusadlp8) - php=hhvm
 www.google.com/feedfetcher.htmltext/..Mozilla/5.0 (compatible) FeedFetcher-Google;(url) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: davrasaurs) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: demostene) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: wiwohk-proxy-server) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~freekaznet) - php=hhvm
 docs.google.comtext/..Mozilla/5.0 (compatible; GoogleDocs; apps-spreadsheets; url) - php=hhvm;https=1 (null)
 www.google.com/bot.htmlapplication/pdfMozilla/5.0 (compatible; GoogleBot/2.1; url) - -
 code.google.com/appengineimage/..AppEngine-Google; (url; appid: s~harunakaze) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: python-proxy-server) - php=hhvm
 code.google.com/p/gwtwiki/text/..JavaWikipediaAPI/3.1-SNAPSHOT url - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~munnaproxyapp2) - php=hhvm
 www.google.com/feedfetcher.htmlimage/..Mozilla/5.0 (compatible) FeedFetcher-Google; (url) - php=hhvm
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: pr0xi3bipaser) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: dadolphson-proxy) - php=hhvm
 code.google.com/appengineimage/..AppEngine-Google; (url; appid: chronickg) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: dustbunnytycoonmonitor) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: 42turkeysproxy) - php=hhvm
 code.google.com/appengineimage/..AppEngine-Google; (url; appid: demostene) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: 9329269) - php=hhvm
 code.google.com/appengineimage/..Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 KHTML Chrome/39.0.2171.95 Safari/537.36 AppEngine-Google; (url; appid: s~1091940701peng66a9d1) zh-CN,zh;q=0.8,en;q=0.6,zh-TW;q=0.4 -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: chronickg) - php=hhvm
 code.google.com/appengineimage/..Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 KHTML Chrome/36.0.1985.125 Safari/537.36 AppEngine-Google; (url; appid: s~skyforever056) zh-CN,zh;q=0.8,en;q=0.6 -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: img-proxy) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: pakgalaxy) - php=hhvm
 code.google.com/appengineimage/..AppEngine-Google; (url; appid: jayjudah1) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: student-pupil-help) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~449-lsw3) zh-CN,zh;q=0.8,en;q=0.6 php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: dex-dwds) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: alexliao1995) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~no8lancelot) - php=hhvm
 www.google.com/bot.htmlapplication/xmlMozilla/5.0 (compatible; GoogleBot/2.1; url) - php=hhvm
 code.google.com/appenginetext/..python-requests/2.1.0 CPython/2.7.5 Linux/ AppEngine-Google; (url; appid: s~revfluenceapp) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: kampungbebas) - php=hhvm
 code.google.com/apis/kmlimage/..Kml-Google; (url), gzip - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: jackieonthefloor) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~malkman36) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: lil05warrior) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~text2solve) - php=hhvm
 code.google.com/appenginetext/..foobar2000/1.2.6 AppEngine-Google; (url; appid: s~jaord-t-api-hrd) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: nikita-web-proxy) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: mad-proxy) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: mistakeproxyarea) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: ksuopto) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: threewiki) - -
 code.google.com/appengineimage/..AppEngine-Google; (url; appid: s~e-ddos) - -
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: tusawebproxy6) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: riccio-hacks-proxy) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: thunderp-proxy) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~tonguesofwiki) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: its-a-tr) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: weps002) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: quigonjinn04) - php=hhvm
 code.google.com/appengineapplication/jsonMozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 KHTML Chrome/39.0.2171.95 Safari/537.36 AppEngine-Google; (url; appid: s~fieldschina-cs) zh-CN,zh;q=0.8,en;q=0.6 php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: s~inter-land) - php=hhvm
 code.google.com/appenginetext/..AppEngine-Google; (url; appid: meme2048) - php=hhvm
facebook
 www.facebook.com/externalhit_uatext.phpimage/..facebookexternalhit/1.1 (url) - -
 www.facebook.com/externalhit_uatext.phptext/..facebookexternalhit/1.1 (url) - php=hhvm
 www.facebook.com/externalhit_uatext.phptext/..facebookexternalhit/1.0 (url) - -
 www.facebook.com/externalhit_uatext.phptext/..facebookexternalhit/1.1 (url) - -
 www.facebook.com/externalhit_uatext.phpimage/..facebookexternalhit/1.0 (url) - -
 www.facebook.com/externalhit_uatext.phpimage/..facebookexternalhit/1.1 (url) - - (null)
 www.facebook.com/externalhit_uatext.phptext/..facebookexternalhit/1.1 (url) - php=hhvm;https=1 (null)
 www.facebook.com/externalhit_uatext.phpimage/..facebookexternalhit/1.1 (url) - php=hhvm
google?
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) - php=hhvm;https=1 (null)
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) - php=hhvm
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) - https=1;php=hhvm (null)
 www.google.com/bot.htmltext/..Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot/2.1; url) - https=1;php=hhvm (null)
 www.google.com/bot.htmltext/..Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot/2.1; url) - php=hhvm
 www.google.com/bot.htmlapplication/jsonMozilla/5.0 (compatible; GoogleBot/2.1; url) - php=hhvm
 www.google.com/bot.html-Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot/2.1; url) - php=zend
 www.google.com/bot.htmltext/..GoogleBot/2.1 (url) - php=hhvm
 www.google.com/bot.htmlapplication/jsonMozilla/5.0 (compatible; GoogleBot/2.1; url) - https=1;php=hhvm (null)
 www.google.com/bot.html-Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot/2.1; url) - php=zend;https=1 (null)
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) en-US,en;q=0.5 php=hhvm
 www.google.com/bot.htmlapplication/jsonMozilla/5.0 (compatible; GoogleBot/2.1; url) zh-us,zh;q=0.9 https=1;php=hhvm (null)
 www.google.com/bot.htmltext/..DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; GoogleBot-Mobile/2.1; url) - https=1;php=hhvm (null)
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) en-US,en;q=0.5 php=zend
 www.google.com/bot.htmltext/..SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; GoogleBot-Mobile/2.1; url) - https=1;php=hhvm (null)
 www.google.com/bot.html-SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; GoogleBot-Mobile/2.1; url) - php=zend;https=1 (null)
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) bg php=hhvm
 www.google.com/bot.htmlimage/..GoogleBot/2.1 (url) en,* -
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) en-US,en;q=0.8 php=zend
 www.google.com/bot.htmlimage/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) - - (null)
 www.google.com/bot.htmlimage/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) en-US,en;q=0.5 -
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) en-US php=zend
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) zh-CN,zh;q=0.8,en;q=0.6 php=hhvm
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) - https=1;php=zend (null)
 www.google.com/bot.htmlimage/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) - -
 www.google.com/bot.htmlimage/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) en-us,en;q=0.5 -
 www.google.com/bot.html-DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; GoogleBot-Mobile/2.1; url) - php=zend;https=1 (null)
 www.google.com/bot.htmlimage/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) en-GB,en;q=0.5 -
 www.google.com/bot.htmltext/..Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot/2.1; url) - https=1;php=hhvm
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) - php=hhvm A1
 www.google.com/bot.html-Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot/2.1; url) bg php=zend
 www.google.com/bot.htmltext/..Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; GoogleBot/2.1; url) - php=hhvm;https=1 (null)
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) en-US,en;q=0.8 php=hhvm
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) - php=zend
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) en-US php=hhvm
 www.google.com/bot.htmltext/..GoogleBot/2.1 (url) en-us,en;q=0.5 php=hhvm
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) en-US,en;q=0.5 php=hhvm;https=1
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url) ASProxy/5.5b5 - php=hhvm
 www.google.com/bot.html-SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; GoogleBot-Mobile/2.1; url) - php=zend
 www.google.com/bot.htmltext/..Mozilla/5.0 (compatible; GoogleBot/2.1; url en-US,en;q=0.5 php=hhvm
yahoo
 help.yahoo.com/help/us/ysearch/slurptext/..Mozilla/5.0 (compatible; Yahoo! Slurp; url) - php=hhvm
 help.yahoo.com/help/us/ysearch/slurptext/..Mozilla/5.0 (compatible; Yahoo! Slurp; url) - php=hhvm;https=1 (null)
 help.yahoo.com/help/us/ysearch/slurpapplication/jsonMozilla/5.0 (compatible; Yahoo! Slurp; url) - php=hhvm;https=1 (null)
 help.yahoo.com/help/us/ysearch/slurptext/..Mozilla/5.0 (compatible; Yahoo! Slurp; url) en,* php=hhvm
 help.yahoo.com/help/us/ysearch/slurpimage/..Mozilla/5.0 (compatible; Yahoo! Slurp; url) en,* -
 help.yahoo.com/help/us/ysearch/slurptext/..Mozilla/5.0 (compatible; Yahoo! Slurp; url) - https=1;php=hhvm (null)
 help.yahoo.com/help/us/ysearch/slurpimage/..Mozilla/5.0 (compatible; Yahoo! Slurp; url) - -
 help.yahoo.co.jp/help/jp/search/indexing/indexing-15.htmlimage/..'Mozilla/5.0 (compatible; Y!J SearchMonkey/1.0 (Y!J-AGENT; url))' - -
 help.yahoo.com/help/us/ysearch/slurpapplication/oggMozilla/5.0 (compatible; Yahoo! Slurp; url) - -
 help.yahoo.co.jp/help/jp/search/indexing/indexing-15.htmltext/..'Mozilla/5.0 (compatible; Y!J SearchMonkey/1.0 (Y!J-AGENT; url))' - -
 help.yahoo.co.jp/help/jp/search/indexing/indexing-15.htmlimage/..Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X; ja-jp) AppleWebKit/536.26 KHTML Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; Y!J-ASR/1.0 fetcher (Y!J-AGENT; url)) en,* -
 help.yahoo.com/help/us/ysearch/slurpvideo/webmMozilla/5.0 (compatible; Yahoo! Slurp; url) - -
 help.yahoo.co.jp/help/jp/search/indexing/indexing-15.htmltext/..Mozilla/5.0 (compatible; Y!J-ASR/1.0 fetcher (Y!J-AGENT; url)) - php=hhvm
baidu
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) en-US php=hhvm
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) zh-cn,zh-tw php=hhvm
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) - php=hhvm
 www.baidu.com/search/spider.htmtext/..Baiduspider-image(url)\nReferer: http://image.baidu.com/i?ct=503316480&z=0&tn=baiduimagedetail - php=hhvm
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) en-us,en;q=0.5 php=hhvm
 www.baidu.com/search/spi_der.htmltext/..Mozilla/5.0 (Linux;u;Android/2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; url) zh-cn,zh-tw php=hhvm
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) en-us,en;q=0.5 php=hhvm;https=1 (null)
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) - php=hhvm;https=1 (null)
 www.baidu.com/search/spider.htmimage/..Baiduspider-image(url)\nReferer: http://image.baidu.com/i?ct=503316480&z=0&tn=baiduimagedetail - -
 www.baidu.com/search/spider.htmtext/..Baiduspider-image(url) - php=hhvm
 www.baidu.com/search/spider.htmimage/..Baiduspider-image(url) - -
 www.baidu.com/search/spider.htmlapplication/jsonMozilla/5.0 (compatible; Baiduspider/2.0; url) - php=hhvm
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) - https=1;php=hhvm (null)
 www.baidu.com/search/spi_der.htmltext/..Mozilla/5.0 (Linux;u;Android/2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; url) - php=hhvm
 www.baidu.com/search/spider.htmtext/..Baiduspider-image(url)\nReferer: http://image.baidu.com/i?ct=503316480&z=0&tn=baiduimagedetail - -
 www.baidu.com/search/spider.htmlimage/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) zh-cn,zh-tw -
 www.baidu.com/search/spider.htmlimage/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) en,* php=hhvm
 www.baidu.com/search/spi_der.html-Mozilla/5.0 (Linux;u;Android/2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; url) - php=zend
 www.baidu.com/search/spider.htmapplication/jsonBaiduspider-image(url)\nReferer: http://image.baidu.com/i?ct=503316480&z=0&tn=baiduimagedetail - php=hhvm
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) - php=hhvm;https=1
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) - https=1;php=hhvm
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) en-US php=hhvm;https=1
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (Linux;u;Android/2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; url) - php=hhvm
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) en-US php=hhvm;https=1 (null)
 www.baidu.com/search/spider.htmlimage/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) en-US,* php=hhvm
 www.baidu.com/search/spider.htmtext/..Baiduspider-image(url) - -
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider-cpro; url) - php=hhvm
 www.baidu.com/search/spider.htmimage/..Baiduspider-image(url) zh-cn,zh-tw -
 www.baidu.com/search/spider.htmtext/..Baiduspider-image(url) zh-cn,zh-tw php=hhvm
 www.baidu.com/search/spider.htmlimage/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) - -
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) ASProxy/5.5b5 - php=hhvm
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) en,* php=hhvm
 www.baidu.com/search/spider.htmapplication/jsonBaiduspider-image(url) - php=hhvm
 www.baidu.com/search/spider.html-Mozilla/5.0 (Linux;u;Android/2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; url) zh-cn,zh-tw php=zend
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (compatible; Baiduspider/2.0; url) en-US https=1;php=hhvm (null)
 www.baidu.com/search/spider.htmltext/..Mozilla/5.0 (Linux;u;Android/2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; url) zh-cn,zh-tw php=hhvm
 www.baidu.com/search/spider.htmltext/..10.23.42.20 Mozilla/5.0 (compatible; Baiduspider/2.0; url) (via Web-Blaster/2.21 (http://www.a-blast.org/web-blast.html)) zh-cn,zh-tw php=hhvm
yandex
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; url) ru, uk;q=0.8, be;q=0.8, en;q=0.7, *;q=0.01 php=hhvm
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; url) - php=hhvm
 yandex.com/botsimage/..Mozilla/5.0 (compatible; YandexBot/3.0; url) ru, uk;q=0.8, be;q=0.8, en;q=0.7, *;q=0.01 -
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; url) en-us, en;q=0.7, *;q=0.01 php=hhvm
 yandex.com/botsimage/..Mozilla/5.0 (compatible; YandexBot/3.0; url) - -
 yandex.com/botsimage/..Mozilla/5.0 (compatible; YandexImageResizer/2.0; url) - -
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; url) tr, en;q=0.7, *;q=0.01 php=hhvm
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; url) - php=hhvm;https=1 (null)
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; url) ru, uk;q=0.8, be;q=0.8, en;q=0.7, *;q=0.01 https=1;php=hhvm
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; url) de, en;q=0.7, *;q=0.01 php=hhvm
 yandex.com/botsimage/..Mozilla/5.0 (compatible; YandexBot/3.0; url) en-us, en;q=0.7, *;q=0.01 -
 yandex.com/botsapplication/xmlMozilla/5.0 (compatible; YandexBlogs/0.99; robot; B; url)0 readers - php=hhvm
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; url) ru, uk;q=0.8, be;q=0.8, en;q=0.7, *;q=0.01 -
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBot/3.0; url) - php=hhvm;https=1
 yandex.com/botstext/..Mozilla/5.0 (compatible; YandexBlogs/0.99; robot; B; url)0 readers - php=hhvm
 yandex.com/botsapplication/jsonMozilla/5.0 (compatible; YandexBot/3.0; url) - php=hhvm
youdao
 www.youdao.com/help/webmaster/spider/text/..Mozilla/5.0 (compatible; YoudaoBot/1.0; url; ) - php=hhvm
ahrefs
 ahrefs.com/robot/text/..Mozilla/5.0 (compatible; AhrefsBot/5.0; url) - php=hhvm
 ahrefs.com/robot/text/..Mozilla/5.0 (compatible; AhrefsBot/5.0; url) - php=hhvm;https=1 (null)
 ahrefs.com/robot/text/..Mozilla/5.0 (compatible; AhrefsBot/5.0; url) - php=hhvm;https=1
 ahrefs.com/robot/image/..Mozilla/5.0 (compatible; AhrefsBot/5.0; url) - -
 ahrefs.com/robot/text/..Mozilla/5.0 (compatible; AhrefsBot/5.0; url) - https=1;php=hhvm
digplanet
 www.digplanet.com/wikiapplication/vnd.php.serializedDigplanet/1.0 (url; mail address ) PHP/5.4 - php=hhvm
msn
 search.msn.com/msnbot.htmtext/..msnbot-NewsBlogs/2.0b (url) - php=hhvm
 search.msn.com/msnbot.htmtext/..msnbot-media/1.1 (url) - php=hhvm
 search.msn.com/msnbot.htmimage/..msnbot-media/1.1 (url) - -
 search.msn.com/msnbot.htmtext/..msnbot-UDiscovery/2.0b (url) - php=hhvm
 search.msn.com/msnbot.htmimage/..msnbot-media/2.0b (url) - -
 search.msn.com/msnbot.htmtext/..msnbot-Products/1.0 (url) - php=hhvm
 search.msn.com/msnbot.htmimage/..msnbot-NewsBlogs/2.0b (url) - -
 search.msn.com/msnbot.htmtext/..msnbot/2.0b (url) - php=hhvm
mail
 go.mail.ru/help/robotstext/..Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; url) ru,by;q=0.7,en;q=0.7,kz;q=0.7,ua;q=0.7,*;q=0.1 php=hhvm
 go.mail.ru/help/robotsimage/..Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Img/2.0; url) ru,by;q=0.7,en;q=0.7,kz;q=0.7,ua;q=0.7,*;q=0.1 -
 go.mail.ru/help/robotstext/..Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; url) - php=hhvm
 go.mail.ru/help/robotstext/..Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Fast/2.0; url) ru,by;q=0.7,en;q=0.7,kz;q=0.7,ua;q=0.7,*;q=0.1 php=hhvm
 go.mail.ru/help/robotstext/..Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; url) ru,by;q=0.7,en;q=0.7,kz;q=0.7,ua;q=0.7,*;q=0.1 php=hhvm;https=1 (null)
 go.mail.ru/help/robotsimage/..Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; url) ru,by;q=0.7,en;q=0.7,kz;q=0.7,ua;q=0.7,*;q=0.1 -
naver
 help.naver.com/robots/application/jsonMozilla/5.0 (compatible; Yeti/1.1; url) ko-KR,ko;q=0.8,en-US;q=0.6,en;q=0.4 php=hhvm
 help.naver.com/robots/image/..Mozilla/5.0 (compatible; Yeti/1.1; url) ko-KR,ko;q=0.8,en-US;q=0.6,en;q=0.4 -
 help.naver.com/robots/image/..Mozilla/5.0 (compatible; Yeti/1.1; url) ko-KR,ko;q=0.8,en-US;q=0.6,en;q=0.4 - (null)
 help.naver.com/robots/application/oggMozilla/5.0 (compatible; Yeti/1.1; url) en-US,* -
 help.naver.com/robots/text/..Mozilla/5.0 (compatible; Yeti/1.1; url) ko-KR,ko;q=0.8,en-US;q=0.6,en;q=0.4 php=hhvm
 help.naver.com/robots/application/oggMozilla/5.0 (compatible; Yeti/1.1; url) ko-KR,ko;q=0.8,en-US;q=0.6,en;q=0.4 -
genieo
 www.genieo.com/webfilter.htmltext/..Mozilla/5.0 (compatible; Genieo/1.0 url) - php=hhvm
 www.genieo.com/webfilter.htmlapplication/xmlMozilla/5.0 (compatible; Genieo/1.0 url) - php=hhvm
 www.genieo.com/webfilter.htmlimage/..Mozilla/5.0 (compatible; Genieo/1.0 url) - -
 www.genieo.com/webfilter.htmlimage/..Mozilla/5.0 (compatible; Genieo/1.0 url) en,* -
echonest
 the.echonest.com/reader/application/xmlnestReader/0.3 (discovery; url; reader at echonest.com) en php=hhvm
 the.echonest.com/reader/text/..nestReader/0.3 (discovery; url; reader at echonest.com) en php=hhvm
 the.echonest.com/reader/image/..nestReader/0.3 (discovery; url; reader at echonest.com) en -
wikiwand
 www.wikiwand.comapplication/jsonWikiWand/0.1 (url; mail address ) BasedOnNodeJs/0.10.23 - php=hhvm
 www.wikiwand.comtext/..WikiWand/0.1 (url; mail address ) BasedOnNodeJs/0.10.23 - php=hhvm
 www.wikiwand.comimage/..WikiWand/0.1 (url; mail address ) BasedOnNodeJs/0.10.23 - -
sogou
 www.sogou.com/docs/help/webmasters.htm#07text/..Sogou web spider/4.0(url) zh-cn php=hhvm
 www.sogou.com/docs/help/webmasters.htm#07text/..Sogou web spider/4.0(url) - php=hhvm
 www.sogou.com/docs/help/webmasters.htm#07application/jsonSogou web spider/4.0(url) - php=hhvm
quickiwiki
 www.quickiwiki.comtext/..QuickiWiki/1.0 (url; mail address ) BasedOnNodeJs/0.10.23 - php=hhvm
yodao
 www.yodao.com/help/webmaster/spider/application/jsonMozilla/5.0 (compatible; YodaoBot/1.0; url; ) zh-cn;q=1.0, zh-tw;q=0.8, en;q=0.5, *;q=0.1 php=hhvm
 www.yodao.com/help/webmaster/spider/application/jsonMozillaTest/5.0 (compatible; YodaoBot/1.0; url; ) zh-cn;q=1.0, zh-tw;q=0.8, en;q=0.5, *;q=0.1 php=hhvm
wikipedia
 de.wikipedia.org/wiki/Benutzer:APPER/WikiHistorytext/..WikiHistory (url) - php=hhvm (null)
 en.wikipedia.org/wiki/User:NicoV/Wikipedia_Cleaner/Documentationtext/..WPCleaner (url) - php=hhvm;https=1 (null)
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/KylieTastic url en-GB,* php=hhvm;https=1
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/haminoon url en-NZ,* php=hhvm;https=1 (null)
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/Frosty url en-AU,* php=hhvm;https=1 (null)
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/wtmitchell url en-US,* php=hhvm;https=1 (null)
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/Becky_Sayles url en-US,* php=hhvm
 en.wikipedia.org/wiki/User:NicoV/Wikipedia_Cleaner/Documentationtext/..WPCleaner (url) - php=hhvm;https=1
 ko.wikipedia.orgapplication/jsonurl - php=hhvm
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/Altsprachenfreund url de-DE,en,* php=hhvm;https=1
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/Hz.tiang url en-SG,* php=hhvm;https=1 (null)
 fr.wikipedia.org/wiki/Utilisateur:OrlodrimBotapplication/jsonOrlodrimBot/1.0 (url) - php=hhvm;https=1 (null)
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/FrB.TG url en-US,* php=hhvm;https=1 (null)
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/Lugia2453 url en-US,* php=hhvm;https=1 (null)
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/Serols url de-DE,en,* php=hhvm;https=1 (null)
 en.wikipedia.orgapplication/jsonurl - php=hhvm
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/2.1.26.0 url - php=hhvm;https=1 (null)
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/an-d url de-DE,en,* php=hhvm;https=1
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/Tony_Tan_98 url en-US,* php=hhvm;https=1 (null)
 en.wikipedia.org/wiki/Wikipedia:Huggletext/..Huggle/Eduardofeld url pt-BR,en,* php=hhvm
coccoc
 help.coccoc.com/text/..Mozilla/5.0 (compatible; coccoc/1.0; url) en-us;q=0.7,en;q=0.3 php=hhvm
 help.coccoc.com/text/..Mozilla/5.0 (compatible; coccoc/1.0; url) en-us;q=0.7,en;q=0.3 php=hhvm;https=1 (null)
 help.coccoc.com/application/jsonMozilla/5.0 (compatible; coccoc/1.0; url) - php=hhvm
 help.coccoc.com/text/..Mozilla/5.0 (compatible; coccoc/1.0; url) - php=hhvm
cibra
 cibra.de/text/..CiBra Data Collector (url) - php=hhvm
www.
 www.text/..GoogleBot/2.1 ( urlGoogleBot.com/bot.html) - php=hhvm
 www.text/..GoogleBot-Image/1.0 ( urlGoogleBot.com/bot.html) - php=hhvm
 www.text/..GoogleBot/2.1 (urlGoogleBot.com/bot.html) - php=hhvm
 www.text/..Mozilla/5.0 (compatible; GoogleBot/2.1 urlGoogleBot.com/bot.html) - php=hhvm
 www.text/..GoogleBot/2.X (urlGoogleBot.com/bot.html) - php=hhvm
 www.text/..Mozilla/5.0 (compatible; GoogleBot/2.1 urlGoogleBot.com/bot.html) - php=hhvm;https=1 (null)
sputnik
 corp.sputnik.ru/webmastertext/..Mozilla/5.0 (compatible; SputnikBot/2.3; url) ru,en;q=0.1,*;q=0.01 php=hhvm
sblog
 fulltext.sblog.cz/screenshot/image/..Mozilla/5.0 (compatible; Seznam screenshot-generator 2.1; url) cs,cz,sk;q=0.7,*;q=0.5 -
 fulltext.sblog.cz/text/..Mozilla/5.0 (compatible; SeznamBot/3.2-test1; url) cs php=hhvm
 fulltext.sblog.cz/text/..Mozilla/5.0 (compatible; SeznamBot/3.2; url) cs php=hhvm
 fulltext.sblog.cz/text/..Mozilla/5.0 (compatible; SeznamBot/3.2-test2; url) cs php=hhvm
 fulltext.sblog.cz/screenshot/text/..Mozilla/5.0 (compatible; Seznam screenshot-generator 2.1; url) cs,cz,sk;q=0.7,*;q=0.5 php=hhvm
 fulltext.sblog.cz/image/..Mozilla/5.0 (compatible; SeznamBot/3.2; url) cs -
 fulltext.sblog.cz/image/..Mozilla/5.0 (compatible; SeznamBot/3.2-test1; url) cs -
pagefreezer
 pagefreezer.com/pagefreezer-crawler/image/..PageFreezer (pagefreezer crawler; url; mail address ) en-us,en;q=0.5 -
 pagefreezer.com/pagefreezer-crawler/text/..PageFreezer (pagefreezer crawler; url; mail address ) en-us,en;q=0.5 php=hhvm
traslated
 mymemory.traslated.net/doc/text/..Mozilla/5.0 (MyMemory Bot url) - php=hhvm
zeerch
 www.zeerch.com/zeerch2/bot.phptext/..Mozilla/5.0 (compatible; LA2; url) - php=hhvm
 www.zeerch.com/bot.phptext/..Mozilla/5.0 (compatible; LA1; url) - php=hhvm
 www.zeerch.com/bot.phptext/..Mozilla/5.0 (compatible; LA1; url) - php=hhvm;https=1 (null)
 www.zeerch.com/zeerch2/bot.phptext/..Mozilla/5.0 (compatible; LA2; url) - php=hhvm;https=1 (null)
 www.zeerch.com/bot.phptext/..Mozilla/5.0 (compatible; LA1; url) - https=1;php=hhvm (null)
 www.zeerch.com/zeerch2/bot.phptext/..Mozilla/5.0 (compatible; LA2; url) - https=1;php=hhvm (null)
php
 pear.php.net/application/vnd.php.serializedPEAR HTTP_Request class ( url ) - php=hhvm
 pear.php.net/package/http_request2text/..HTTP_Request2/2.0.0 (url) PHP/5.5.18 ja php=hhvm
 pear.php.net/package/http_request2text/..HTTP_Request2/2.2.0 (url) PHP/5.3.29 - php=hhvm
 pear.php.net/package/http_request2image/..HTTP_Request2/2.1.1 (url) PHP/5.3.2-1ubuntu4.18 - -
 pear.php.net/package/http_request2application/xmlHTTP_Request2/2.1.1 (url) PHP/5.3.15 - php=hhvm
 pear.php.net/text/..PEAR HTTP_Request class ( url ) - php=hhvm
 pear.php.net/application/xmlPEAR HTTP_Request class ( url ) - php=hhvm
 pear.php.net/image/..PEAR HTTP_Request class ( url ) - -
143
 173.13.143.74/bot.phptext/..Mozilla/5.0 (compatible; YioopBot; url) - php=hhvm
 173.13.143.74/bot.phptext/..Mozilla/5.0 (compatible; Please Name Your robot; url) - php=hhvm
 173.13.143.74/bot.phptext/..Mozilla/5.0 (compatible; YioopBot; url) - php=hhvm;https=1 (null)
pchome
 www.pchome.com.tw/pchomebot.htmtext/..Mozilla/5.0 (compatible; PChomebot/1.0; url) zh-tw,zh-cn,zh,en-us,en;q=0.7,*;q=0.3 php=hhvm
wmflabs
 tools.wmflabs.org/geohacktext/..Geohack (url) - php=hhvm (null)
 tools.wmflabs.org/languagetool/application/xmlurl bot, contact: mail address - php=hhvm;https=1 (null)
xbmc
 xbmc.orgimage/..XBMC/13.2 Git:20140817-0f3db05 (Windows NT 6.1;WOW64;Win64;x64; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140817-0f3db05 (Linux; Android; 3.0.50 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140817-0f3db05 (Windows NT 6.3;WOW64;Win64;x64; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140817-0f3db05 (Linux; Android; 3.0.36 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140817-0f3db05 (iOS; 13.0.0, Version 6.1.4 (Build 10B809); url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140817-0f3db05 (Windows NT 6.1; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140604-84725b0 (Linux; Android; 3.10.33 armv7l; url) - -
 www.xbmc.orgimage/..XBMC/12.2 Git:20131005-4dd128f (Linux; Android; 3.0.50 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140817-0f3db05 (Mac OS X; 14.0.0 x86_64, Version 10.10.1 (Build 14B25); url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140821-c5ae8b3 (Linux; Android; 3.10.33 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140831-a1505b1 (Linux; Android; 3.10.33 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.0 Git:20140505-f42f5b5 (Linux; Android; 3.0.50 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140817-0f3db05 (iOS; 11.0.0, Version 5.1.1 (Build 9B830); url) - -
 xbmc.orgimage/..XBMC/13.2-MINIX(1) Git:20140423-b8bc5a0 (Linux; Android; 3.10.33 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.1 Git:20140604-84725b0 (Windows NT 6.1;WOW64;Win64;x64; url) - -
 xbmc.orgimage/..XBMC/13.0 Git:20140505-a394e15 (Linux; Android; 3.0.36 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.1 Git:20140604-84725b0 (Linux; Android; 3.0.50 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.3-MINIX(0) Git:20140423-b8bc5a0 (Linux; Android; 3.10.33 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140817-0f3db05 (Linux; Android; 3.10.33 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.0 Git:20140505-f42f5b5 (Windows NT 6.1;WOW64;Win64;x64; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:0f3db05 (Linux; OpenELEC (official) - Version: 4.2.1; 3.16.3 x86_64; url) - -
 xbmc.orgimage/..XBMC/13.1 Git:20140607-49d7d62 (Linux; Android; 3.10.33 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.3-SPMC(2) Git:20140423-b8bc5a0 (Linux; Android; 3.0.50 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140817-0f3db05 (Linux; Android; 3.4.0-perf-g21e3850 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:20140822-420815e (Linux; Android; 3.0.101-g3f1a217 armv7l; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:Unknown (Linux; Android; 3.10.33 armv7l; url) - -
 www.xbmc.orgimage/..XBMC/12.3 Git:20131212-9ed3e58 (Windows NT 6.1;WOW64;Win64;x64; url) - -
 xbmc.orgimage/..XBMC/13.2 Git:Unknown (Linux; Buildroot 2013.11; 3.10.54 armv7l; url) - -
etao
 open.etao.com/dev/EtaoSpidertext/..Mozilla/5.0 (compatible; EtaoSpider/1.0; url) - php=hhvm
 open.etao.com/dev/EtaoSpidertext/..Mozilla/5.0 (compatible; EtaoSpider/1.0; url) - php=hhvm;https=1 (null)
exabot
 www.exabot.com/go/robottext/..Mozilla/5.0 (compatible; Exabot/3.0 (BiggerBetter); url) - php=hhvm
 www.exabot.com/go/robottext/..Mozilla/5.0 (compatible; Exabot/3.0; url) - php=hhvm
bin-co
 www.bin-co.com/php/scripts/load/text/..BinGet/1.00.A (url) - php=hhvm
 www.bin-co.com/php/scripts/load/application/vnd.php.serializedBinGet/1.00.A (url) - php=hhvm
domeinwinkel
 www.domeinwinkel.nl/text/..Domeinwinkel CatchCrawler/1.0 (url) - php=hhvm
stackoverflow
 stackoverflow.com/questions/8956331/how-to-get-results-from-the-wikipedia-api-with-phptext/..Testing for url - php=hhvm
 stackoverflow.com/questions/8956331/how-to-get-results-from-the-wikipedia-api-with-phpapplication/jsonTesting for url - php=hhvm
blekko
 blekko.com/about/blekkobottext/..Mozilla/5.0 (compatible; Blekkobot; ScoutJet; url) - php=hhvm
 blekko.com/about/blekkobottext/..Mozilla/5.0 (compatible; Blekkobot; ScoutJet; url) - php=hhvm;https=1 (null)
scrapy
 scrapy.orgtext/..Scrapy/0.25.0-232-ged84231 (url) en php=hhvm
 scrapy.orgtext/..Scrapy/0.25.0-232-ged84231 (url) en php=hhvm;https=1 (null)
 scrapy.orgtext/..Scrapy/0.25.1 (url) en php=hhvm;https=1 (null)
 scrapy.orgtext/..Scrapy/0.22.2 (url) en php=hhvm
 scrapy.orgtext/..Scrapy/0.24.4 (url) en php=hhvm
 scrapy.orgtext/..Scrapy/0.24.4 (url) en php=hhvm;https=1 (null)
zum
 help.zum.com/inquirytext/..ZumBot/1.0 (ZUM Search; url) - php=hhvm
 help.zum.com/inquirytext/..Mozilla/5.0 (compatible; ZumBot/1.0; url) - php=hhvm
 help.zum.com/inquiryimage/..ZumBot/1.0 (ZUM Search; url) - -
superfeedr
 superfeedr.comapplication/xmlSuperfeedr bot/2.0 url - Make your feeds realtime: get in touch - php=hhvm
 superfeedr.comtext/..Superfeedr bot/2.0 url - Make your feeds realtime: get in touch - php=hhvm
 superfeedr.comapplication/xmlSuperfeedr bot/2.0 url - Make your feeds realtime: get in touch - php=hhvm;https=1 (null)
 superfeedr.comtext/..Superfeedr bot/2.0 url - Make your feeds realtime: get in touch - php=hhvm;https=1 (null)
uni-leipzig
 corpora.informatik.uni-leipzig.de/crawler_faq.htmltext/..Mozilla/5.0 (compatible; heritrix/3.1.1; UniLeipzigASV url) - php=hhvm
 corpora.informatik.uni-leipzig.de/crawler_faq.htmltext/..Mozilla/5.0 (compatible; heritrix/3.1.1; UniLeipzigASV url) - php=hhvm;https=1 (null)
monitis
 www.monitis.comtext/..Mozilla/5.0 (compatible; monitis - premium monitoring service; url) - php=hhvm
 monitis.comtext/..Mozilla/5.0 (compatible; monitis.com - free monitoring service; url) - php=hhvm
drupal
 drupal.org/application/jsonDrupal (url) - php=hhvm
 drupal.org/text/..Drupal (url) - php=hhvm
 drupal.org/image/..Drupal (url) - -
 drupal.org/text/..User-Agent: Drupal (url) - php=hhvm
wordpress
 zeitgeist77.wordpress.comtext/..WordPress/4.1-beta2-30797; url - php=hhvm
 josefboberg.wordpress.comtext/..WordPress/4.1-beta2-30797; url - php=hhvm
 jochenlembke.wordpress.comtext/..WordPress/4.1-beta2-30797; url - php=hhvm
 peripluscd.wordpress.comtext/..WordPress/4.1-beta2-30797; url - php=hhvm
 pageofsunil.wordpress.comtext/..WordPress/4.1-beta2-30797; url - php=hhvm
 thereisnodebt.wordpress.comtext/..WordPress/4.1-beta2-30797; url - php=hhvm
 multiculturalcookingnetwork.wordpress.comtext/..WordPress/4.1-beta2-30797; url - php=hhvm
recuweb
 recuweb.comapplication/jsonurl en-us,en;q=0.5 php=hhvm;https=1 (null)
majestic12
 www.majestic12.co.uk/bot.php?text/..Mozilla/5.0 (compatible; MJ12bot/v1.4.5; url) en php=hhvm
 www.majestic12.co.uk/bot.php?text/..Mozilla/5.0 (compatible; MJ12bot/v1.4.5; url) - php=hhvm
yacy
 yacy.net/bot.htmltext/..yacybot (/global; amd64 Linux 3.2.0-4-amd64; java 1.7.0_65; Europe/en) url en-us,en;q=0.5 php=hhvm
 yacy.net/bot.htmltext/..yacybot (/global; amd64 Windows 7 6.1; java 1.8.0_25; Europe/de) url en-us,en;q=0.5 php=hhvm
 yacy.net/bot.htmltext/..yacybot (/global; amd64 Linux 3.16.7-7-desktop; java 1.8.0_40; Europe/pl) url en-us,en;q=0.5 php=hhvm
 yacy.net/bot.htmltext/..yacybot (/global; amd64 Windows 7 6.1; java 1.8.0_25; Europe/en) url en-us,en;q=0.5 php=hhvm
 yacy.net/bot.htmltext/..yacybot (/global; amd64 Linux 3.16.7-7-desktop; java 1.8.0_40; Europe/pl) url en-us,en;q=0.5 php=hhvm;https=1
 yacy.net/bot.htmltext/..yacybot (/global; amd64 Linux 3.13.0-43-generic; java 1.7.0_65; Etc/en) url en-us,en;q=0.5 php=hhvm
 yacy.net/bot.htmltext/..yacybot (/global; i386 Linux 3.16.0-4-686-pae; java 1.7.0_65; Europe/en) url en-us,en;q=0.5 php=hhvm;https=1
 yacy.net/bot.htmltext/..yacybot (/global; i386 Linux 3.16.0-4-686-pae; java 1.7.0_65; Europe/en) url en-us,en;q=0.5 php=hhvm
 yacy.net/bot.htmltext/..yacybot (/global; x86 Windows 7 6.1; java 1.8.0_25; Europe/en) url en-us,en;q=0.5 php=hhvm
 yacy.net/bot.htmltext/..yacybot (/global; amd64 Linux 3.12.1; java 1.7.0_65; Europe/en) url en-us,en;q=0.5 php=hhvm
 yacy.net/bot.htmltext/..yacybot (/global; x86 Windows XP 5.1; java 1.7.0_71; America/es) url en-us,en;q=0.5 php=hhvm;https=1 (null)
 yacy.net/bot.htmltext/..yacybot (/global; amd64 Linux 3.13.0-44-generic; java 1.7.0_65; Europe/en) url en-us,en;q=0.5 php=hhvm
 yacy.net/bot.htmltext/..yacybot (freeworld/global; PowerPC OS/400 V7R1M0; java 1.6.0; UTC/en) url en-us,en;q=0.5 php=hhvm
plos
 alm.plos.orgapplication/jsonLagotto 3.11 - url - php=hhvm
 sfo-stage-alm01.int.plos.orgapplication/jsonLagotto 3.9.6 - url - php=hhvm
opensiteexplorer
 www.opensiteexplorer.org/dotbottext/..Mozilla/5.0 (compatible; DotBot/1.1; url, mail address ) - php=hhvm
meteor
 wikimedia.meteor.com/application/jsonWikiMedia Meteor DDP stream (url, mail address ) - php=hhvm
example
 www.example.com/text/..wikidrain/1.0 (url) - php=hhvm
 example.com/MyCoolToolPage/application/jsonMyCoolTool (url) - php=hhvm
archive
 www.archive.org/details/archive.org_botimage/..Mozilla/5.0 (compatible; special_archiver/3.1.1 url) - - (null)
 www.archive.org/details/archive.org_botimage/..Mozilla/5.0 (compatible; special_archiver/3.1.1 url) - -
 www.archive.org/details/archive.org_bottext/..Mozilla/5.0 (compatible; special_archiver/3.1.1 url) - php=hhvm
 www.archive.org/details/archive.org_bottext/..Mozilla/5.0 (compatible; special_archiver/3.1.1 url) - php=hhvm;https=1 (null)
 www.archive.org/details/archive.org_bottext/..Mozilla/5.0 (compatible; archive.org_bot url) - php=hhvm
 archive.org/details/archive.org_botimage/..Mozilla/5.0 (compatible; heritrix/3.3.0-SNAPSHOT-20140702-2247 url) - -
 www.archive.org/details/archive.org_botimage/..Mozilla/5.0 (compatible; archive.org_bot url) - -
dynotes
 www.dynotes.com/multi-lang-dictionary/application/jsonMLD (WP 7)/1.1.2 (url); mail address - php=hhvm
 www.dynotes.com/multi-lang-dictionary/application/jsonMLD/5.2.2 (url; mail address en-us php=hhvm
 www.dynotes.com/multi-lang-dictionary/application/jsonMLD/5.1.2 (url; mail address en-us php=hhvm
flipboard
 flipboard.com/browserproxytext/..Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:28.0) Gecko/20100101 Firefox/28.0 (FlipboardProxy/1.1; url) en-us,en;q=0.5 php=hhvm
 flipboard.com/browserproxyimage/..Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:28.0) Gecko/20100101 Firefox/28.0 (FlipboardProxy/1.6; url) - -
 flipboard.com/browserproxytext/..Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:28.0) Gecko/20100101 Firefox/28.0 (FlipboardProxy/1.1; url) en-us,en;q=0.5 php=hhvm;https=1 (null)
 flipboard.com/browserproxyimage/..Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:28.0) Gecko/20100101 Firefox/28.0 (FlipboardProxy/1.1; url) en-us,en;q=0.5 -
 flipboard.com/browserproxytext/..null (FlipboardProxy/1.1; url) - -
 flipboard.com/browserproxyimage/..null (FlipboardProxy/1.1; url) - -
test
 test.co.kr/text/..xxxxxxxx/Nutch-2.2.1 (url) - php=hhvm
github
 github.com/sparklemotion/mechanize/application/jsonMechanize/2.7.3 Ruby/2.1.0p0 (url) en-us,en;q=0.5 php=hhvm
 github.com/pauldix/feedzirra/tree/masterapplication/xmlfeedzirra url - php=hhvm
 wiki.github.com/bixo/bixo/bixocrawlertext/..Mozilla/5.0 (compatible; pub-crawler; url; mail address ) en-us,en-gb,en;q=0.7,*;q=0.3 php=hhvm
 github.com/pauldix/feedzirra/tree/mastertext/..feedzirra url - php=hhvm
 github.com/pauldix/feedzirra/tree/masterapplication/xmlfeedzirra url - php=hhvm;https=1 (null)
 github.com/sparklemotion/mechanize/text/..Mechanize/2.7.3 Ruby/2.1.0p0 (url) en-us,en;q=0.5 php=hhvm
riddler
 riddler.io/abouttext/..Riddler (url) - php=hhvm
 riddler.io/abouttext/..Riddler (url) - php=hhvm;https=1
feedly
 www.feedly.com/fetcher.htmlapplication/xmlFeedly/1.0 (url; like FeedFetcher-Google) - php=hhvm
 www.feedly.com/fetcher.htmlapplication/xmlFeedly/1.0 (url; like FeedFetcher-Google) - php=hhvm;https=1 (null)
mysite
 www.mysite.com/application/vnd.php.serializedMyBot/1.0 (url) - php=hhvm
 www.mysite.com/text/..MyBot/1.0 (url) - php=hhvm
 www.mysite.com/application/jsonMyBot/1.0 (url) - php=hhvm
FeedBurner
 www.FeedBurner.comtext/..FeedBurner/1.0 (url) - php=hhvm
netvibes
 www.netvibes.comtext/..Netvibes (url) - php=hhvm
 www.netvibes.comapplication/xmlNetvibes (url) - php=hhvm
esophoria
 www.esophoria.orgtext/..WordPress/3.4.2; url - php=hhvm
wesee
 www.wesee.com/bot/image/..WeSEE:Ads/PictureBot (url) - -
 www.wesee.com/bot/text/..WeSEE:Ads/PageBot (url) - php=hhvm
amzn
 amzn.to/1vsZADitext/..Amazon Route 53 Health Check Service; ref:75c68de8-ca59-474b-a8a5-1bcc0ec34b5d; report url - php=hhvm;https=1 (null)
 amzn.to/1vsZADitext/..Amazon Route 53 Health Check Service; ref:75c68de8-ca59-474b-a8a5-1bcc0ec34b5d; report url - php=hhvm;https=1
datasift
 datasift.com/bot.htmltext/..Mozilla/5.0 (TweetmemeBot/4.0; url) Gecko/20100101 Firefox/31.0 - php=hhvm
 datasift.com/bot.htmltext/..Mozilla/5.0 (TweetmemeBot/4.0; url) Gecko/20100101 Firefox/31.0 - php=hhvm;https=1 (null)
 datasift.com/bot.htmltext/..Mozilla/5.0 (TweetmemeBot/4.0; url) Gecko/20100101 Firefox/31.0 - php=hhvm;https=1
embed
 support.embed.ly/image/..Mozilla/5.0 (compatible; Embedly/0.2; snap; url) - -
 support.embed.ly/text/..Mozilla/5.0 (compatible; Embedly/0.2; url) - php=hhvm
 support.embed.ly/text/..Mozilla/5.0 (compatible; Embedly/0.2; url) - php=hhvm;https=1 (null)
SearchNearMe
 SearchNearMe.com/contact.phptext/..SearchNearMe (url) - php=hhvm
 SearchNearMe.com/contact.phpapplication/vnd.php.serializedSearchNearMe (url) - php=hhvm
testomato
 www.testomato.com/testomatobottext/..Testomatobot/1.0 (Linux x86_64 url) minicrawler/3.0~beta - php=hhvm
 www.testomato.com/testomatobottext/..Testomatobot/1.0 (Linux x86_64; url) minicrawler/3.0~beta en-US,en,cs;q=0.01 php=hhvm
daum
 tab.search.daum.net/aboutWebSearch.htmltext/..Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows server; url) Daumoa/3.0 ko-kr,ko;q=0.8,en-us;q=0.5,en;q=0.3 php=hhvm
alexa
 www.alexa.com/site/help/webmasterstext/..ia_archiver (url; mail address ) - php=hhvm
 www.alexa.com/help/webmasterstext/..Mozilla/5.0 (compatible; alexa site audit/1.0; url; mail address ) - php=hhvm
phonifier
 www.phonifier.comtext/..Mozilla/5.0 (compatible; Phonifier; url) - php=hhvm
 www.phonifier.comtext/..Mozilla/5.0 (compatible; Phonifier; url) - php=hhvm;https=1
 www.phonifier.comtext/..Mozilla/5.0 (compatible; Phonifier; url) - php=hhvm;https=1 (null)
creativecommons
 wiki.creativecommons.org/Metadata_Scrapertext/..CC Metadata Scaper url - php=hhvm
grapeshot
 www.grapeshot.co.uk/crawler.phptext/..Mozilla/5.0 (compatible; GrapeshotCrawler/2.0; url) - php=hhvm
cdlib
 webarchives.cdlib.org/p/webmasterstext/..Mozilla/5.0 (compatible; cdlwas_bot; heritrix/1.14.1 url) - php=hhvm
bl
 www.bl.uk/aboutus/legaldeposit/websites/websites/faqswebmaster/index.htmltext/..bl.uk_lddc_bot/3.1.1 (url) - php=hhvm
 www.bl.uk/aboutus/legaldeposit/websites/websites/faqswebmaster/index.htmlimage/..bl.uk_lddc_bot/3.1.1 (url) - -
 www.bl.uk/aboutus/legaldeposit/websites/websites/faqswebmaster/index.htmltext/..bl.uk_lddc_bot/3.1.1 (url) - php=hhvm;https=1 (null)
OpenLinkProfiler
 OpenLinkProfiler.org/bottext/..Mozilla/5.0 (compatible; spbot/4.4.2; url ) en-us,en;q=0.5 php=hhvm
 OpenLinkProfiler.org/bottext/..Mozilla/5.0 (compatible; spbot/4.4.2; url ) - php=hhvm
easou
 www.easou.com/search/spider.htmltext/..Mozilla/5.0 (compatible; EasouSpider; url) zh;q=0.9,en;q=0.8 php=hhvm
grouphigh
 www.grouphigh.com/text/..Mozilla/5.0 (compatible; GroupHigh/1.0; url) - php=hhvm
 www.grouphigh.com/text/..Mozilla/5.0 (compatible; GroupHigh/1.0; url) - php=hhvm;https=1 (null)
 www.grouphigh.com/application/xmlMozilla/5.0 (compatible; GroupHigh/1.0; url) - php=hhvm
pinterest
 www.pinterest.com/text/..Pinterest/0.2 (url) - php=hhvm
 www.pinterest.com/image/..Pinterest/0.2 (url) - -
2wap
 www.2wap.orgtext/..Mozilla/5.0 (compatible; Phonifier; url) - php=hhvm
trendiction
 www.trendiction.de/bottext/..Mozilla/5.0 (Windows; Windows NT 6.0; en-GB; rv:1.0; trendictionbot0.5.0; trendiction search; url; please let us know of any problems; web at trendiction.com) Gecko/20071127 Firefox/3.0.0.11 en-gb,en;q=0.5 php=hhvm
 www.trendiction.de/botimage/..Mozilla/5.0 (Windows; Windows NT 6.0; en-GB; rv:1.0; trendictionbot0.5.0; trendiction search; url; please let us know of any problems; web at trendiction.com) Gecko/20071127 Firefox/3.0.0.11 en-gb,en;q=0.5 -
paper
 support.paper.li/entries/20023257-what-is-paper-litext/..Mozilla/5.0 (compatible; PaperLiBot/2.1; url) en;q=0.8, * php=hhvm
bit
 bit.ly/1dJuuzstext/..Seobility (SEO-Check; url) de,en php=hhvm
rockpeaks
 www.rockpeaks.com/contacttext/..RockPeaks/0.1 (url) - php=hhvm
wikidict
 www.wikidict.detext/..url - php=hhvm
zaigar
 lv.zaigar.infotext/..WordPress/3.2.1; url - php=hhvm
bsurprised
 bsurprised.com/text/..BSurprised WikiBox 0.1.3 (url) en php=hhvm
 bsurprised.com/text/..BSurprised WikiBox 0.1.3 (url) it php=hhvm
 bsurprised.com/text/..BSurprised WikiBox 0.1.3 (url) - php=hhvm
grammarly
 www.grammarly.comapplication/jsonGrammarly/1.0 (url) - php=hhvm
sistrix
 crawler.sistrix.net/text/..Mozilla/5.0 (compatible; SISTRIX Crawler; url) - php=hhvm
okian
 www.okian.ro/text/..MyBot/1.0 (url) - php=hhvm
 www.okian.ro/application/jsonMyBot/1.0 (url) - php=hhvm
proximic
 www.proximic.com/info/spider.phptext/..Mozilla/5.0 (compatible; proximic; url) - php=hhvm
saciol
 www.saciol.com/text/..User-Agent: Saciolbot/1.2 (url; mail address - php=hhvm
weblio
 www.weblio.jp/info/crawler.jspimage/..Mozilla/5.0 (compatible; Webliobot/0.1; url) - -
 www.weblio.jp/text/..Mozilla/5.0 (compatible; WeblioBot; url) - php=hhvm
 www.weblio.jp/info/crawler.jsptext/..Mozilla/5.0 (compatible; Webliobot/0.1; url) - -
goo
 help.goo.ne.jp/contact/text/..goo wikipedia (url) - php=hhvm
 search.goo.ne.jp/option/use/sub4/sub4-1/-DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo;url) - php=zend
parsijoo
 www.parsijoo.ir/image/..Mozilla/5.0 (compatible; parsijoo-bot; url; mail address ) - -
 www.parsijoo.ir/text/..Mozilla/5.0 (compatible; parsijoo-bot; url; mail address ) - php=hhvm
egerin
 www.egerin.comtext/..crawler (url); Kurdish search engine ku php=hhvm
sanskritdictionary
 www.sanskritdictionary.com/application/vnd.php.serializedUser-Agent: SanskritDictionary/0.1 (url) - php=hhvm
similartech
 www.similartech.com/smtbottext/..Mozilla/5.0 (compatible; SMTBot/1.0; url) - php=hhvm
hatena
 a.hatena.ne.jp/helptext/..Hatena Antenna/0.5 (url) - php=hhvm
spinn3r
 spinn3r.com/robottext/..Mozilla/5.0 (X11; Linux x86_64; en-US; rv:1.9.0.19; aggregator:Spinn3r (Spinn3r 3.1); url) Gecko/2010040121 Firefox/3.0.19 - php=hhvm
joka02
 joka02.infoimage/..WordPress/4.1; url - -
searchmetrics
 www.searchmetrics.com/en/searchmetrics-bot/text/..Mozilla/5.0 (compatible; SearchmetricsBot; url) - php=hhvm
moviecus
 www.moviecus.com/botcontactinfo.phpapplication/yamlmoviecus bot (url) - php=hhvm
 www.moviecus.com/botcontactinfo.phpapplication/jsonmoviecus bot (url) - php=hhvm
havos
duckduckgo
 duckduckgo.com/duckduckbot.htmltext/..DuckDuckBot/1.1; (url) - php=hhvm
 duckduckgo.comtext/..Mozilla/5.0 (compatible; DuckDuckGo-Favicons-Bot/1.0; url) en-US,en;q=0.8,zh;q=0.6,es;q=0.4 php=hhvm
 duckduckgo.com/duckduckbot.htmlimage/..DuckDuckBot/1.1; (url) - -
netarkivet
 netarkivet.dk/webcrawlertext/..Mozilla/5.0 (compatible; heritrix/1.14.4 url) - php=hhvm
 netarkivet.dk/webcrawlertext/..Mozilla/5.0 (compatible; heritrix/1.14.4 url) - php=hhvm;https=1
 netarkivet.dk/webcrawlerimage/..Mozilla/5.0 (compatible; heritrix/1.14.4 url) - -
gulliway
 gulliway.orgtext/..Mozzila/5.0 (Windows NT 5.1; GulliwayBot/01 url) - php=hhvm
 gulliway.orgapplication/xmlMozzila/5.0 (Windows NT 5.1; GulliwayBot/01 url) - php=hhvm
thinglink
 www.thinglink.com/application/jsonMozilla/5.0 (compatible; Thinglink/1.0; url, mail address ) - php=hhvm
 www.thinglink.com/help/ThinglinkImageBotimage/..Elmer, the Thinglink ImageBot (url) - -
 www.thinglink.com/help/ThinglinkImageBottext/..Elmer, the Thinglink ImageBot (url) - php=hhvm
linkdex
 www.linkdex.com/bots/text/..Mozilla/5.0 (compatible; linkdexbot/2.0; url) - php=hhvm
popularmusicvid
 www.popularmusicvid.com/text/..MyBot/1.0 (url) - php=hhvm
creativepulses
 creativepulses.nlapplication/jsonCreativePulses Crawler (url) - php=hhvm
pingdom
 www.pingdom.comtext/..Pingdom.com_bot_version_1.4_(url) - php=hhvm
 www.pingdom.com/text/..Pingdom.com_bot_version_1.4_(url) - php=hhvm
loopj
 loopj.com/android-async-httpapplication/jsonandroid-async-http/1.4.4 (url) - php=hhvm
metamagazine
 metamagazine.comtext/..WordPress/3.9.2; url - php=hhvm
topworldvid
 www.topworldvid.com/text/..MyBot/1.0 (url) - php=hhvm
gorgor
 gorgor.irtext/..hivaBot/hivaBot-1.0 (Iranian Search Engine bot; url; mail address ) en-us,en-gb,en;q=0.7,*;q=0.3 php=hhvm
 gorgor.irapplication/jsonhivaBot/hivaBot-1.0 (Iranian Search Engine bot; url; mail address ) - php=hhvm
image2play
 image2play.com/image/..Mozilla/5.0 (compatible; Image2play/0.1; url) - -
tt-rss
webmeup-crawler
 webmeup-crawler.com/text/..Mozilla/5.0 (compatible; BLEXBot/1.0; url) - php=hhvm
 webmeup-crawler.com/application/jsonMozilla/5.0 (compatible; BLEXBot/1.0; url) - php=hhvm
jetsli
 jetsli.de/crawlertext/..Mozilla/5.0 (compatible; Jetslide; url) en-us php=hhvm
uptimerobot
 www.uptimerobot.com/text/..Mozilla/5.0(compatible; UptimeRobot/2.0; url) en-US,en;q=0.8 php=hhvm
friedemann-vogel
 friedemann-vogel.de/forschung/konfliktlinguistik-20application/jsonTalksCrawler/2.0 (url) - php=hhvm
idmarch
 www.idmarch.org/bot.htmltext/..Mozilla/5.0 (compatible; idmarch Automatic.beta/1.2; url) en-us,en-gb,en;q=0.7,*;q=0.3 php=hhvm
 www.idmarch.org/bot.htmltext/..Mozilla/5.0 (compatible; idmarch Automatic.beta/1.2; url) en-us,en-gb,en;q=0.7,*;q=0.3 php=hhvm;https=1 (null)
vientech
 vientech.at/abuse.txttext/..url - php=hhvm
backgroundswitcher
 www.backgroundswitcher.com/image/..John's Background Switcher 4.9 (url) - -
 www.backgroundswitcher.com/text/..John's Background Switcher 4.9 (url) - -
crazywebcrawler
 www.crazywebcrawler.comtext/..CRAZYWEBCRAWLER 0.9.2, url - php=hhvm
wikidata
 www.wikidata.orgapplication/jsonurl - php=hhvm
 wikidata.org/wiki/User:Mushroomapplication/jsonMushroomTest/0.1 url - php=hhvm
homenet
 dispenser.homenet.org/~dispenser/application/jsonDispensersTools (url) - php=hhvm
 dispenser.homenet.org/~dispenser/text/..DispensersTools (url) - php=hhvm
johnooms
 johnooms.nltext/..WordPress/4.1; url - php=hhvm
yoursite
 yoursite.com/botinfotext/..Mozilla/5.0 (compatible; YourCoolBot/1.0; url) - php=hhvm
ireplay
 ireplay.fr/text/..iReplay/1.0 (url) - php=hhvm
plagiarismcheck
 plagiarismcheck.orgapplication/jsonWikiCrawl 1.0b (url contact-mail: mail address ) - php=hhvm
cm-tuguan
 best.cm-tuguan.comtext/..WordPress/4.1; url - php=hhvm
tiscali
 www.tiscali.it/text/..Mozilla/5.0 (compatible; IstellaBot/1.18.81 url) * php=hhvm
watchmouse
 watchmouse.com/image/..WatchMouse (url ; HQ) en-us,en;q=0.5 -
 watchmouse.com/image/..WatchMouse (url ; HQ) en-us,en;q=0.5 php=hhvm
picsearch
 www.picsearch.com/bot.htmltext/..psbot/0.1 (url) - php=hhvm
 www.picsearch.com/bot.htmltext/..psbot-image (url) - php=hhvm
simplepie
 simplepie.orgapplication/xmlSimplePie/1.3.1 (Feed Parser; url; Allow like Gecko) Build/20121030175403 - php=hhvm
schmorp
 software.schmorp.de/pkg/AnyEventapplication/xmlMozilla/5.0 (compatible; AnyEvent-HTTP/2.21; url) - php=hhvm;https=1
inagist
 inagist.comtext/..InAGist URL Resolver (url) en-us,en;q=0.5 php=hhvm
bestonlinesongs
 www.bestonlinesongs.com/text/..MyBot/1.0 (url) - php=hhvm
scarecrow
 www.scarecrow.com/application/jsonScarecrow/1.0 (url; mail address ) - php=hhvm
vk
 vk.com/dev/Sharetext/..Mozilla/5.0 (compatible; vkShare; url) - php=hhvm;https=1
 vk.com/dev/Sharetext/..Mozilla/5.0 (compatible; vkShare; url) - php=hhvm;https=1 (null)
topsportsvidz
 www.topsportsvidz.com/text/..MyBot/1.0 (url) - php=hhvm
japanarmenia
 japanarmenia.comtext/..WordPress/3.9.3; url - php=hhvm
toolserver
 toolserver.org/~guandalug/application/vnd.php.serializedGuandalugs PHPWikiBot/1.1 (url;de:User:Guandalug) - php=hhvm (null)
semager
 www.semager.de/blog/semager-bots/text/..Mozilla/5.0 (compatible; Semager/1.4c; url) - php=hhvm
zeebox
 www.zeebox.comtext/..Zeebox (url) en-us,en;q=0.5 php=hhvm
datoid
 datoid.cz/tag-information/application/jsonDatoid/0.9 (url; mail address ) BasedOnNette/2.0.9 - php=hhvm
diffbot
 www.diffbot.comtext/..Mozilla/5.0 (Windows; Windows NT 5.1; en-US; rv:1.9.1.2) Gecko/20090729 Firefox/3.5.2 (Diffbot/0.1; url) en-us,en;q=0.5 php=hhvm
go
 kc.nict.go.jp/project1/crawl.htmltext/..ICC-Crawler/2.0 (Mozilla-compatible; ; url) ja php=hhvm
edu
 ws.nju.edu.cn/falcons/text/..Mozilla/5.0 (compatible; Falconsbot; url) - php=hhvm
enwp
 enwp.org/User:Hellknowz/WikiSharpAPItext/..WikiSharpAPI/0.3 url (C# .NET) - php=hhvm
hiergehtslos
 www.hiergehtslos.deimage/..Mozilla/5.0 (Windows NT 6.1; Trident/7.0; url; rv:11.0) like Gecko de-DE -
187,803total

Page requests for probable crawlers, recognized by keyword
Count
x 1000
Agent string
  Mime type (count ≥ 3)
Peachy MediaWiki Bot API Version 2.0 (alpha 8) - php=hhvm (null)
 application/vnd.php.serialized
 text/..
GoogleBot-Image/1.0 - -
 image/..
 text/..
WikiGameBot/0.2 ( mail address ) - php=hhvm
 application/json
php wikibot classes - php=hhvm
 application/vnd.php.serialized
 application/json
 text/..
ClueBot/2.0 - php=hhvm (null)
 application/vnd.php.serialized
LinkParser/2.0 - php=hhvm (null)
 text/..
wikiwix-bot-3.0 - php=hhvm
 text/..
MediaWikiCrawler-Google - php=hhvm
 text/..
 application/json
py-radehh.py/rg11106 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
welcome (wikinews:es; User:Ralgisbot) Pywikibot/2.0b1 (g4173) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
pwb/rg3113 Pywikipediabot/2.0 - php=hhvm;https=1 (null)
 application/json
pywikipedia-addzumra.py/r10860 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
pywikipedia-zzfatranslator.py/r10843 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
inspect/r2160 Pywikipediabot/2.0 - php=hhvm;https=1 (null)
 application/json
pywikipedia-newar4ur.py/r10843 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
pywikibot-1newar25.py/rg11120 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
maj_articles_recents (wikipedia:fr; User:ZéroBot) Pywikibot/2.0b3 (g4795) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
welcome (wikipedia:ru; User:Dima_st_bk_bot) Pywikibot/2.0b3 (g3) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
GoogleBot-Image/1.0 - php=hhvm
 text/..
welcome (wikipedia:ru; User:Dima_st_bk_bot) Pywikibot/2.0b3 (g2) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
MediaWiki::Bot/3.2.6 - php=hhvm
 application/json
YisouSpider zh-cn,en-us,zh-tw,en-gb,en; php=hhvm
 text/..
addLabel (wikidata:wikidata; User:PLbot) Pywikibot/2.0b3 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
Mozilla/5.0 (compatible; OrangeBot/2.0; mail address ) fr; q=1.0, en; q=0.5, *; q=0.1 php=hhvm
 text/..
wymowa (commons:commons; User:Alkamid) Pywikibot/2.0b3 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
Hoo Bot (https://meta.wikimedia.org/wiki/User:Hoo_man) - php=hhvm;https=1 (null)
 application/json
 text/..
adddescralbum (wikidata:wikidata; User:RobotMichiel1972) Pywikibot/2.0b3 (s5895) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
AniBot/0.9 php/curl - php=hhvm
 application/vnd.php.serialized
HTMLParser/2.0 - php=hhvm
 text/..
adddescr (wikidata:wikidata; User:RobotMichiel1972) Pywikibot/2.0b3 (s5895) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.1 KHTML Chrome/21.0.1180.89 Safari/537.1; 360Spider zh-CN php=hhvm
 text/..
tigerbot - php=hhvm;https=1 (null)
 application/json
 text/..
GoogleBot-Image/1.0 - - (null)
 image/..
 text/..
Twitterbot/1.0 - php=hhvm
 text/..
unknown Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (Exabot-Thumbnails) en,* -
 image/..
addbot (commons:commons; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
MediaWiki::Bot/5.005006 - php=hhvm (null)
 application/json
adddescrauteur (wikidata:wikidata; User:RobotMichiel1972) Pywikibot/2.0b3 (s5895) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
pywikipedia-newinterwiki-fa.py/rg11077 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
pywikipedia-radeh.py/rg11084 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
pywikibot-compat-commonscat.py/rg11120 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
DigitalsmithsBot - php=hhvm
 text/..
porzucone (wiktionary:pl; User:AlkamidBot) Pywikibot/2.0b3 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
addbot (wikidata:wikidata; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
php wikibot classes - php=hhvm (null)
 application/vnd.php.serialized
 text/..
RBot/0.3 ( mail address ) - php=hhvm
 application/json
 text/..
adddescralbum (wikipedia:en) Pywikibot/2.0b3 (s5895) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
iw2data/r-1 (unknown) Pywikipediabot/2.0 - php=hhvm;https=1 (null)
 application/json
pywikipedia-zz_make_cat.py/rg11084 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
run_pagefromfile.2/r-1 (unknown) Pywikipediabot/2.0 - php=hhvm;https=1 (null)
 application/json
UAA-UAA.py/r10417 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
MediaWiki::Bot/3.005002 - php=hhvm
 application/json
GoogleBot-Video/1.0 - php=hhvm
 text/..
run_pagefromfile.3/r-1 (unknown) Pywikipediabot/2.0 - php=hhvm;https=1 (null)
 application/json
DotNetWikiBot/3.11 (Microsoft Windows NT 6.2.9200.0; ) - php=hhvm
 text/..
LTBot en-us,en;q=0.5 php=hhvm
 text/..
AnomieBOT/1.0 (TagDater; see [[User:AnomieBOT]]) - php=hhvm (null)
 application/json
welcome (wikipedia:lt; User:Homobot) Pywikibot/2.0b3 (3) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
PythonWikipediaBot/1.0 - php=hhvm
 application/json
 text/..
compat-checkimages.py/rs11096 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
gnd2 (wikidata:wikidata; User:PLbot) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.5.final.0 - php=hhvm;https=1
 application/json
pywiki-newar25.py/rg11120 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
compat-label_bot.py/rg11051 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
mrmetadata (wikipedia:en) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
MediaWiki::Bot/3.1.6 (User:SporkBot) - php=hhvm
 application/json
pywikibot-compat-abi-17-progreso1911.py/rg10993 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
mussol-mussol.py/r-1 (unknown) Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
DotNetWikiBot/2.100 (Unix 3.2.0.59; ) - php=hhvm;https=1 (null)
 text/..
 application/xml
indexer2 (wikipedia:en; User:Legobot) Pywikibot/2.0b3 (g4842) httplib2/0.9 Python/3.4.0.final.0 - php=hhvm;https=1 (null)
 application/json
spider - php=hhvm
 text/..
 application/json
 application/vnd.php.serialized
python-wikitools/1.2 (User:DickensBot) - php=hhvm
 application/json
MediaWiki::Bot/5.005006 (User:lustiger_seth) - php=hhvm;https=1 (null)
 application/json
WorldOfMusicBetaBot/1.0 - php=hhvm
 text/..
Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.1 KHTML Chrome/21.0.1180.89 Safari/537.1; 360Spider zh-CN php=hhvm;https=1 (null)
 text/..
LRI.fr bot mail address - php=hhvm
 application/json
GoogleBot (gocrawl v0.4) - php=hhvm
 text/..
pywikipedia-com_cat.py/r10809 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
mail address mail address – MediaWiki Tcl Bot Framework 1.0 - php=hhvm;https=1 (null)
 application/json
interwiki (wikinews:es; User:Ralgisbot) Pywikibot/2.0b1 (g4173) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
cat_finder-core (wikipedia:fa; User:Rezabot) Pywikibot/2.0b2 (g4582) httplib2/0.8 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
YisouSpider - php=hhvm
 text/..
 application/json
mrmetadata (commons:commons; User:Seven-League_Bot) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
compat-redirect.py/rs11099 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
 text/..
py-navbox.py/rg11106 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
Owlin Bot v. 3.0 - php=hhvm
 text/..
redirect (wikipedia:en; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
addbot (wikipedia:en; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
unknown Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (Exabot-Thumbnails) en,* php=hhvm
 text/..
 image/..
bot-07-fix-language-mappings (wikidata:wikidata; User:AkkakkBot) Pywikibot/2.0b3 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
adddescrgebouw (wikidata:wikidata; User:RobotMichiel1972) Pywikibot/2.0b3 (s5895) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
redirect (wikipedia:en; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
pywikipedia-commonscat.py/rg10961 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
pywikipedia3-MakeScoreTable_test3.py/r11448 Pywikipediabot/1.0 - php=hhvm
 application/json
Nutch Spider/Nutch-2.2.1 - php=hhvm
 text/..
DotNetWikiBot/3.11 (Microsoft Windows NT 6.2.9200.0; ) - php=hhvm;https=1 (null)
 text/..
pywikipedia-interwiki.py/rg18 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
 application/xml
Twitterbot/1.0 - -
 image/..
 text/..
 application/ogg
SineBot/1.5.19(User:SineBot) - php=hhvm
 application/vnd.php.serialized
 text/..
pywikibot-compat-aaa_categorieAutori.py/rg10952 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
Mozilla/5.0 (Linux; Android/4.3; zh-CN; SCH-N719 Build/JSS15J) AppleWebKit/533.1 KHTML Version/4.0 YisouSpider/1.0.0 Mobile Safari/533.1 - php=hhvm
 text/..
clean_sandbox (wikinews:es; User:Ralgisbot) Pywikibot/2.0b1 (g4173) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
WPendata-importcategoryDEFAULT.py/r11052 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
GermCrawler - php=hhvm
 application/json
 text/..
refreshfeeds (wikinews:ru; User:AKBot) Pywikibot/2.0b3 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
pywikipedia-rad1.py/r10582 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
MyCuteBot/0.1 - php=hhvm
 text/..
 application/json
sport (wikipedia:fr; User:NaggoBot) Pywikibot/2.0b2 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
pwb/rg3009 Pywikipediabot/2.0 - php=hhvm;https=1 (null)
 application/json
GoogleBot-Image/1.0 - -
 image/..
 text/..
DotNetWikiBot/2.101 (Microsoft Windows NT 6.1.7601 Service Pack 1; ) - php=hhvm
 text/..
Mozilla/5.0 (compatible; uMBot-LN/1.0; mailto: mail address ) - php=hhvm
 text/..
dikantenyvaovao (wiktionary:mg; User:Bot-Jagwar) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
LTBot en-us,en;q=0.5 php=hhvm;https=1
 text/..
py-interwiki.py/rg11047 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
redirect (wikinews:es; User:Ralgisbot) Pywikibot/2.0b1 (g4173) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
cat_finder-core (wikidata:wikidata; User:Rezabot) Pywikibot/2.0b2 (g4582) httplib2/0.8 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
compat-interwiki.py/rg11111 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
 application/xml
Test Webbot - php=hhvm
 text/..
YisouSpider zh-cn,en-us,zh-tw,en-gb,en; php=hhvm;https=1 (null)
 text/..
pywikibot-compat-aaa_elenco.py/rg10952 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
ko_newpage/r-1 (unknown) Pywikipediabot/2.0 - php=hhvm;https=1 (null)
 application/json
pywikipedia-zzaddnavebox.py/rg11084 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
wymowa (wiktionary:pl; User:AlkamidBot) Pywikibot/2.0b3 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
ifd-hoobot (wikidata:wikidata; User:PLbot) Pywikibot/2.0b3 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
gsa-crawler (Enterprise; T2-KPTYDNBXJWWKK; mail address ) - php=hhvm;https=1 (null)
 text/..
addbot (wikipedia:de; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
Twitterbot/1.0 - php=hhvm;https=1 (null)
 text/..
Bub's wikibot (Wikibot/2011111111; JWBF/1.2; Java/1.8) - php=hhvm;https=1 (null)
 text/..
welcome-c (wikipedia:fr; User:Loveless) Pywikibot/2.0b2 (g4566) httplib2/0.9 Python/2.7.6.final.0 - php=hhvm;https=1 (null)
 application/json
Spiderbot/Nutch-1.7 en-us,en-gb,en;q=0.7,*;q=0.3 php=hhvm
 text/..
GoogleBot-Image/1.0 - https=1;php=hhvm (null)
 text/..
My Nutch Spider/Nutch-2.2.1 - php=hhvm
 text/..
AnomieBOT/1.0 (FlagIconRemover; see [[User:AnomieBOT]]) - php=hhvm (null)
 application/json
AnomieBOT/1.0 (OrphanReferenceFixer; see [[User:AnomieBOT]]) - php=hhvm (null)
 application/json
SPIupdater-globalfunc.py/r10417 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
Bot at mysite.com - php=hhvm
 text/..
Mozilla/5.0 (Linux; Android/4.2.2; en-us; CUBOT P9 Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 en-US -
 image/..
Mozilla/5.0 (compatible; uMBot-FC/1.0; mailto: mail address ) - php=hhvm
 text/..
RBot/0.3 ( mail address ) - -
 image/..
ContextAd Bot 1.0 - php=hhvm
 text/..
SearchBot/Nutch-1.9 en-us,en-gb,en;q=0.7,*;q=0.3 php=hhvm
 text/..
GoogleBot-Video/1.0 - -
 application/ogg
 video/webm
CorenSearchBot/1.7 en libwww-perl/6.05 - php=hhvm;https=1 (null)
 text/..
moveClaims (wikidata:wikidata; User:PLbot) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.5.final.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (Linux; Android/4.3; ru-ru; Spider Build/JLS36C) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 ru-RU, en-US -
 image/..
Peachy MediaWiki Bot API Version 1.0 - php=hhvm (null)
 application/vnd.php.serialized
pywikipedia3-MakeScoreTable_10000.py/r11448 Pywikipediabot/1.0 - php=hhvm
 application/json
gsa-crawler (Enterprise; T2-KPTYDNBXJWWKK; mail address ) - php=hhvm
 text/..
com.apple.Safari.WebFeedParser/600.1.4 CFNetwork/711.1.16 Darwin/14.0.0 en-us php=hhvm
 application/xml
 text/..
SurakWare MediaWiki Bot/1.0 - php=hhvm;https=1 (null)
 text/..
Mozilla/5.0 (Linux; Android/4.2.1; es-es; CUBOT ONE Build/JOP40D) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 es-ES, en-US -
 image/..
Mozilla/5.0 (Linux; Android/4.2.2; de-de; CUBOT P9 Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 de-DE, en-US -
 image/..
GoogleBot/Nutch-1.7 en-us,en-gb,en;q=0.7,*;q=0.3 php=hhvm
 text/..
node-crawler/0.2.5 - php=hhvm
 text/..
pywikipedia-zzfawikipatroler.py/rg11084 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
TicketsBot/0.1 - php=hhvm
 text/..
AnomieBOT/1.0 (PERTableUpdater; see [[User:AnomieBOT]]) - php=hhvm (null)
 application/json
pywikipedia-zzpurging.py/rg11084 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
addbot (wikipedia:fr; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
mrmetadata (wikipedia:id) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
wikiparser/1 CFNetwork/673.5 Darwin/13.4.0 (x86_64) (MacPro5,1) en-us -
 image/..
YandexExtdataBot/1.0 ( mail address ) - php=hhvm
 application/json
DotNetWikiBot/2.103 (Microsoft Windows NT 6.1.7601 Service Pack 1; ) - php=hhvm;https=1
 text/..
 application/xml
robospider/1.0 - php=hhvm
 text/..
svnpywikipedia-interwiki.py/r11270 Pywikipediabot/1.0 - php=hhvm
 application/json
Mozilla/5.0 (X11; compatible; semantic-visions.com crawler; HTTPClient 3.1) - php=hhvm
 text/..
redirect (wikipedia:nl; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
DotNetWikiBot/2.101 (Unix 3.1.9.0; ) - php=hhvm;https=1
 text/..
BeneBot*/1.0 WikibasePhpLib/0.1 - php=hhvm (null)
 application/json
DotNetWikiBot/2.102 (Microsoft Windows NT 6.2.9200.0; ) - php=hhvm;https=1 (null)
 text/..
 application/xml
Mozilla/5.0 (Linux; Android/4.3; zh-CN; SCH-N719 Build/JSS15J) AppleWebKit/533.1 KHTML Version/4.0 YisouSpider/1.0.0 Mobile Safari/533.1 zh-cn,en-us,zh-tw,en-gb,en; php=hhvm
 text/..
addbot (wikipedia:es; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
DotNetWikiBot/2.101 (Microsoft Windows NT 6.1.7601 Service Pack 1; ) - php=hhvm;https=1 (null)
 application/xml
 text/..
vm-auto-erl-neu (wikipedia:de; User:Xqbot) Pywikibot/2.0b3 (s5878) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
pywikibot-compat-sichteroptin.py/r10883 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
 text/..
addbot (wikipedia:it; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
botpywi-analyse_article.py/rg11108 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
GoogleBot-Image/1.0 - php=hhvm;https=1 (null)
 text/..
mrmetadata (wikipedia:fr) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
wikiparser/1 CFNetwork/673.5 Darwin/13.4.0 (x86_64) (MacPro5,1) en-us php=hhvm
 text/..
redirect (wikipedia:sv; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
dikantenyvaovao (wiktionary:en) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
compat-redirect.py/rg10957 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
AnomieBOT/1.0 (TemplateSubster; see [[User:AnomieBOT]]) - php=hhvm (null)
 application/json
Mozilla/5.0 (Linux; Android/4.2.2; it-it; CUBOT P9 Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 it-IT, en-US -
 image/..
php wikibot classes - php=hhvm;https=1
 application/vnd.php.serialized
fixing_redirects (wikipedia:sr; User:MilicevicBot) Pywikibot/2.0b2 (3) httplib2/0.9 Python/2.7.6.final.0 - php=hhvm;https=1 (null)
 application/json
category_redirect (wikipedia:ar; User:ZkBot) Pywikibot/2.0b3 (g4872) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
tdrx-location-image-crawler: one-time crawl, about 100,000 images; please contact mail address and temporarily block if this causes any inconvenience to the site. I am using a single thread. - -
 image/..
Mozilla/5.0 (Linux; Android/4.2.2; es-es; CUBOT P9 Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 es-ES, en-US -
 image/..
Mozilla/5.0 (Linux; Android/4.2.2; de-de; CUBOT X6 Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 de-DE, en-US -
 image/..
ArchiveTeam ArchiveBot/20141230.01 (wpull 0.1005a1) and not Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 KHTML Chrome/39.0.2171.95 Safari/537.36 - php=hhvm
 text/..
mrmetadata (wikipedia:it) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
redirect (wikipedia:sv; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
mrmetadata (wikipedia:ja) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
mrmetadata (wikipedia:ru) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
redirect (wikipedia:war; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (Linux; Android/4.2.1; de-de; CUBOT ONE Build/JOP40D) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 de-DE, en-US -
 image/..
FP (commons:commons; User:SteinsplitterBot) Pywikibot/2.0b2 httplib2/0.8 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
AnomieBOT/1.0 (BAGBot; see [[User:AnomieBOT]]) - php=hhvm (null)
 application/json
 text/..
milog_bot/1.0 ( mail address ) - php=hhvm
 text/..
pywikipedia-zzgallery.py/rg11084 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
compat-pwb.py/rg11092 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
 text/..
Mozilla/5.0 (Linux; Android/4.2.2; es-es; CUBOT X6 Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 es-ES, en-US -
 image/..
redirect (wikipedia:de; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
pywikipedia-amb_mehrdadbot.py/r2 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
unknown Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (Exabot-Thumbnails) en;q=0.9,*;q=0.8 php=hhvm
 text/..
"Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534 KHTML MsnBot-Media /1.0b" en-US -
 image/..
 text/..
cd-delinker.py/r11775 Pywikipediabot/1.0 - php=hhvm (null)
 application/json
PHPCrawl - php=hhvm
 text/..
redirect (wikipedia:fr; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
COIBot/1.00 - php=hhvm (null)
 text/..
pywikipedia-bot_rss.py/rg14444 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
php wikibot classes - php=hhvm;https=1 (null)
 application/vnd.php.serialized
Update_cats_and_iwiki (commons:commons) Pywikibot/2.0b3 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
AnomieBOT/1.0 (RandomPagePicker; see [[User:AnomieBOT]]) - php=hhvm (null)
 application/json
ifd-empty (wikidata:wikidata; User:PLbot) Pywikibot/2.0b3 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
addbot (wikipedia:pl; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
pywikibot-compat-redirect.py/rg10993 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
Mozilla/5.0 (Linux; Android/4.2.2; fr-fr; CUBOT P9 Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 fr-FR, en-US -
 image/..
Mozilla/5.0 (Apibot Browser) - -
 image/..
datetemplates (wikipedia:en; User:Cerabot) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
redirect (wikipedia:pl; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
redirect (wikipedia:es; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
redirect (wikipedia:ceb; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
COIBot/2.0 - php=hhvm (null)
 text/..
BuiBui-Bot/1.0 (3m4il: buibui[dot]bot[à7]moquadv[dot]com) - php=hhvm
 text/..
addbot (wikipedia:pt; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
t9/rg2816 Pywikipediabot/2.0 - php=hhvm;https=1 (null)
 application/json
Mozilla/5.0 (Linux; Android/4.2.1; es-es; CUBOT GT99 Build/JOP40D) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 es-ES, en-US -
 image/..
redirect (wikipedia:de; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
wikt-es-nom-forma.py/rg10914 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
pywikibot-compat-dobrodoslice.py/rg11089 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
addbot (wikipedia:ca; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
redirect (wikipedia:es; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
touch (wikipedia:sr; User:MilicevicBot) Pywikibot/2.0b2 (3) httplib2/0.9 Python/2.7.6.final.0 - php=hhvm;https=1
 application/json
webcrawler - php=hhvm
 text/..
harvest_template (wikidata:wikidata; User:BotMultichill) Pywikibot/2.0b3 (g4813) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
create_gregorian_date_pages (wikidata:wikidata; User:Mjbmrbot) Pywikibot/2.0b3 (g4864) httplib2/0.9 Python/2.7.5.final.0 - php=hhvm;https=1 (null)
 application/json
Mozilla/5.0 (Linux; Android/4.2.2; de-de; CUBOT GT72E Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 de-DE, en-US -
 image/..
YOUBot (Youniversal Media Bot) - php=hhvm
 text/..
redirect (wikipedia:fa; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
MoodleBot/1.0 - php=hhvm
 application/xml
 text/..
mrmetadata (wikipedia:zh) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
redirect/-1 (unknown) Pywikibot/2.0 (User:Rahl43bot) - php=hhvm;https=1 (null)
 application/json
redirect (wikipedia:vi; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
bar (wikipedia:it; User:IncolaBot) Pywikibot/2.0b3 (g2) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
setup (wikipedia:en; User:Pywikibot-test) Pywikibot/2.0b3 (g1784) httplib2/0.9 Python/2.6.9.final.0 - php=hhvm;https=1 (null)
 application/json
redirect (wikipedia:ca; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
mrmetadata (wikipedia:de) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
pywikipedia-wikifyer.py/rg11084 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
GoogleBot/Nutch-1.9-SNAPSHOT en-us,en-gb,en;q=0.7,*;q=0.3 php=hhvm
 text/..
redirect (wikipedia:ar; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
XLinkBot/1.00 - php=hhvm (null)
 text/..
My bot mail address - php=hhvm
 text/..
redirect (wikipedia:war; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
create_gregorian_date_pages (wikinews:fa; User:Mjbmrbot) Pywikibot/2.0b3 (g4864) httplib2/0.9 Python/2.7.5.final.0 - php=hhvm;https=1 (null)
 application/json
addbot (wikipedia:cs; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
fixing_redirects (wikipedia:sr; User:MilicevicBot) Pywikibot/2.0b2 (3) httplib2/0.9 Python/2.7.6.final.0 - php=hhvm;https=1
 application/json
Peachy MediaWiki Bot API Version 2.0 (alpha 8) - php=hhvm;https=1 (null)
 application/vnd.php.serialized
 text/..
redirect (wikipedia:nl; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
redirect (wikipedia:ceb; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
pywikipedia-git-dar.py/rg90 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
replace (wikipedia:fr; User:Escarbot) Pywikibot/2.0b3 (g4872) httplib2/0.9 Python/2.7.9.final.0 - php=hhvm;https=1 (null)
 application/json
AnomieBOT/1.0 (AFDMergeFromCleaner; see [[User:AnomieBOT]]) - php=hhvm (null)
 application/json
ArchiveTeam ArchiveBot/20141230.01 (wpull 0.1005a1) and not Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 KHTML Chrome/39.0.2171.95 Safari/537.36 - -
 image/..
 application/ogg
redirect (wikipedia:zh; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
MediaWiki::Bot/5.005006 - php=hhvm
 application/json
addbot (wikipedia:sk; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
MediaWiki::Bot/dev - php=hhvm
 application/json
gsa-crawler (Enterprise; T4-LL7J6JQDJC263; mail address , mail address ) - php=hhvm
 text/..
harvest_template (wikidata:wikidata; User:BotMultichill) Pywikibot/2.0b3 (g4818) httplib2/0.8 Python/2.7.2.final.0 - php=hhvm;https=1 (null)
 application/json
create_gregorian_date_pages (wikinews:uk) Pywikibot/2.0b3 (g4864) httplib2/0.9 Python/2.7.5.final.0 - php=hhvm;https=1 (null)
 application/json
mrmetadata (wikipedia:he) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
interwiki (wiktionary:zh; User:JAnDbot) Pywikibot/2.0b3 (s5906) httplib2/0.8 Python/2.7.6.final.0 - php=hhvm;https=1
 application/json
g13bot_tools-g13_nudge_bot.py/r-1 (unknown) Pywikipediabot/1.0 - php=hhvm (null)
 application/json
redirect (wikipedia:ja; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (Linux; Android/4.2.1; en-us; CUBOT ONE Build/JOP40D) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 en-US -
 image/..
 text/..
redirect (wikipedia:pt; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
bot-loose_category_from_gallery.py/rg10972 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
DotNetWikiBot/2.100 (Unix 3.2.0.60; ) - php=hhvm;https=1 (null)
 text/..
 application/xml
('python-wikitools/1.1.1 (User:GrantsBot)',) - php=hhvm (null)
 application/json
RSS Bot/1.9 (Mac OS X Version 10.10.1 (Build 14B25)) en;q=1 php=hhvm;https=1 (null)
 application/xml
redirect (wikipedia:ru; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
setup (wikipedia:en; User:Pywikibot-test) Pywikibot/2.0b3 (g1855) httplib2/0.9 Python/3.3.5.final.0 - php=hhvm;https=1 (null)
 application/json
Webwiki Search Engine Bot - www.webwiki.de - php=hhvm
 text/..
redirect (wikipedia:ja; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
compat-gs-VM-auto-erl2.py/rs11096 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
User-Agent Baiduspider - php=hhvm
 text/..
addbot (wikipedia:ja; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
addbot (wikipedia:ru; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
dikantenyvaovao (wiktionary:ca) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
MWFeedParser de-de php=hhvm;https=1
 application/xml
create_gregorian_date_pages (wikinews:el) Pywikibot/2.0b3 (g4864) httplib2/0.9 Python/2.7.5.final.0 - php=hhvm;https=1 (null)
 application/json
addbot (wikipedia:fa; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
pywikilab-llista_mils.py/r-1 (unknown) Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
UKBot [[:no:Bruker:UKBot]] - MwClient/0.7.2dev (https://github.com/mwclient/mwclient) - php=hhvm (null)
 application/json
redirect (wikipedia:ru; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
update-regular-users (wikipedia:en; User:SuggestBot) Pywikibot/2.0b2 httplib2/0.9 Python/2.7.1.final.0 - php=hhvm;https=1 (null)
 application/json
compat-welcome.py/rg11087 Pywikipediabot/1.0 - php=hhvm;https=1
 application/json
create_gregorian_date_pages (wikinews:sv) Pywikibot/2.0b3 (g4864) httplib2/0.9 Python/2.7.5.final.0 - php=hhvm;https=1 (null)
 application/json
request-daemon (wikipedia:pt; User:SuggestBot) Pywikibot/2.0b2 httplib2/0.9 Python/2.7.1.final.0 - php=hhvm;https=1 (null)
 application/json
addbot (wikipedia:zh; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
Mozilla/5.0 (Linux; Android/4.2.1; it-it; CUBOT ONE Build/JOP40D) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 it-IT, en-US -
 image/..
mrmetadata (wikipedia:hu) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
Mozilla/5.0 (Linux; Android/4.3; ru-ru; Spider Build/JLS36C) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 ru-RU, en-US php=hhvm
 text/..
 image/..
transferbot (wikipedia:co) Pywikibot/2.0b2 (g4618) httplib2/0.9 Python/2.7.8.final.0 - php=hhvm;https=1 (null)
 application/json
addbot (wikipedia:sv; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
Mozilla/5.0 (Linux; Android/4.3; Spider Build/JLS36C) AppleWebKit/537.36 KHTML Chrome/39.0.2171.93 Mobile Safari/537.36 ru-RU,ru;q=0.8,en-US;q=0.6,en;q=0.4 -
 image/..
mrmetadata (wikipedia:th) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.1 KHTML Chrome/21.0.1180.89 Safari/537.1; 360Spider - php=hhvm
 text/..
 application/json
redirect (wikipedia:hu; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
WikiBot/0.1 - php=hhvm
 text/..
setup (wikipedia:en; User:Pywikibot-test) Pywikibot/2.0b3 (g1736) httplib2/0.9 Python/3.3.5.final.0 - php=hhvm;https=1 (null)
 application/json
Mozilla/5.0 (compatible; SputnikImageBot/2.3) - -
 image/..
adddescrauteur (wikipedia:en) Pywikibot/2.0b3 (s5895) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
addbot (wikipedia:ko; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
Mozilla/5.0 (Linux; Android/4.2.1; it-it; CUBOT GT99 Build/JOP40D) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 it-IT, en-US -
 image/..
mrmetadata (wikipedia:mr) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
p3 (wikipedia:en; User:InwBot) Pywikibot/2.0b2 httplib2/0.9 Python/2.7.8.final.0 - php=hhvm;https=1
 application/json
adddescralbum (wikipedia:nl; User:RobotMichiel1972) Pywikibot/2.0b3 (s5895) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
Riki Solution crawler/riki-1.6 (riki test spider; www.myriki.com; mail address ) fr,en-us,en-gb,en;q=0.7,*;q=0.3 php=hhvm
 text/..
Mozilla/5.0 (Linux; Android/4.2.2; en-us; S222 Build/CUBOT) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 en-US -
 image/..
gsa-crawler (Enterprise; T4-N4DP54QDKA66K; mail address ) - php=hhvm
 text/..
Mozilla/5.0 (Linux; Android/4.2.2; ru-ru; CUBOT P9 Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 ru-RU, en-US -
 image/..
ArchiveTeam ArchiveBot/20141229.01 (wpull 0.1005a1) and not Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 KHTML Chrome/39.0.2171.95 Safari/537.36 * -
 image/..
redirect (wikipedia:fa; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
vic/rg2781 Pywikipediabot/2.0 - php=hhvm;https=1 (null)
 application/json
Wikibot/2.1.1 CFNetwork/672.1.15 Darwin/14.0.0 en-us -
 image/..
badge_new (wikidata:wikidata; User:Dexbot) Pywikibot/2.0b2 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
erfgoedbot-categorize_images.py/rg10979 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
Mozilla/5.0 (compatible; MyBot/1.0;) - php=hhvm
 application/json
addbot (wikipedia:hu; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
unittest (wikipedia:en; User:JVbot) Pywikibot/2.0b3 (g4871) httplib2/0.9 Python/2.7.9.final.0 - php=hhvm;https=1 (null)
 application/json
Baidu-YunGuanCe-Bot(ce.baidu.com) zh-CN,zh;q=0.8,zh-TW;q=0.6 php=hhvm
 text/..
create_gregorian_date_pages (wikinews:pl) Pywikibot/2.0b3 (g4864) httplib2/0.9 Python/2.7.5.final.0 - php=hhvm;https=1 (null)
 application/json
com.apple.Safari.WebFeedParser/600.1.4 CFNetwork/711.0.6 Darwin/14.0.0 en-us php=hhvm
 application/xml
 text/..
setup (wikipedia:en; User:Pywikibot-test) Pywikibot/2.0b3 (g1784) httplib2/0.9 Python/3.3.5.final.0 - php=hhvm;https=1 (null)
 application/json
compat-fr1er.py/r-1 (unknown) Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
badge_good_new (wikipedia:el; User:Dexbot) Pywikibot/2.0b2 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
PythonWikipediaBot/1.0 - php=hhvm;https=1
 text/..
EarwigBot/0.2.devgit-b87d5ac6 (Python/2.7.3; https://github.com/earwig/earwigbot; mail address ) - php=hhvm;https=1 (null)
 application/json
redirect (wikipedia:eo; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
redirect (wikipedia:it; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
bar (wikipedia:it; User:IncolaBot) Pywikibot/2.0b3 (g3) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
Mozilla/5.0 (Linux; Android/4.2.2; en-us; CUBOT GT72E Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 en-US -
 image/..
mrmetadata (wikipedia:ro) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
Wikibot/2.1.1 CFNetwork/711.1.16 Darwin/14.0.0 en-us -
 image/..
mrmetadata (wikipedia:uk) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
bible-genealogy (wikidata:wikidata; User:Karan85) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.8.final.0 - php=hhvm;https=1 (null)
 application/json
canvi (wikipedia:ca; User:JoRobot) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
DotNetWikiBot/3.12 (Unix 3.2.0.59; ) - php=hhvm;https=1 (null)
 text/..
redirect (wikipedia:ms; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
create_gregorian_date_pages (wikinews:it) Pywikibot/2.0b3 (g4864) httplib2/0.9 Python/2.7.5.final.0 - php=hhvm;https=1 (null)
 application/json
addbot (wikipedia:bs; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
Mozilla/5.0 (compatible; ca-crawler/1.0) - php=hhvm
 text/..
Dalvik/1.6.0 (Linux; Android/4.2.1; CUBOT ONE Build/JOP40D) - -
 image/..
GoogleBot-Image/1.0 - php=hhvm
 text/..
badge_good_new (wikidata:wikidata; User:Dexbot) Pywikibot/2.0b2 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
BOT/0.1 (BOT for JCE) - php=zend
 text/..
setup (wikipedia:en; User:Pywikibot-test) Pywikibot/2.0b3 (g1853) httplib2/0.9 Python/2.6.9.final.0 - php=hhvm;https=1 (null)
 application/json
Mozilla/5.0 (Linux; Android/4.2.2; es-es; CUBOT P9 Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 es-ES, en-US php=zend
 -
setup (wiktionary:en; User:UnicornBot) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.6.final.0 - php=hhvm;https=1 (null)
 application/json
Mozilla/5.0 (Linux; Android/4.2.2; en-us; CUBOT X6 Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 en-US -
 image/..
create_gregorian_date_pages (wikinews:de) Pywikibot/2.0b3 (g4864) httplib2/0.9 Python/2.7.5.final.0 - php=hhvm;https=1 (null)
 application/json
Mozilla/5.0 (Linux; Android/4.2.1; es-es; CUBOT ONE Build/JOP40D) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 es-ES, en-US php=hhvm
 text/..
mrmetadata (wikipedia:fa) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
GoogleBot/Nutch-1.9-SNAPSHOT en-us,en-gb,en;q=0.7,*;q=0.3 -
 image/..
node.js - nodemw - mail address - Maintainer: Rainer Rillke - mail address - [[:commons:User:Rillke]] - php=hhvm (null)
 application/json
Wikibot/2.1.1 CFNetwork/609.1.4 Darwin/13.0.0 en-gb -
 image/..
pwb/r2631 Pywikipediabot/2.0 - php=hhvm;https=1 (null)
 application/json
Mozilla/5.0 (Linux; Android/4.2.2; fa-ir; GLX SpiderI Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 fa-IR, en-US -
 image/..
Mozilla/5.0 (Linux; Android/4.2.2; de-de; CUBOT X6 Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 de-DE, en-US php=hhvm
 image/..
 text/..
Mozilla/5.0 (iPhone; CPU iPhone OS 6_0_1 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko; Google Page Speed Insights) Version/6.0 Mobile/10A525 Safari/8536.25 GoogleBot/2.1 - -
 image/..
create_gregorian_date_pages (wikinews:zh) Pywikibot/2.0b3 (g4864) httplib2/0.9 Python/2.7.5.final.0 - php=hhvm;https=1 (null)
 application/json
SearchBot/Nutch-1.9 en-us,en-gb,en;q=0.7,*;q=0.3 php=hhvm;https=1 (null)
 text/..
redirect (wikipedia:ko; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
mrmetadata (wikipedia:az) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
Mozilla/5.0 (compatible; publiclibraryarchive.org/1.0; mail address ) de-de,de,en-us,en-gb,en;q=0.7,*;q=0.3 php=hhvm
 text/..
mrmetadata (wikipedia:vi) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
DotNetWikiBot/2.96 (Microsoft Windows NT 6.1.7601 Service Pack 1; ) - php=hhvm
 text/..
mrmetadata (wikipedia:gl) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
ZeBigWebBot - php=hhvm
 text/..
recreation (wikipedia:fr; User:ZéroBot) Pywikibot/2.0b3 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
SNK Screenshot Bot/0.20 ( mail address ) en,* -
 image/..
6951784 (commons:commons; User:RussBot) Pywikibot/2.0b3 (g3) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
"Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534 KHTML MsnBot-Media /1.0b" - -
 image/..
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko; Google Page Speed Insights) Chrome/27.0.1453 Safari/537.36 GoogleBot/2.1 - -
 image/..
private_collection (wikidata:wikidata; User:BotMultichill) Pywikibot/2.0b3 (g4818) httplib2/0.8 Python/2.7.2.final.0 - php=hhvm;https=1 (null)
 application/json
create_gregorian_date_pages (wikinews:bs) Pywikibot/2.0b3 (g4864) httplib2/0.9 Python/2.7.5.final.0 - php=hhvm;https=1 (null)
 application/json
redirect (wikipedia:id; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
Mozilla/5.0 (Linux; Android/4.2.2; it-it; CUBOT X6 Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 it-IT, en-US -
 image/..
cocytus-output (wikipedia:sh) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.6.final.0 - php=hhvm;https=1 (null)
 application/json
pywikipedia-git-maghalesaz_cmd2.py/rg90 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
pywikibot-compat-redirect.py/rg11120 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
AnomieBOT/1.0 (DeletionSortingCleaner; see [[User:AnomieBOT]]) - php=hhvm (null)
 application/json
Mozilla/5.0 (Linux; Android/4.2.1; it-it; CUBOT GT99 Build/JOP40D) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 it-IT, en-US php=hhvm
 image/..
 text/..
Goalkeeperbot(User:Beetstra)/1.0 - php=hhvm (null)
 text/..
redirect (wikipedia:fr; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
cat (wikipedia:pt; User:Alch_Bot) Pywikibot/2.0b3 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
redirect (wikipedia:no; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
mrmetadata (wikipedia:sr) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
Inlibris.com XMLBot/1.0 - php=hhvm
 text/..
Dalvik/1.6.0 (Linux; Android/4.2.2; CUBOT X6 Build/JDQ39) - php=hhvm;https=1
 text/..
CheMoBot/1.00 - php=hhvm (null)
 text/..
MediaWiki::Bot/5.005007 - php=hhvm;https=1 (null)
 application/json
Yeobot/1.1 Contact: mail address ) - php=hhvm
 text/..
DotNetWikiBot/2.92 (Microsoft Windows NT 6.1.7600.0; ) - php=hhvm
 text/..
 application/xml
COIBot/1.00 - php=hhvm;https=1 (null)
 text/..
mrmetadata (wikipedia:fi) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
rapid-miner-crawler - php=hhvm
 text/..
RSS Bot/1.9 (Mac OS X Version 10.10.1 (Build 14B25)) en;q=1 php=hhvm;https=1
 application/xml
addbot (wikipedia:eo; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
Mozilla/5.0 (Linux; Android/4.2.2; fr-fr; CUBOT GT72E Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 fr-FR, en-US -
 image/..
MediaWiki::PerlBot/User:Wdwdbot - php=hhvm;https=1
 application/json
pywikipedia-zzcity_article_cmd.py/rg11084 Pywikipediabot/1.0 - php=hhvm;https=1 (null)
 application/json
Mozilla/5.0 (Linux; Android/4.2.2; ru-ru; CUBOT X6 Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 ru-RU, en-US -
 image/..
redirect (wikipedia:vi; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
YOUBot (Youniversal Media Bot) - -
 image/..
request-daemon (wikipedia:no; User:AnbefalingsBot) Pywikibot/2.0b2 httplib2/0.9 Python/2.7.1.final.0 - php=hhvm;https=1 (null)
 application/json
Mozilla/5.0 (Linux; Android/4.2.2; es-es; CUBOT_P7 Build/JDQ39) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 es-ES, en-US -
 image/..
Mozilla/5.0 (Linux; Android/4.2.1; fr-fr; CUBOT ONE Build/JOP40D) AppleWebKit/534.30 KHTML Version/4.0 Mobile Safari/534.30 fr-FR, en-US -
 image/..
redirect (wikipedia:ar; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
getpages (wikipedia:de; User:Wolfgang_Liebig) Pywikibot/2.0b2 (-1 (unknown)) httplib2/0.8 Python/2.7.8.final.0 - php=hhvm;https=1 (null)
 application/json
harvest_template (wikipedia:it; User:BotMultichill) Pywikibot/2.0b3 (g4813) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
mrmetadata (wikiversity:en) Pywikibot/2.0b3 httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
archiv-erl-bot (wikipedia:de; User:SpBot) Pywikibot/2.0b2 (g4674) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
MediaWiki::Bot/5.005007 - php=hhvm
 application/json
addbot (wikipedia:nl; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
redirect (wikipedia:sr; User:Xqbot) Pywikibot/2.0b3 (s5897) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
MaxPointCrawler/Nutch-1.1 (maxpoint.crawler at maxpointinteractive dot com) en-us,en-gb,en;q=0.7,*;q=0.3 php=hhvm
 text/..
redirect (wikipedia:no; User:Xqbot) Pywikibot/2.0b3 (s5902) httplib2/0.9 Python/2.7.3.final.0 - php=hhvm;https=1
 application/json
ifd-category (wikidata:wikidata; User:PLbot) Pywikibot/2.0b3 httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
qic2/rg2781 Pywikipediabot/2.0 - php=hhvm;https=1 (null)
 application/json
ArchiveTeam ArchiveBot/20141229.01 (wpull 0.1005a1) and not Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 KHTML Chrome/39.0.2171.95 Safari/537.36 - - (null)
 image/..
addbot (wikipedia:uk; User:YiFeiBot) Pywikibot/2.0b2 (g4635) httplib2/0.7.2 Python/2.7.3.final.0 - php=hhvm;https=1 (null)
 application/json
39,639total

IP ranges: known ip ranges for Google are 64.233.[160.0-191.255], 66.249.[64.0-95.255], 66.102.[0.0-15.255], 72.14.[192.0-255.255],
74.125.[0.0-255.255], 209.085.[128.0-255.255], 216.239.[32.0-63.255] and a few minor other subranges

Errata: WMF traffic logging service suffered from server capacity problems in Aug/Sep/Oct 2011.
Absolute traffic counts for October 2011 are approximatly 7% too low.
Data loss only occurred during peak hours. It therefore may have had somewhat different impact for traffic from different parts of the world.
and may have also skewed relative figures like share of traffic per browser or operating system.

From mid September till late November squid log records for mobile traffic were in invalid format.
Data could be repaired for logs from mid October onwards. Older logs were no longer available.

In a an unrelated server outage precisely half of traffic to WMF mobile sites was not counted from Oct 16 - Nov 29 (one of two load-balanced servers did not report traffic).
WMF has since improved server monitoring, so that similar outages should be detected and fixed much faster from now on.

Generated on Thu, Apr 9, 2015 15:59
Author:Erik Zachte (
Web site)
Mail: ezachte@### (no spam: ### = wikimedia.org)
All data and images on this page are in the public domain.

Note: page may load slower on Microsoft Internet explorer than on other major browsers