See also: Requests by destination or by origin / Methods / Scripts / User agents / Skins / Crawlers / Op.Sys. / Mobile devices / Browsers / Google / Country data / Traffic trends, and notes about reliability of these data

The following overview of crawler (aka bot) page requests is based on the user agent information that accompanies most server requests. Unfortunately this user agent information follows rather loosely defined guidelines. Also please bear in mind than the most popular crawler names may be somewhat overrepresented. This is the result of so called user agent spoofing (where a requester supplies false credentials, e.g. to bypass web servers filters). GoogleBot seems to be a favorite for spoofing. Therefore requests from an ip address registered by Google (see below) are color coded GoogleBot, others GoogleBot For this report page requests are considered to be issued by a crawler in two cases: 1 The user agent string contains a web address (only crawlers should have that, but there a some false positives, where a browser sends a user agent string with a web address (ill behaved plug-in, main offenders have been eliminated) 2 The user agent string contains the term bot, spider or crawl[er]' In total 71,673,320 page requests (mime type text/html only!) per day are considered crawler requests, out of 472,465,580 external requests, which is 15.2%
Page requests for crawlers that specify a url in the agent string
Count x 1000	Secondary domain (~site) name	URL	Mime type	User agent
	google
		www.google.com/bot.html	text/..	Mozilla/5.0 (compatible; GoogleBot/2.1; url)
		www.google.com/bot.html	-	Mozilla/5.0 (compatible; GoogleBot/2.1; url)
		www.google.com/bot.html	text/..	Mozilla/5.0 (iPhone; CPU iPhone OS 4_1 like Mac OS X; en-us) AppleWebKit/532.9 KHTML Version/4.0.5 Mobile/8B117 Safari/6531.22.7 (compatible; GoogleBot-Mobile/2.1; url)
		www.google.com/bot.html	-	Mozilla/5.0 (iPhone; CPU iPhone OS 4_1 like Mac OS X; en-us) AppleWebKit/532.9 KHTML Version/4.0.5 Mobile/8B117 Safari/6531.22.7 (compatible; GoogleBot-Mobile/2.1; url)
		desktop.google.com/	application/xml	Mozilla/5.0 (compatible; Google Desktop/5.9.1005.12335; url)
		www.google.com/bot.html	image/..	Mozilla/5.0 (compatible; GoogleBot/2.1; url)
		www.google.com/bot.html	text/..	DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; GoogleBot-Mobile/2.1; url)
		www.google.com/bot.html	-	DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; GoogleBot-Mobile/2.1; url)
		www.google.com/bot.html	text/..	SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; GoogleBot-Mobile/2.1; url)
		www.google.com/bot.html	-	SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; GoogleBot-Mobile/2.1; url)
		desktop.google.com/	image/..	Mozilla/5.0 (compatible; Google Desktop/5.9.1005.12335; url)
		www.google.com/feedfetcher.html	image/..	Mozilla/5.0 (compatible) FeedFetcher-Google; (url)
		www.google.com/feedfetcher.html	-	FeedFetcher-Google; (url)
		www.google.com/feedfetcher.html	application/xml	FeedFetcher-Google; (url)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: ortografia4)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~cloudcrawling)
		www.google.com/feedfetcher.html	text/..	Mozilla/5.0 (compatible) FeedFetcher-Google; (url)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: wikien3)
		code.google.com/p/crawler4j/	text/..	crawler4j (url)
		www.google.com/feedfetcher.html	text/..	FeedFetcher-Google; (url)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: wikien4)
		www.google.com/feedfetcher.html	application/json	Mozilla/5.0 (compatible) FeedFetcher-Google; (url)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: hao1-prxoy)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: rarplayer)
		desktop.google.com/	text/..	Mozilla/5.0 (compatible; Google Desktop/5.9.1005.12335; url)
		code.google.com/appengine	application/json	AppEngine-Google; (url; appid: s~redconceptual)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: ortopedianew)
		code.google.com/appengine	text/..	WikiBot/0.1 AppEngine-Google; (url; appid: newikipedia)
		www.google.com/feedfetcher.html	application/xml	Mozilla/5.0 (compatible) FeedFetcher-Google; (url)
		code.google.com/appengine	text/..	Mozilla/5.0 (Windows; Windows NT 5.1; en-US; rv:1.9.0.7) Gecko/2009021910 Firefox/3.0.7 AppEngine-Google; (url; appid: s~fonetika3)
		code.google.com/appengine	application/xml	AppEngine-Google; (url; appid: wikipedia-raw)
		desktop.google.com/	application/xml	Mozilla/5.0 (compatible; Google Desktop/5.9.909.30391; url)
		www.google.com/feedfetcher.html	text/..	Mozilla/5.0 (compatible) FeedFetcher-Google;(url)
		code.google.com/appengine	image/..	AppEngine-Google; (url; appid: s~senchaiosrc)
		desktop.google.com/	application/xml	Mozilla/5.0 (compatible; Google Desktop/5.9.911.3589; url)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: usawebdl)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: abdulfat)
		code.google.com/appengine	image/..	Offline Mobile Wiki (Tel:44 141 334 5472, mail address ) AppEngine-Google; (url; appid: wiki2go)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~syytacit)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: azamasmadi)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~keytanwiki3)
		code.google.com/appengine	image/..	AppEngine-Google; (url; appid: d24-img)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~japantiki)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~wikigraph2)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~keytanwiki4)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~keytanwiki2)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~francetiki)
		www.google.com/bot.html	text/..	GoogleBot/2.1 (url)
		www.google.com/feedfetcher.html	image/..	Mozilla/5.0 (compatible) FeedFetcher-Google;(url)
		www.google.com/coop/cse/cref	text/..	FeedFetcher-Google-CoOp; (url)
		www.google.com/bot.html	image/..	DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; GoogleBot-Mobile/2.1; url)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: worldwide-propaganda)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: d24-img)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: pakgalaxy)
		desktop.google.com/	-	Mozilla/5.0 (compatible; Google Desktop/5.9.1005.12335; url)
		code.google.com/appengine	text/..	www.productontology.org/1.0 (Contact: mail address ) AppEngine-Google; (url; appid: gr4bing)
		code.google.com/appengine	application/json	Mozilla 4.0 AppEngine-Google; (url; appid: prfleme)
		code.google.com/appengine	text/..	Offline Mobile Wiki (Tel:44 141 334 5472, mail address ) AppEngine-Google; (url; appid: wiki2go)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: kires-roxy)
		docs.google.com	image/..	Mozilla/5.0 (compatible; GoogleDocs; documents; url)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: 114proxy)
		code.google.com/p/ronda	application/json	Ronda - url
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: threewiki)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~senchaiosrc)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: toom16-10)
		code.google.com/appengine	application/json	MWBOT GAE Edition AppEngine-Google; (url; appid: philip-bot)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~drizzlprox)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: mehproxy)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: wmhsonline)
		code.google.com/appengine	text/..	Mozilla/5.0 AppEngine-Google; (url; appid: s~app3123ak)
		www.google.com/feedfetcher.html	-	Mozilla/5.0 (compatible) FeedFetcher-Google; (url)
		code.google.com/appengine	application/json	AppEngine-Google; (url; appid: prfleme)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~proxyseekkety)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: tusawebproxy4)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: webusadlp9)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: python-proxy-server)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: proxy-devakishor)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~espanatiki)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: bloblastoro)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: atxproxy)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: ageryder)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: davrasaurs)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: dkoxyserv)
		desktop.google.com/	image/..	Mozilla/5.0 (compatible; Google Desktop/5.9.911.3589; url)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: wiwohk-proxy-server)
		code.google.com/appengine	application/json	Mozilla 3.5 AppEngine-Google; (url; appid: prfleme)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: burmansearch)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: s~italiatiki)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: proxyusing121)
		www.google.com/feedfetcher.html	image/..	FeedFetcher-Google; (url)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: pazvantoff)
		www.google.com/bot.html	NONE/wikipedia	- Mozilla/5.0 (compatible; GoogleBot/2.1; url)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: wwwwebp2)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: mrjosiaht)
		code.google.com/appengine	text/..	mail address AppEngine-Google; (url; appid: s~wiki-sherpa)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: wwwwebp8)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: khrixy)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: web-proxy-hh)
		code.google.com/p/ronda	text/..	Ronda - url
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: bie99miracle)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: thetechnolust)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: betafxserver)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: paradigm-web-proxy)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: kurizogeorge)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: funnyinternetwebsite)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: webproxy8-2)
		code.google.com/appengine	text/..	AppEngine-Google; (url; appid: boxapp)
	facebook
		www.facebook.com/externalhit_uatext.php	image/..	facebookexternalhit/1.0 (url)
		www.facebook.com/externalhit_uatext.php	text/..	facebookexternalhit/1.0 (url)
		developers.facebook.com	image/..	facebookplatform/1.0 (url)
		www.facebook.com/externalhit_uatext.php	text/..	facebookexternalhit/1.1 (url)
		www.facebook.com/externalhit_uatext.php	-	facebookexternalhit/1.0 (url)
		www.facebook.com/externalhit_uatext.php	image/..	facebookexternalhit/1.1 (url)
		developers.facebook.com	-	facebookplatform/1.0 (url)
		www.facebook.com/externalhit_uatext.php	application/json	facebookexternalhit/1.1 (url)
		developers.facebook.com	text/..	facebookplatform/1.0 (url)
		www.facebook.com/externalhit_uatext.php	application/vnd.php.serialized	facebookexternalhit/1.1 (url)
		www.facebook.com/externalhit_uatext.php	-	facebookexternalhit/1.1 (url)
	bing
		www.bing.com/bingbot.htm	text/..	Mozilla/5.0 (compatible; bingbot/2.0; url)
		www.bing.com/bingbot.htm	-	Mozilla/5.0 (compatible; bingbot/2.0; url)
		www.bing.com/bingbot.htm	image/..	Mozilla/5.0 (compatible; bingbot/2.0; url)
		www.bing.com/bingbot.htm	text/..	Mozilla/5.0 (compatible; bingbot/2.0; url) ASProxy/5.5b3
		www.bing.com/bingbot.htm	application/json	Mozilla/5.0 (compatible; bingbot/2.0; url)
		www.bing.com/bingbot.htm	application/vnd.php.serialized	Mozilla/5.0 (compatible; bingbot/2.0; url)
		www.bing.com/bingbot.htm	text/..	Mozilla/5.0 (compatible; bingbot/2.0; url) ASProxy/5.5b5
		www.bing.com/bingbot.htm	text/..	Mozilla/5.0 (compatible; bingbot/2.0; url) AppEngine-Google; (http://code.google.com/appengine; appid: wxcity1)
	google?
		www.google.com/bot.html	text/..	Mozilla/5.0 (compatible; GoogleBot/2.1; url)
		www.google.com/bot.html	text/..	GoogleBot/2.1 (url)
		www.google.com/bot.html	-	Mozilla/5.0 (compatible; GoogleBot/2.1; url)
		www.google.com/bot.html	image/..	Mozilla/5.0 (compatible; GoogleBot/2.1; url)
		www.google.com/bot.html	application/json	Mozilla/5.0 (compatible; GoogleBot/2.1; url)
		www.google.com/bot.html	application/vnd.php.serialized	Mozilla/5.0 (compatible; GoogleBot/2.1; url)
		www.google.com/bot.html	-	Mozilla/5.0 (iPhone; CPU iPhone OS 4_1 like Mac OS X; en-us) AppleWebKit/532.9 KHTML Version/4.0.5 Mobile/8B117 Safari/6531.22.7 (compatible; GoogleBot-Mobile/2.1; url)
		www.google.com/bot.html	text/..	Mozilla/5.0 (iPhone; CPU iPhone OS 4_1 like Mac OS X; en-us) AppleWebKit/532.9 KHTML Version/4.0.5 Mobile/8B117 Safari/6531.22.7 (compatible; GoogleBot-Mobile/2.1; url)
		www.google.com/bot.html	-	DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; GoogleBot-Mobile/2.1; url)
		www.google.com/bot.html	text/..	Mozilla/5.0 (compatible; GoogleBot/2.1; url)
		www.google.com/bot.html	-	SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; GoogleBot-Mobile/2.1; url)
		www.google.com/bot.html	application/xml	Mozilla/5.0 (compatible; GoogleBot/2.1; url)
		www.google.com/bot.html	application/json	DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; GoogleBot-Mobile/2.1; url)
	yahoo
		help.yahoo.com/help/us/ysearch/slurp	image/..	Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; url)
		help.yahoo.com/help/us/ysearch/slurp	text/..	Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; url)
		help.yahoo.com/help/us/ysearch/slurp	text/..	Mozilla/5.0 (compatible; Yahoo! Slurp; url)
		help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html	text/..	'Mozilla/5.0 (compatible; Y!J SearchMonkey/1.0 (Y!J-AGENT; url))'
		help.yahoo.co.jp/help/jp/search/indexing/indexing-27.html	text/..	DoCoMo/2.0 SH902i (compatible; Y!J-SRD/1.0; url)
		help.yahoo.co.jp/help/jp/search/indexing/indexing-27.html	-	DoCoMo/2.0 SH902i (compatible; Y!J-SRD/1.0; url)
		help.yahoo.com/help/us/ysearch/slurp	-	Mozilla/5.0 (compatible; Yahoo! Slurp; url)
		help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html	image/..	'Mozilla/5.0 (compatible; Y!J SearchMonkey/1.0 (Y!J-AGENT; url))'
		help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html	text/..	Y!J-BRI/0.0.1 crawler ( url )
		developer.yahoo.com/yql/provider	text/..	Mozilla/5.0 (compatible; Yahoo Pipes 2.0; url) Gecko/20090729 Firefox/3.5.2
		help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html	text/..	Y!J-BRW/1.0 crawler (url)
		listing.yahoo.co.jp/support/faq/int/other/other_001.html	text/..	Y!J-BRJ/YATS crawler (url)
		help.yahoo.com/help/us/ysearch/slurp	application/json	Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; url)
		help.yahoo.com/help/us/ysearch/slurp	text/..	Mozilla/5.0 (compatible; Yahoo! Nano; url)
		help.yahoo.com/help/us/ysearch/slurp	-	Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; url)
		help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html	text/..	Y!J-BRT/1.0 crawler (url)
		help.yahoo.com/help/us/ysearch/slurp	application/xml	Mozilla/5.0 (compatible; Yahoo! Slurp;url)
		help.yahoo.co.jp/help/jp/search/indexing/indexing-15.html	image/..	Y!J-BRU/VSIDX crawler (url)
	baidu
		www.baidu.com/search/spider.html	text/..	Mozilla/5.0 (compatible; Baiduspider/2.0; url)
		www.baidu.com/search/spider.html	-	Mozilla/5.0 (compatible; Baiduspider/2.0; url)
		www.baidu.com/search/spider.htm	text/..	Baiduspider-image(url)
		www.baidu.com/search/spider.html	application/vnd.php.serialized	Mozilla/5.0 (compatible; Baiduspider/2.0; url)
		www.baidu.com/search/spider.html	application/xml	Mozilla/5.0 (compatible; Baiduspider/2.0; url)
		www.baidu.com/search/spider.html	application/json	Mozilla/5.0 (compatible; Baiduspider/2.0; url)
		www.baidu.com/search/spider.html	image/..	Mozilla/5.0 (compatible; Baiduspider/2.0; url)
		www.baidu.com/search/spider.htm	text/..	Baiduspider(url)
		www.baidu.com/search/spider.html	text/..	Mozilla/5.0 (compatible;Baiduspider/2.0;url)
	yandex
		yandex.com/bots	text/..	Mozilla/5.0 (compatible; YandexBot/3.0; url)
		yandex.com/bots	text/..	Mozilla/5.0 (compatible; YandexDirect/3.0; url)
		yandex.com/bots	-	Mozilla/5.0 (compatible; YandexBot/3.0; url)
		yandex.com/bots	image/..	Mozilla/5.0 (compatible; YandexImageResizer/2.0; url)
		yandex.com/bots	text/..	Mozilla/5.0 (compatible; YandexImages/3.0; url)
		yandex.com/bots	application/vnd.php.serialized	Mozilla/5.0 (compatible; YandexBot/3.0; url)
		yandex.com/bots	text/..	Mozilla/5.0 (compatible; YandexNews/3.0; url)
		yandex.com/bots	image/..	Mozilla/5.0 (compatible; YandexBot/3.0; url)
		yandex.com/bots	image/..	Mozilla/5.0 (compatible; YandexImages/3.0; url)
		yandex.com/bots	image/..	Mozilla/5.0 (compatible; YandexAntivirus/2.0; url)
		yandex.com/bots	application/json	Mozilla/5.0 (compatible; YandexBot/3.0; url)
	naver
		help.naver.com/robots/	text/..	Yeti/1.0 (NHN Corp.; url)
		help.naver.com/robots/	-	Yeti/1.0 (NHN Corp.; url)
		help.naver.com/robots/	image/..	Yeti/1.0 (NHN Corp.; url)
		help.naver.com/robots/	text/..	Yeti/1.0 (NHN Corp.; url) ASProxy/5.5b3
		help.naver.com/robots/	text/..	Yeti/1.0 (NHN Corp.; url) ASProxy/5.5b5
		help.naver.com/robots/	application/json	Yeti/1.0 (NHN Corp.; url)
		corp.naver.jp/	text/..	Mozilla/5.0 (compatible; NaverJapan/1.0; url)
	msn
		search.msn.com/msnbot.htm	text/..	msnbot-media/1.1 (url)
		search.msn.com/msnbot.htm	text/..	msnbot/2.0b (url)
		search.msn.com/msnbot.htm	image/..	msnbot-media/1.1 (url)
		search.msn.com/msnbot.htm	text/..	msnbot-Products/1.0 (url)
		search.msn.com/msnbot.htm	text/..	msnbot-UDiscovery/2.0b (url)
		search.msn.com/msnbot.htm	text/..	msnbot-NewsBlogs/2.0b (url)
		search.msn.com/msnbot.htm	-	msnbot-media/1.1 (url)
		search.msn.com/msnbot.htm	text/..	msnbot/0.01 (url)
		search.msn.com/msnbot.htm	-	msnbot/2.0b (url)
		search.msn.com/msnbot.htm	-	msnbot/0.01 (url)
		search.msn.com/msnbot.htm	application/json	msnbot-media/1.1 (url)
	blekko
		blekko.com/about/blekkobot	text/..	Mozilla/5.0 (compatible; Blekkobot; ScoutJet; url)
		blekko.com/about/blekkobot	-	Mozilla/5.0 (compatible; Blekkobot; ScoutJet; url)
		blekko.com/about/blekkobot	application/json	Mozilla/5.0 (compatible; Blekkobot; ScoutJet; url)
	genieo
		www.genieo.com/webfilter.html	text/..	Mozilla/5.0 (compatible; Genieo/1.0 url)
		www.genieo.com/webfilter.html	application/xml	Mozilla/5.0 (compatible; Genieo/1.0 url)
		www.genieo.com/webfilter.html	image/..	Mozilla/5.0 (compatible; Genieo/1.0 url)
	cibra
		cibra.de/	text/..	CiBra Data Collector (url)
	www.
		www.	text/..	GoogleBot/2.1 ( urlGoogleBot.com/bot.html)
		www.	text/..	GoogleBot-Image/1.0 ( urlGoogleBot.com/bot.html)
		www.	image/..	GoogleBot/2.1 (urlGoogleBot.com/bot.html)
		www.	text/..	GoogleBot/2.1 (urlGoogleBot.com/bot.html)
	80legs
		www.80legs.com/webcrawler.html	text/..	Mozilla/5.0 (compatible; 008/0.83; url) Gecko/2008032620
		www.80legs.com/webcrawler.html	image/..	Mozilla/5.0 (compatible; 008/0.83; url) Gecko/2008032620
	soso
		help.soso.com/webspider.htm	text/..	Sosospider(url)
		help.soso.com/webspider.htm	text/..	Mozilla/5.0(compatible; Sosospider/2.0; url)
		help.soso.com/webspider.htm	application/json	Mozilla/5.0(compatible; Sosospider/2.0; url)
		help.soso.com/webspider.htm	-	Mozilla/5.0(compatible; Sosospider/2.0; url)
		help.soso.com/webspider.htm	-	Sosospider(url)
		help.soso.com/webspider.htm	application/json	Sosospider(url)
	youdao
		www.youdao.com/help/webmaster/spider/	text/..	Mozilla/5.0 (compatible; YoudaoBot/1.0; url; )
		www.youdao.com/help/webmaster/spider/	-	Mozilla/5.0 (compatible; YoudaoBot/1.0; url; )
		www.youdao.com/help/webmaster/spider/	image/..	Mozilla/5.0 (compatible;YodaoBot-Image/1.0;url;)
		www.youdao.com/help/webmaster/spider/	text/..	Mozilla/5.0 (compatible;YodaoBot-Image/1.0;url;)
		toolbar.youdao.com/	image/..	Youdao Toolbar (url)
		www.youdao.com/help/webmaster/spider/	application/vnd.php.serialized	Mozilla/5.0 (compatible; YoudaoBot/1.0; url; )
	wwwgogetpapers
		wwwgogetpapers.com/	application/json	User-Agent: GoGetPapersBot (url)
	sblog
		fulltext.sblog.cz/screenshot/	image/..	Mozilla/5.0 (compatible; Seznam screenshot-generator 2.0; url)
		fulltext.sblog.cz/	text/..	SeznamBot/3.0 (url)
		fulltext.sblog.cz/screenshot/	text/..	Mozilla/5.0 (compatible; Seznam screenshot-generator 2.0; url)
		fulltext.sblog.cz/	-	SeznamBot/3.0 (url)
	toolserver
		toolserver.org/~dispenser/	image/..	CacheThumbs/1.2 (url)
		wiki.toolserver.org/view/GeoHack	text/..	Geohack (url)
		toolserver.org/~dispenser/	text/..	DispensersTools (url)
		toolserver.org/~para/cgi-bin/kmlexport	text/..	url libwww-perl/6.02
		toolserver.org/~dispenser/	application/json	DispensersTools (url)
	php
		pear.php.net/	application/vnd.php.serialized	PEAR HTTP_Request class ( url )
		pear.php.net/package/http_request2	text/..	HTTP_Request2/0.5.2 (url) PHP/5.2.17
		pear.php.net/	text/..	PEAR HTTP_Request class ( url )
		pear.php.net/	image/..	PEAR HTTP_Request class ( url )
		pear.php.net/package/http_request2	application/xml	HTTP_Request2/2.0.0 (url) PHP/5.3.8
		pear.php.net/	application/xml	PEAR HTTP_Request class ( url )
		pear.php.net/package/http_request2	text/..	HTTP_Request2/2.1.1 (url) PHP/5.3.2-1ubuntu4.17
		pear.php.net/package/http_request2	image/..	HTTP_Request2/2.1.1 (url) PHP/5.3.2-1ubuntu4.15
	wordpress
		josefboberg.wordpress.com	text/..	WordPress/3.5-alpha-21304; url
		klausgauger.wordpress.com	text/..	WordPress/3.5-alpha-21304; url
		support.wordpress.com/contact/	text/..	WordPress.com mShots; url
		goodjohnjr.wordpress.com	text/..	WordPress/3.5-alpha-21304; url
		josefboberg.wordpress.com	text/..	WordPress/3.5-alpha-21535; url
		imagenssagradas.wordpress.com	text/..	WordPress/3.5-alpha-21535; url
		kterrl.wordpress.com	text/..	WordPress/3.5-alpha-21304; url
		fredvidal.wordpress.com	text/..	WordPress/3.5-alpha-21304; url
		02varvara.wordpress.com	text/..	WordPress/3.5-alpha-21535; url
		kingcrimsonprog.wordpress.com	image/..	WordPress/3.5-alpha-21304; url
	echonest
		the.echonest.com/reader/	application/xml	nestReader/0.3 (discovery; url; reader at echonest.com)
		the.echonest.com/reader/	text/..	nestReader/0.3 (discovery; url; reader at echonest.com)
	exabot
		www.exabot.com/go/robot	text/..	Mozilla/5.0 (compatible; Exabot/3.0; url)
		www.exabot.com/go/robot	-	Mozilla/5.0 (compatible; Exabot/3.0; url)
	sogou
		www.sogou.com/docs/help/webmasters.htm#07	text/..	Sogou web spider/4.0(url)
		www.sogou.com/docs/help/webmasters.htm#07	-	Sogou web spider/4.0(url)
		www.sogou.com/docs/help/webmasters.htm#07	application/json	Sogou web spider/4.0(url)
		www.sogou.com/docs/help/webmasters.htm#07	application/vnd.php.serialized	Sogou web spider/4.0(url)
		www.sogou.com/docs/help/webmasters.htm#07	text/..	Sogou Pic Spider/3.0(url)
	yacy
		yacy.net/bot.html	text/..	yacybot (freeworld-global; amd64 Linux 2.6.32-custom; java 1.6.0_26; Europe/en) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.2.0-29-generic; java 1.6.0_24; Europe/en) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 2.6.32-5-amd64; java 1.6.0_18; Europe/en) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Windows 7 6.1; java 1.7.0_02; Europe/fr) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.2.0-27-generic; java 1.6.0_24; America/en) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.1.10-1.16-desktop; java 1.6.0_24; Europe/nl) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.2.0-29-generic; java 1.6.0_24; Indian/en) url
		yacy.net/bot.html	-	yacybot (freeworld/global; amd64 Linux 3.3.8-gentoo; java 1.6.0_33; UTC/en) url
		yacy.net/bot.html	-	yacybot (freeworld/global; amd64 Linux 3.2.0-29-generic; java 1.6.0_24; Indian/en) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 2.6.24-28-server; java 1.6.0_18; Europe/en) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 2.6.38-15-generic; java 1.6.0_24; Europe/en) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.3.8-gentoo; java 1.6.0_33; UTC/en) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.2.0-29-generic; java 1.6.0_24; Europe/fr) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.2.0-30-generic; java 1.6.0_24; Europe/fr) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.0.0-22-generic; java 1.6.0_24; Europe/de) url
		yacy.net/bot.html	-	yacybot (freeworld/global; amd64 Linux 3.2.0-29-generic; java 1.6.0_24; Europe/en) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.2.0-26-generic; java 1.6.0_24; America/en) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 2.6.32-42-generic; java 1.6.0_24; Europe/en) url
		yacy.net/bot.html	-	yacybot (freeworld/global; amd64 Linux 3.2.0-27-generic; java 1.6.0_24; Indian/en) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.2.0-30-generic; java 1.6.0_24; Europe/en) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Windows 7 6.1; java 1.7.0_04; Europe/de) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 2.6.37.6; java 1.6.0_25; Europe/en) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.2.0-27-generic; java 1.6.0_24; Indian/en) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Windows 7 6.1; java 1.7.0_05; America/en) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; x86 Windows Server 2008 6.0; java 1.7.0_04; Europe/de) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 2.6.32-5-amd64; java 1.6.0_18; Europe/de) url
		yacy.net/bot.html	-	yacybot (freeworld/global; amd64 Linux 3.1.10-1.16-desktop; java 1.6.0_24; Europe/nl) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 2.6.32-32-generic; java 1.6.0_20; Europe/en) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.0.0-16-generic; java 1.6.0_24; Europe/en) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 3.4.4-2-ARCH; java 1.6.0_24; UTC/en) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 2.6.35-32-generic; java 1.6.0_20; Europe/en) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Windows 7 6.1; java 1.7.0_04; Europe/pl) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 2.6.32-41-server; java 1.6.0_26; Europe/de) url
		yacy.net/bot.html	text/..	yacybot (freeworld/global; amd64 Linux 2.6.32-28-generic; java 1.6.0_20; Europe/en) url
	wikipedia
		en.wikipedia.org/wiki/Wikipedia:Huggle	text/..	Huggle/2.1.19.0 url
		en.wikipedia.org/wiki/User:NicoV/Wikipedia_Cleaner/Documentation	text/..	WPCleaner (url)
		de.wikipedia.org/wiki/Benutzer:APPER/WikiHistory	text/..	WikiHistory (url)
		en.wikipedia.org/wiki/Wikipedia:Huggle	text/..	Huggle/2.1.18.0 url
	majestic12
		www.majestic12.co.uk/bot.php?	text/..	Mozilla/5.0 (compatible; MJ12bot/v1.4.3; url)
		www.majestic12.co.uk/bot.php?	text/..	Mozilla/5.0 (compatible; MJ12bot/v1.4.2; url)
	discoveryengine
		discoveryengine.com/discoverybot.html	text/..	Mozilla/5.0 (compatible; discoverybot/2.0; url)
		discoveryengine.com/discoverybot.html	-	Mozilla/5.0 (compatible; discoverybot/2.0; url)
		discoveryengine.com/discoverybot.html	image/..	Mozilla/5.0 (compatible; discoverybot/2.0; url)
	bin-co
		www.bin-co.com/php/scripts/load/	text/..	BinGet/1.00.A (url)
		www.bin-co.com/php/scripts/load/	application/vnd.php.serialized	BinGet/1.00.A (url)
	ahrefs
		ahrefs.com/robot/	text/..	Mozilla/5.0 (compatible; AhrefsBot/3.1; url)
		ahrefs.com/robot/	-	Mozilla/5.0 (compatible; AhrefsBot/3.1; url)
		ahrefs.com/robot/	application/xml	Mozilla/5.0 (compatible; AhrefsBot/3.1; url)
	zum
		help.zum.com/inquiry	text/..	ZumBot/1.0 (ZUM Search; url)
		help.zum.com/inquiry	image/..	ZumBot/1.0 (ZUM Search; url)
	jike
		shoulu.jike.com/spider.html	text/..	Mozilla/5.0 (compatible; JikeSpider; url)
		shoulu.jike.com/spider.html	image/..	Mozilla/5.0 (compatible; JikeSpider; url)
		shoulu.jike.com/spider.html	-	Mozilla/5.0 (compatible; JikeSpider; url)
	fucinamediale
		labs.fucinamediale.com	text/..	Mozilla/5.0 (compatible; ExperimentalWikiBot/1.0; url)
	cognarius
		cognarius.com	application/json	AppsArlak/1.0 (url)
		cognarius.com	text/..	AppsArlak/1.0 (url)
	flipboard
		flipboard.com/browserproxy	image/..	Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (FlipboardProxy/0.0.5; url)
		flipboard.com/browserproxy	text/..	Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (FlipboardProxy/1.1; url)
		flipboard.com/browserproxy	text/..	Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (FlipboardProxy/0.0.5; url)
		flipboard.com/browserproxy	application/json	Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (FlipboardProxy/0.0.1; url)
		flipboard.com/browserproxy	image/..	null (FlipboardProxy/1.1; url)
		flipboard.com/browserproxy	-	Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (FlipboardProxy/0.0.5; url)
	numberfound
		www.numberfound.it/	text/..	MyBot/1.0 (url)
	wikidict
		www.wikidict.de	text/..	url
	goo
		help.goo.ne.jp/contact/	text/..	goo wikipedia (url)
		goo.gl/7y4SX	text/..	GoogleProducer; (url)
		help.goo.ne.jp/door/crawler.html	text/..	ichiro/3.0 (url)
		help.goo.ne.jp/help/article/1142	text/..	ichiro/3.0 (url)
		search.goo.ne.jp/option/use/sub4/sub4-1/	-	DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo; url)
		search.goo.ne.jp/option/use/sub4/sub4-1/	text/..	DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo; url)
		search.goo.ne.jp/option/use/sub4/sub4-1/	text/..	ichiro/3.0 (url)
	diffbot
		www.diffbot.com	text/..	Mozilla/5.0 (Windows; Windows NT 5.1; en-US; rv:1.9.1.2) Gecko/20090729 Firefox/3.5.2 (Diffbot/0.1; url)
	archive-it
		archive-it.org/files/site-owners.html	image/..	Mozilla/5.0 (compatible; archive.org_bot; Archive-It; url)
		archive-it.org/files/site-owners.html	-	Mozilla/5.0 (compatible; archive.org_bot; Archive-It; url)
		archive-it.org/files/site-owners.html	text/..	Mozilla/5.0 (compatible; archive.org_bot; Archive-It; url)
	traslated
		mymemory.traslated.net/doc/	text/..	Mozilla/5.0 (MyMemory Bot url)
	FeedBurner
		www.FeedBurner.com	text/..	FeedBurner/1.0 (url)
	speaktoit
		www.speaktoit.com	application/json	Speaktoit url
	daum
		tab.search.daum.net/aboutWebSearch.html	text/..	Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows server; url) Daumoa/3.0
	ephorus
		www.ephorus.com/	text/..	Mozilla/5.0 (compatible; Ephorusbot/1.4.4.2; url)
	sf
		liferea.sf.net/	text/..	Liferea/1.x.x (Linux; es_ES.UTF-8; url)
		liferea.sf.net/	text/..	Liferea/0.x.x (Linux; en_US.UTF-8; url)
		magpierss.sf.net	text/..	MagpieRSS/0.7x (url)
	tweetmeme
		tweetmeme.com/	text/..	Mozilla/5.0 (compatible; TweetmemeBot/2.11; url)
		tweetmeme.com/	-	Mozilla/5.0 (compatible; TweetmemeBot/2.11; url)
	whatrhymeswith
		www.whatrhymeswith.com/site/rhyme-bot	text/..	RhymeBot/0.1 (url)
	okian
		www.okian.ro/	text/..	MyBot/1.0 (url)
	kosmix
		www.kosmix.com/html/kosmos.html	application/xml	Mozilla/5.0(compatible;Kosmos/1.0;url)
	mediawiki
		www.mediawiki.org/	text/..	MediaWiki OAI Harvester 0.2 (url)
	gnip
		www.gnip.com/	text/..	UnwindFetchor/1.0 (url)
	SearchNearMe
		SearchNearMe.com/contact.php	application/vnd.php.serialized	SearchNearMe (url)
		SearchNearMe.com/contact.php	text/..	SearchNearMe (url)
	archive
		www.archive.org/details/archive.org_bot	text/..	Mozilla/5.0 (compatible; archive.org_bot url)
		www.archive.org/details/archive.org_bot	image/..	Mozilla/5.0 (compatible; archive.org_bot url)
		archive.org/details/archive.org_bot	image/..	Mozilla/5.0 (compatible; heritrix/3.1.1-SNAPSHOT-20120118.092903 url)
	thearchangelmichael
		thearchangelmichael.net	text/..	WordPress/3.4.1; url
	wiktionary
		en.wiktionary.org/wiki/User:Rukhabot	application/json	Rukhabot/0.1 (url)
		en.wiktionary.org/wiki/User:Daneel	application/json	Daneel Olivaw/0.1 (url Olivaw)
		en.wiktionary.org/wiki/User:Rukhabot	text/..	Rukhabot/0.1 (url)
	federatedmedia
		federatedmedia.net	text/..	Mozilla/5.0 (url) Gecko/20061208 Firefox/2.0.0.1
	semager
		www.semager.de/blog/semager-bots/	text/..	Mozilla/5.0 (compatible; Semager/1.4c; url)
	newsgator
		www.newsgator.com/	text/..	FeedDemon/2.7 (url; Microsoft Windows XP)
		www.newsgator.com	text/..	NewsGatorOnline/2.0 (url; 1 subscribers)
	jetbrains
		www.jetbrains.com/omea_reader/	text/..	JetBrains Omea Reader 2.0 Release Candidate 1 (url)
		www.jetbrains.com/omea_reader/	text/..	JetBrains Omea Reader 1.0.x (url)
	avantbrowser
		www.avantbrowser.com	text/..	Avant Browser (url)
		www.avantbrowser.com	text/..	Advanced Browser (url)
	feedshow
		www.feedshow.com	text/..	FeedshowOnline (url)
		www.feedshow.com	text/..	Feedshow/x.0 (url; 1 subscriber)
	apercite
		www.apercite.fr/robot/index.html	image/..	Mozilla/5.0 (compatible; Apercite; url)
	wikiglass
		wikiglass.com	text/..	url : mail address
	emining
		emining.jp/	text/..	emBot-GalaBuzz/Nutch-1.0 (url; mail address )
		emining.jp/	-	emBot-GalaBuzz/Nutch-1.0 (url; mail address )
	tineye
		tineye.com/crawler.html	image/..	TinEye/1.1 (url)
	wikimpress
		wikimpress.org/	text/..	Mozilla/5.0 (compatible; Linux i686 (x86_64); de-DE; url>Wikimpress) Wikimpress/1.0
		wikimpress.org/	-	Mozilla/5.0 (compatible; Linux i686 (x86_64); de-DE; url>Wikimpress) Wikimpress/1.0
	drupal
		drupal.org/	text/..	Drupal (url)
		drupal.org/	image/..	Drupal (url)
		drupal.org/	text/..	User-Agent: Drupal (url)
		drupal.org/	text/..	Drupal (url
		drupal.org/	application/xml	Drupal (url)
		drupal.org/	-	Drupal (url)
	xbmc
		www.xbmc.org	image/..	XBMC/11.0 Git:20120702-f3cd288 (iOS; 11.0.0 AppleTV2,1, Version 5.1.1 (Build 9B830); url)
		www.xbmc.org	image/..	XBMC/11.0 Git:20120321-14feb09 (Windows NT 6.1;WOW64;Win64;x64; url)
		www.xbmc.org	image/..	XBMC/11.0 Git:20120321-14feb09 (Windows NT 6.1; url)
		www.xbmc.org	image/..	XBMC/11.0 Git:20120331-ebfd899 (iOS; 11.0.0 AppleTV2,1, Version 5.1.1 (Build 9B830); url)
	netseer
		www.netseer.com/crawler.html	text/..	Mozilla/5.0 (compatible; NetSeer crawler/2.0; url; mail address )
		www.netseer.com/crawler.html	text/..	Mozilla/5.0 (compatible; Netseer crawler/2.0; url; mail address )
	bibalex
		archive.bibalex.org/bot/	image/..	Mozilla/5.0 (compatible; archive.bibalex.org_bot; url)
		archive.bibalex.org/bot/	text/..	Mozilla/5.0 (compatible; archive.bibalex.org_bot; url)
	coccoc
		help.coccoc.vn/	text/..	coccoc/1.0 (url)
		help.coccoc.vn/	-	coccoc/1.0 (url)
	ac
		newgen.utcc.ac.th/salesss	text/..	WordPress/3.2.1; url
		www.clips.ua.ac.be/pages/pattern	application/json	Pattern/2.3 url
		newgen.utcc.ac.th/usasalesss	text/..	WordPress/3.2.1; url
	github
		github.com/pauldix/typhoeus/tree/master	text/..	Typhoeus - url
		github.com/edsu/wikitweets	application/json	wikitweets <url
	parsijoo
		www.parsijoo.ir	text/..	Mozilla/5.0 (compatible; mail address url)
		www.parsijoo.ir	-	Mozilla/5.0 (compatible; mail address url)
	moviecus
		www.moviecus.com/botcontactinfo.php	application/yaml	moviecus bot (url)
	worldaswillandfarce
		worldaswillandfarce.com	text/..	WordPress/3.5-alpha-21304; url
		worldaswillandfarce.com	text/..	WordPress/3.5-alpha-21535; url
	freebase
		www.freebase.com	text/..	metaweb/Nutch-1.0-dev (url; help_at_metaweb.com)
	paper
		support.paper.li/entries/20023257-what-is-paper-li	text/..	Mozilla/5.0 (compatible; PaperLiBot/2.1; url)
	textdigger
		textdigger.com	text/..	Mozilla/5.0 (url) Gecko/20061208 Firefox/2.0.0.1
	topsy
		labs.topsy.com/butterfly/	text/..	Mozilla/5.0 (compatible; Butterfly/1.0; url) Gecko/2009032608 Firefox/3.0.8
	dasdonkey
		www.dasdonkey.com	text/..	Mozilla/5.0 (compatible; DonkeyBot/0.1; url)
	aitellu
		www.aitellu.com	text/..	Mozilla/5.0 (compatible; Aitellu-Octoswarm/3.1; url)
	hatena
		a.hatena.ne.jp/help	text/..	Hatena Antenna/0.5 (url)
	graemef
		graemef.com	text/..	NewsGator FetchLinks extension/0.2.0 (url)
	zipcommander
		www.zipcommander.com/	text/..	1st ZipCommander (Net) - url
	tinyurl
		tinyurl.com/64t5n	text/..	Rome Client (url) Ver: 0.9
	timewe
		timewe.net	text/..	CDR/1.7.1 Simulator/0.7(url) Profile/MIDP-1.0 Configuration/CLDC-1.0
	blogbridge
		www.blogbridge.com/	text/..	BlogBridge 2.13 (url)
	it-influentials
		search.it-influentials.com/bot.htm	text/..	Mozilla/5.0 (compatible;FindITAnswersbot/1.0;url)
	nemui
		mozshot.nemui.org/	text/..	Mozilla/5.0 (Gecko/20070310 Mozshot/0.0.20070628; url)
	feeds4all
		www.feeds4all.com/feedzcollector	text/..	FeedZcollector v1.x (Platinum) url
	snarfware
		www.snarfware.com/	text/..	Snarfer/0.x.x (url)
	ponderer
		ponderer.org/download/annotate_google.user.js	text/..	annotate_google; url
	ranchero
		ranchero.com/netnewswire/	text/..	NetNewsWire/2.x (Mac OS X; url)
	orcabrowser
		www.orcabrowser.com	text/..	Orca Browser (url)
	rssbandit
		www.rssbandit.org	text/..	RssBandit/1.5.0.10 (WinNT 5.1.2600.0; url) (WinNT 5.1.2600.0; )
	zootycoon
		www.zootycoon.com	text/..	Zoo Tycoon 2 Client -- url
	rssreader
		www.rssreader.com	text/..	RssReader/1.0.xx.x (url) Microsoft Windows NT 5.1.2600.0
	abonti
		www.abonti.com	text/..	Mozilla/5.0 (compatible; Abonti/0.91 - url)
	winpodder
		winpodder.com	text/..	WinPodder (url)
	seebot
		seebot.org	text/..	Lynx/2.8 (;url)
	kula
		kula.jp/endo	text/..	endo/1.0 (Mac OS X; ppc i386; url)
	plagger
		plagger.org/	text/..	Plagger/0.x.xx (url)
	enwp
		enwp.org/User:SDPatrolBot	text/..	SDPatrolBot (url)
		enwp.org/User:KingpinBot	text/..	KingpinBot (url)
		enwp.org/User:H3llkn0wz/WikiSharpAPI	text/..	WikiSharpAPI/0.3 url (C# .NET)
	tumblr
		benderthewebrobot.tumblr.com	text/..	Mozilla/5.0 (compatible; Bender; url)
	warebay
		www.warebay.com/bot.html	text/..	Mozilla/5.0 (compatible; WBSearchBot/1.1; url)
	bsurprised
		bsurprised.com/	text/..	BSurprised WikiBox 0.1.3 (url)
	alexa
		www.alexa.com/site/help/webmasters	text/..	ia_archiver (url; mail address )
	grid-son
		grid-son.com	application/json	url
	linkbutler
		www.linkbutler.de/spider	text/..	lb-spider/Mozilla/5.0 Gecko/20100101 Firefox/10.0.2 (lb-spider; url; mail address )
	trendiction
		www.trendiction.de/bot	text/..	Mozilla/5.0 (Windows; Windows NT 6.0; en-GB; rv:1.0; trendictionbot0.5.0; trendiction search; url; please let us know of any problems; web at trendiction.com) Gecko/20071127 Firefox/3.0.0.11
	spinn3r
		spinn3r.com/robot	text/..	Mozilla/5.0 (X11; Linux x86_64; en-US; rv:1.9.0.19; aggregator:Spinn3r (Spinn3r 3.1); url) Gecko/2010040121 Firefox/3.0.19
	rockpeaks
		www.rockpeaks.com/contact	text/..	RockPeaks/0.1 (url)
	picsearch
		www.picsearch.com/bot.html	text/..	psbot/0.1 (url)
		www.picsearch.com/bot.html	image/..	psbot/0.1 (url)
	sentymetr
		sentymetr.pl/bot.html	application/json	Mozilla/5.0 (compatible; SentymetrBot 1.0; url)
		sentymetr.pl/bot.html	text/..	Mozilla/5.0 (compatible; SentymetrBot 1.0; url)
	simplepie
		simplepie.org	application/xml	SimplePie/1.2 (Feed Parser; url; Allow like Gecko) Build/20090627192103
		simplepie.org	text/..	SimplePie/1.2.1 (Feed Parser; url; Allow like Gecko) Build/20111015034325
		simplepie.org	application/xml	SimplePie/1.2.1 (Feed Parser; url; Allow like Gecko) Build/20111015034325
		simplepie.org	text/..	SimplePie/1.2 (Feed Parser; url; Allow like Gecko) Build/20090627192103
	pagepeeker
		pagepeeker.com/robots/	text/..	Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/535.21 KHTML Chrome/19.0.1042.0 Safari/535.21 PagePeeker/2.1; url
		pagepeeker.com/robots	image/..	PagePeeker.com (info: url)
		pagepeeker.com/robots/	image/..	Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/535.21 KHTML Chrome/19.0.1042.0 Safari/535.21 PagePeeker/2.1; url
		pagepeeker.com/robots	text/..	PagePeeker.com (info: url)
	rcdtokyo
		www.rcdtokyo.com/pc2m/	text/..	Mozilla/5.0 (compatible; PEAR HTTP_Request class; url)
	netnewswireapp
		netnewswireapp.com/mac/	-	NetNewsWire/3.3.2 (Mac OS X; url; gzip-happy)
	Anonymouse
		Anonymouse.org/	image/..	url (Unix)
		Anonymouse.org/	text/..	url (Unix)
	zookabot
		zookabot.com	text/..	Zookabot/2.5;url
		zookabot.com	text/..	Zookabot/2.4;url
	searchtechnologies
		www.searchtechnologies.com	text/..	Mozilla/5.0 (compatible; heritrix/1.14.3 url)
	zeebox
		www.zeebox.com	application/json	Zeebox (url)
		www.zeebox.com	text/..	Zeebox (url)
	nb
		www.nb.no/vevfangst	image/..	Mozilla/5.0 (compatible; heritrix/1.14.4 url)
		www.nb.no/vevfangst	text/..	Mozilla/5.0 (compatible; heritrix/1.14.4 url)
	weblio
		www.weblio.jp/	text/..	Mozilla/5.0 (compatible; WeblioBot; url)
	proximic
		www.proximic.com/info/spider.php	text/..	Mozilla/5.0 (compatible; proximic; url)
	plagiarismcheck
		plagiarismcheck.org	application/json	WikiCrawl 1.0b (url contact-mail: mail address )
	bnf
		www.bnf.fr/fr/outils/a.dl_web_capture_robot.html	image/..	Mozilla/5.0 (compatible; bnf.fr_bot; url)
		www.bnf.fr/fr/outils/a.dl_web_capture_robot.html	text/..	Mozilla/5.0 (compatible; bnf.fr_bot; url)
	js-kit
		js-kit.com/	text/..	JS-Kit URL Resolver, url
	instapaper
		www.instapaper.com/	text/..	Mozilla/5.0 (Macintosh; Intel Mac OS X 10_6_8) AppleWebKit/534.50 KHTML Version/5.1 Instapaper/4.0 (url)
	quus
		quus.net/	text/..	url
	mobileproxy
		mobileproxy.mobi	text/..	Mozilla/5.0 (compatible; MobileSurf; url)
	neticle
		bot.neticle.hu/	text/..	neticle Bot ( url )
		bot.neticle.hu/	text/..	Neticle Crawler v1.0 ( url )
	loc
		webarchiveqr.loc.gov/about/loc-notification-webmasters.html	image/..	Mozilla/5.0 (compatible; heritrix/3.1.0 url)
		webarchiveqr.loc.gov/about/loc-notification-webmasters.html	text/..	Mozilla/5.0 (compatible; heritrix/3.1.0 url)
	duckduckgo
		duckduckgo.com/duckduckbot.html	text/..	DuckDuckBot/1.1; (url)
		duckduckgo.com/duckduckpreview.html	-	DuckDuckPreview/1.0; (url)
		duckduckgo.com/duckduckpreview.html	text/..	DuckDuckPreview/1.0; (url)
	linguee
		www.linguee.com/bot	text/..	Linguee Bot (url; mail address )
	mopupduty
		mopupduty.com	text/..	WordPress/3.4.1; url
		mopupduty.com	-	WordPress/3.4.1; url
	sonyericsson
		www.sonyericsson.com/UAprof/R800xR301.xml	image/..	Mozilla/5.0 (Linux; Android/2.3.3; en-us; SonyEricssonR800xurl Build/3.0.1.E.1.44) AppleWebKit/533.1 KHTML Version/4.0 Mobile Safari/533.1
		www.sonyericsson.com/UAprof/R800xR301.xml	text/..	Mozilla/5.0 (Linux; Android/2.3.3; en-us; SonyEricssonR800xurl Build/3.0.1.E.1.44) AppleWebKit/533.1 KHTML Version/4.0 Mobile Safari/533.1
	veveo
		corporate.veveo.net/webmasters.html	text/..	Mozilla/5.0 (compatible; Veveobot; url)
	networkedblogs
		www.networkedblogs.com	image/..	NetworkedBlogs (url;) AppEngine-Google; (http://code.google.com/appengine; appid: s~networkedblogshr)
	search
		www.search.ch/rim.html	text/..	UltraSpider3000/1.0 (url)
	netvibes
		www.netvibes.com	text/..	Netvibes (url)
	fotopedia
		www.fotopedia.com	application/json	Picor (url)
	riight
		riight.com/co/spider	text/..	RIIGHT-SPIDER/RIIGHT-1.1 (RIIGHT.COM SEARCH SPIDER; url; mail address )
	giparakis
		giparakis.gr	text/..	WordPress/3.4.1; url
	turnitin
		www.turnitin.com/robot/crawlerinfo.html	text/..	TurnitinBot/2.1 (url)
	zapbot
		www.zapbot.com	text/..	Mozilla/5.0 (compatible; ZapBot/0.2c; url)
		www.zapbot.org	text/..	Mozilla/5.0 (compatible; ZapBot/0.2o; url)
		www.zapbot.net	text/..	Mozilla/5.0 (compatible; ZapBot/0.2n; url)
	embed
		support.embed.ly/	text/..	Mozilla/5.0 (compatible; Embedly/0.2; url)
		support.embed.ly/	image/..	Mozilla/5.0 (compatible; Embedly/0.2; snap; url)
	tiscali
		www.tiscali.it/	text/..	Mozilla/5.0 (compatible; IstellaBot/1.01.18 url)
	localhost
		localhost/~lookformedical/yioop/bot.php	text/..	Mozilla/5.0 (compatible; YIOOP; url)
	mysistermarilynmonroe
		mysistermarilynmonroe.org	text/..	WordPress/3.4.1; url
		www.mysistermarilynmonroe.com	text/..	WordPress/3.4.1; url
	webworldismyoyster
		www.webworldismyoyster.com	text/..	WordPress/3.4.1; url
	ibis
		ibis.ne.jp/browser/about.html	image/..	Mozilla/4.0 (compatible; ibisBrowser; url)
	nettenis
		www.nettenis.org	text/..	WordPress/3.4.1; url
		www.nettenis.org	image/..	WordPress/3.4.1; url
	backgroundswitcher
		www.backgroundswitcher.com/	text/..	John's Background Switcher 4.5 (url)
		www.backgroundswitcher.com/	image/..	John's Background Switcher 4.4 (url)
		www.backgroundswitcher.com/	text/..	John's Background Switcher 4.4 (url)
111456.689999992	total

Page requests for probable crawlers, recognized by keyword
Count x 1000	Agent string
		Mime type (count ≥ 3)
	PythonWikipediaBot/1.0
		application/json
		application/xml
		text/..
		-
		application/x-www-form-urlencoded
		image/..
	GoogleBot-Image/1.0
		image/..
		text/..
		-
	spider
		text/..
		application/vnd.php.serialized
		image/..
		-
		application/json
	php wikibot classes
		application/vnd.php.serialized
		text/..
		-
	MediaWikiCrawler-Google/2.0 ( mail address )
		text/..
		-
	LinkParser/2.0
		text/..
		-
	GoogleBot-Image/1.0
		text/..
		image/..
		-
		application/vnd.php.serialized
		application/json
	wikiwix-bot-3.0
		text/..
		-
	Peachy MediaWiki Bot API Version 1.0
		application/vnd.php.serialized
		text/..
		-
	Mozilla/5.0 (Windows; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 ( mail address )
		text/..
		application/json
		-
	ClueBot/1.1
		application/vnd.php.serialized
	Answersbot
		text/..
	Pywikipediabot/2.0
		application/json
	Mozilla/5.0 MaboMwFramework/1.2 (w:de:MerlIwBot)
		text/..
	cleaner-wikipedia bot / self.maluke.com
		text/..
		application/json
	Wikipath Bot (email: mail address )
		application/json
	Mozilla 5.0 (Apibot 0.32)
		application/vnd.php.serialized
	plantspedia data crawler
		text/..
	ClueBot/2.0
		application/vnd.php.serialized
		text/..
	WikiBot/0.1
		text/..
		image/..
		application/xml
	Mozilla/5.0 (Windows; Windows NT 5.1; zh-CN; rv:1.8.0.11) Gecko/20070312 Firefox/1.5.0.11; 360Spider
		text/..
		-
		image/..
		application/pdf
		application/json
	wikbot/1.60 CFNetwork/548.1.4 Darwin/11.0.0
		image/..
		application/json
		text/..
		-
	DigitalsmithsBot
		text/..
	mail address
		application/vnd.php.serialized
		text/..
	AnomieBOT 1.0 (TagDater; see [[User:AnomieBOT]])
		application/json
	MediaWiki::Bot/3.2.6
		application/json
	python-wikitools/1.2 (User:BernsteinBot)
		application/json
	Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (Exabot-Thumbnails)
		image/..
		text/..
		application/json
		-
	DotNetWikiBot/2.101 (Microsoft Windows NT 6.1.7601 Service Pack 1; )
		text/..
		application/xml
	DotNetWikiBot/2.81 (Microsoft Windows NT 6.1.7601 Service Pack 1; )
		text/..
		application/xml
		image/..
		application/ogg
	DotNetWikiBot/2.100 (Unix 2.6.32.38; )
		text/..
	www.integromedb.org/Crawler
		text/..
		image/..
		-
		application/xml
	Tawbot (public svn release; plwiki)
		text/..
	python2.7.1-wikibot/0.0.2 mail address
		application/json
	scrapybot/1.0
		text/..
	MLBot (www.metadatalabs.com/mlbot)
		text/..
		application/vnd.php.serialized
		application/json
		image/..
		-
	Mozilla/5.0 (compatible; Ezooms/1.0; mail address )
		text/..
		application/json
		application/xml
		application/vnd.php.serialized
	test_crawl/1.0
		text/..
		image/..
	Opera/8.01 (J2ME/MIDP; MXit WebBot/6.2.1/1.8.5.168;) Opera Mini/3.1
		image/..
		text/..
		-
	quaba spider
		text/..
	SineBot/1.5.19(User:SineBot)
		application/vnd.php.serialized
		text/..
	Webwiki Search Engine Bot - www.webwiki.de
		text/..
	AnomieBOT 1.0 (OrphanReferenceFixer; see [[User:AnomieBOT]])
		application/json
	DotNetWikiBot/2.97 (Microsoft Windows NT 5.1.2600 Service Pack 3; )
		text/..
	Test Webbot
		text/..
	GermCrawler
		application/json
		text/..
	DotNetWikiBot/2.101 (Microsoft Windows NT 5.1.2600 Service Pack 3; )
		text/..
		application/xml
	Mozilla/5.0 (X11; Linux i686; en-US; rv:1.8.0.7) Gecko/20060909 Firefox/1.5.0.7 SnapPreviewBot
		text/..
		-
	DotNetWikiBot/2.100 (Microsoft Windows NT 6.1.7601 Service Pack 1; )
		text/..
		application/x-www-form-urlencoded
		application/xml
	Mozilla/5.0 (compatible; SnapPreviewBot; en-US; rv:1.8.0.9) Gecko/20061206 Firefox/1.5.0.9
		text/..
		-
	Mozilla/5.0 (compatible; Nigma.ru/3.0; mail address )
		text/..
		-
	DotNetWikiBot/2.100 (Unix 5.10.0.0; )
		text/..
		application/xml
	UCMore Crawler App
		text/..
		-
	blip-bot
		text/..
	mail address mail address – MediaWiki Tcl Bot Framework 0.5 (r1)
		application/json
	AnomieBOT 1.0 (FlagIconRemover; see [[User:AnomieBOT]])
		application/json
	Seznam.cz/TestBot
		application/json
	Doddebot
		text/..
	DNSTallyKwBot/0.2
		text/..
	AniBot/0.9 php/curl
		application/vnd.php.serialized
		-
	HosiryuhosiBot IRC-RecentChanges Checker
		text/..
		application/x-www-form-urlencoded
	AnomieBOT 1.0 (TemplateSubster; see [[User:AnomieBOT]])
		application/json
	MediaWiki::Bot/3.005002
		application/json
		text/..
	Twitterbot/1.0
		text/..
		image/..
		-
	DotNetWikiBot/2.100 (Microsoft Windows NT 6.2.8400.0; )
		text/..
		application/xml
	wikbotlite/1.60 CFNetwork/548.1.4 Darwin/11.0.0
		image/..
		application/json
		text/..
		-
	SchoolReviewNetworkWikiBot
		application/json
	My Nutch Spider/Nutch-1.5.1
		text/..
	HTMLParser/1.6
		text/..
	imho-bot/1.0
		text/..
	AnomieBOT 1.0 (PERTableUpdater; see [[User:AnomieBOT]])
		application/json
		text/..
	My Nutch Spider/Nutch-1.2
		text/..
		image/..
		application/ogg
	VWBot - CorenSearchBot/1.5 en derivative
		text/..
	FAST Search Web Crawler 14.0.0325.0000
		text/..
		-
		application/xml
	wAPI/1.1 (Bot: NoomBot Operator: Noommos Contact: mail address )
		application/vnd.php.serialized
	Mozilla/5.0 crawler/suggest.io
		text/..
		-
	SurakWare MediaWiki Bot/1.0
		text/..
		application/xml
	TwynCatBot/0.1 (Contact: www.twyn.com)
		application/json
	JavaCrawler/1.1
		text/..
	mail address mail address – MediaWiki Tcl Bot Framework 0.5
		application/json
		application/x-www-form-urlencoded
	HRoestBot, de-wikipedia using pywikipedia framework
		text/..
		application/json
	PopScreenBot
		image/..
		text/..
	~Bot ([[:fr:w:User:TildeBot]] by [[:fr:w:User:Alphos]] mail address )
		text/..
	Opera/8.01 (J2ME/MIDP; MXit WebBot/5.9.8/1.8.5.168;) Opera Mini/3.1
		image/..
		text/..
		-
	Mozilla/5.0 (compatible; Tbot/1.0;)
		text/..
	AnomieBOT 1.0 (BAGBot; see [[User:AnomieBOT]])
		application/json
		text/..
	Mozilla/5.0 (compatible; LucidWorks/; ; crawler at example dot com)
		text/..
		-
	DotNetWikiBot/2.96 (Microsoft Windows NT 6.1.7601 Service Pack 1; )
		text/..
		-
		application/xml
	OrlodrimBot/1.0
		text/..
	COIBot/1.00
		text/..
	SiocWikiBot/1.0
		application/vnd.php.serialized
		text/..
		-
	Zing-BottaBot/2.0
		text/..
	bitlybot
		text/..
		image/..
		-
	DotNetWikiBot/2.100 (Unix 3.0.0.12; )
		text/..
		application/xml
	Mozilla/5.0 (SnapPreviewBot) Gecko/20061206 Firefox/1.5.0.9
		image/..
		text/..
	Soundkiosk Relation-Crawler (Version 1.0; soundkiosk.de)
		application/xml
		text/..
	HTMLParser/2.0
		text/..
	infraEnterprise v8 Web Crawler
		-
		text/..
	mail address mail address – MediaWiki Tcl Bot Framework 0.5
		application/x-www-form-urlencoded
		application/json
	Surag Spider/Nutch-1.4
		text/..
		image/..
	GoogleBot
		text/..
		image/..
	DotNetWikiBot/2.100 (Microsoft Windows NT 5.1.2600 Service Pack 3; )
		text/..
		application/xml
	TrueKnowledgeBot bot mail address >
		application/vnd.php.serialized
		application/xml
		text/..
	GNAA-bot
		text/..
	YBot/0.1
		application/vnd.php.serialized
	Phantom.js bot
		image/..
		text/..
	COIBot/2.0
		text/..
	TVersity Media Robot
		text/..
	LauschenBot/1.0 ( mail address )
		text/..
	Mozilla/5.0 (compatible; FriendFeedBot/0.1; Http://friendfeed.com/about/bot; 367 subscribers; feed-id=3852576738117026533)
		application/xml
		-
	WisdomStreamsSpider/Nutch-1.5 (Wisdom Streams Crawler; www.lmwisdom.com; mail address )
		text/..
	MyCuteBot/0.1
		text/..
		application/json
		application/vnd.php.serialized
	MediaWiki::Bot/1.00
		text/..
		application/json
	Empedia Bot
		text/..
	Web Crawler
		text/..
	DotNetWikiBot, edited by D. Rodionov/2.91 (Microsoft Windows NT 6.0.6002 Service Pack 2; )
		text/..
		application/xml
	SuperBot/4.7.0.74 (Windows XP)
		text/..
		image/..
	XLinkBot/1.00
		text/..
	minicrawler/1
		text/..
	Mozilla/5.0 (compatible; UnisterBot; mail address )
		text/..
		image/..
	Goalkeeperbot(User:Beetstra)/1.0
		text/..
	NexiSpider/Nutch-1.5.1
		text/..
	Mozilla/5.0 (Bgbot 0.5)
		text/..
	uw_transparancy, toolserver.org wikiproject parser
		application/json
		text/..
	SiteSeekerCrawler/1.0
		text/..
	AnomieBOT 1.0 (RandomPagePicker; see [[User:AnomieBOT]])
		application/json
	SoftNet Nutch Spider/Nutch-1.4
		text/..
		application/ogg
	mySpider/Nutch-1.5.1
		text/..
	myurlcrawler/0.1
		text/..
	python-wikitools/1.2 (User:Mr.Z-bot)
		application/json
	AdMedia bot
		text/..
	Opera/8.01 (J2ME/MIDP; MXit WebBot/6.2.0/1.8.5.168;) Opera Mini/3.1
		image/..
		text/..
		-
	DotNetWikiBot/2.96 (Microsoft Windows NT 6.1.7600.0; )
		text/..
	python-wikitools/1.2 (User:LaraBot)
		application/json
	Opera/8.01 (J2ME/MIDP; MXit WebBot/6.1.0/1.8.5.168;) Opera Mini/3.1
		image/..
		text/..
		-
	Mozilla/5.0 QunarBot/1.0
		text/..
	SINA_ROBOT; Mozilla/5.0 (Windows; Windows NT 5.1; MSIE8.0; zh-CN; rv:1.9.1.8) Gecko/20100202 Firef8
		text/..
	wikbot/1.60 CFNetwork/548.0.4 Darwin/11.0.0
		image/..
		text/..
		application/json
	leftco-bot/1.0
		text/..
	My Nutch Spider/Nutch-1.4
		text/..
		-
	Mozilla 5.0 (Apibot 0.30b5)
		application/vnd.php.serialized
	SearchBot
		text/..
	DotNetWikiBot/2.99 (Microsoft Windows NT 6.1.7601 Service Pack 1; )
		text/..
	Geni ircpybot 1.0
		application/json
		text/..
		application/xml
	MediaWiki::Bot 3.1.5
		application/json
	HosiryuhosiBot IRC-RecentChanges Checker for Personal
		text/..
		application/x-www-form-urlencoded
	MyCuteBot / 0.1.
		text/..
	wikbot/1.60 CFNetwork/485.13.9 Darwin/11.0.0
		image/..
		application/json
		text/..
	FAST Enterprise Crawler/5.3.4 ( mail address )
		text/..
		-
	UniversalFeedParser/5.1.1 https://code.google.com/p/feedparser/
		text/..
		application/xml
	AnomieBOT 1.0 (DeletionSortingCleaner; see [[User:AnomieBOT]])
		application/json
17966.99	total

IP ranges: known ip ranges for Google are 64.233.[160.0-191.255], 66.249.[64.0-95.255], 66.102.[0.0-15.255], 72.14.[192.0-255.255],
74.125.[0.0-255.255], 209.085.[128.0-255.255], 216.239.[32.0-63.255] and a few minor other subranges

Errata: WMF traffic logging service suffered from server capacity problems in Aug/Sep/Oct 2011.
Absolute traffic counts for October 2011 are approximatly 7% too low.
Data loss only occurred during peak hours. It therefore may have had somewhat different impact for traffic from different parts of the world.
and may have also skewed relative figures like share of traffic per browser or operating system.

From mid September till late November squid log records for mobile traffic were in invalid format.
Data could be repaired for logs from mid October onwards. Older logs were no longer available.

In a an unrelated server outage precisely half of traffic to WMF mobile sites was not counted from Oct 16 - Nov 29 (one of two load-balanced servers did not report traffic).
WMF has since improved server monitoring, so that similar outages should be detected and fixed much faster from now on.

Generated on Fri, Sep 7, 2012 13:35
Author:Erik Zachte (Web site)
Mail: ezachte@### (no spam: ### = wikimedia.org)
All data and images on this page are in the public domain.

Note: page may load slower on Microsoft Internet explorer than on other major browsers