Used Browsers |
1 | 23350 | 42.00 | 134 | 1.98 | MJ12bot/v1.4.7 |
2 | 9280 | 16.69 | 747 | 11.04 | DotBot/1.1 |
3 | 7672 | 13.80 | 2222 | 32.84 | compatible Mozilla/5.x |
4 | 4539 | 8.16 | 1 | 0.01 | MegaIndex.ru/2.0 |
5 | 1498 | 2.69 | 404 | 5.97 | AhrefsBot/5.2 |
6 | 1326 | 2.39 | 445 | 6.58 | Internet Explorer 6.x |
7 | 1308 | 2.35 | 46 | 0.68 | Barkrowler experimental crawler - 0.4.7 |
8 | 810 | 1.46 | 644 | 9.52 | Baiduspider/2.0 |
9 | 489 | 0.88 | 68 | 1.01 | SeznamBot/3.2 |
10 | 469 | 0.84 | 84 | 1.24 | YandexBot/3.0 |
11 | 408 | 0.73 | 82 | 1.21 | linkdexbot/2.0 |
12 | 361 | 0.65 | 81 | 1.20 | (unknown) |
13 | 347 | 0.62 | 202 | 2.99 | bingbot/2.0 |
14 | 339 | 0.61 | 149 | 2.20 | Googlebot 2.x |
15 | 277 | 0.50 | 158 | 2.34 | Ubuntu/7.10 |
16 | 210 | 0.38 | 2 | 0.03 | Scrapy/1.0.5 (+http://scrapy.org) |
17 | 206 | 0.37 | 33 | 0.49 | Internet Explorer 9.x |
18 | 188 | 0.34 | 109 | 1.61 | Internet Explorer 5.5 |
19 | 181 | 0.33 | 5 | 0.07 | spbot/5.0.3 |
20 | 178 | 0.32 | 136 | 2.01 | Opera 9.x |
21 | 159 | 0.29 | 130 | 1.92 | Opera 7.x |
22 | 142 | 0.26 | 114 | 1.68 | Opera 8.x |
23 | 128 | 0.23 | 40 | 0.59 | Sogou web spider/4.0(+http://www.sogou.c... |
24 | 110 | 0.20 | 84 | 1.24 | Internet Explorer 7.x |
25 | 104 | 0.19 | 4 | 0.06 | SemrushBot/1.2~bl |
26 | 101 | 0.18 | 75 | 1.11 | compatible Mozilla/4.x |
27 | 73 | 0.13 | 61 | 0.90 | Internet Explorer 5.x |
28 | 70 | 0.13 | 7 | 0.10 | HubSpot Marketing Grader, HubSpot Market... |
29 | 54 | 0.10 | 20 | 0.30 | Wget |
30 | 52 | 0.09 | 7 | 0.10 | Insideview/Nutch-1.13-SNAPSHOT |
31 | 51 | 0.09 | 42 | 0.62 | Netscape 4.7x |
32 | 50 | 0.09 | 2 | 0.03 | Mozilla |
33 | 45 | 0.08 | 3 | 0.04 | Barkrowler 0.1.6 |
34 | 45 | 0.08 | 5 | 0.07 | SEOkicks-Robot |
35 | 44 | 0.08 | 1 | 0.01 | LinkpadBot/1.12 |
36 | 43 | 0.08 | 0 | 0.00 | ZmEu |
37 | 43 | 0.08 | 37 | 0.55 | Internet Explorer 2.x |
38 | 42 | 0.08 | 21 | 0.31 | Steeler/3.5 |
39 | 36 | 0.06 | 0 | 0.00 | yoozBot-2.2 |
40 | 34 | 0.06 | 4 | 0.06 | MJ12bot/v1.4.8 |
41 | 34 | 0.06 | 32 | 0.47 | Opera 6.x |
42 | 32 | 0.06 | 25 | 0.37 | compatible Mozilla/3.x |
43 | 31 | 0.06 | 0 | 0.00 | YandexImages/3.0 |
44 | 29 | 0.05 | 7 | 0.10 | Internet Explorer 10.x |
45 | 24 | 0.04 | 0 | 0.00 | Firefox/3.6.28 |
46 | 24 | 0.04 | 22 | 0.33 | sysscan/1.0 (https://github.com/robertda... |
47 | 22 | 0.04 | 3 | 0.04 | CCBot/2.0 (http://commoncrawl.org/faq/) |
48 | 22 | 0.04 | 2 | 0.03 | Python-urllib/2.7 |
49 | 22 | 0.04 | 4 | 0.06 | Cliqzbot/2.0 |
50 | 20 | 0.04 | 19 | 0.28 | Mozilla/0.91 Beta (Windows) |
51 | 20 | 0.04 | 17 | 0.25 | Powermarks/3.5 |
52 | 20 | 0.04 | 1 | 0.01 | crawler4j (http://code.google.com/p/craw... |
53 | 18 | 0.03 | 2 | 0.03 | Linux x86_64 |
54 | 18 | 0.03 | 3 | 0.04 | masscan/1.0 |
55 | 17 | 0.03 | 16 | 0.24 | Internet Explorer 4.x |
56 | 17 | 0.03 | 15 | 0.22 | Netscape 4.x |
57 | 17 | 0.03 | 7 | 0.10 | Go-http-client/1.1 |
58 | 16 | 0.03 | 14 | 0.21 | Internet Explorer 3.x |
59 | 16 | 0.03 | 16 | 0.24 | Mozilla/0.6 Beta (Windows) |
60 | 15 | 0.03 | 0 | 0.00 | python-requests/2.14.2 |
61 | 14 | 0.03 | 14 | 0.21 | eZ Publish Link Validator |
62 | 14 | 0.03 | 12 | 0.18 | CakePHP |
63 | 14 | 0.03 | 2 | 0.03 | Exabot/3.0 |
64 | 13 | 0.02 | 4 | 0.06 | Firefox/2.0.0.6 |
65 | 12 | 0.02 | 12 | 0.18 | WebCapture 2.0 |
66 | 12 | 0.02 | 6 | 0.09 | Internet Explorer 8.x |
67 | 11 | 0.02 | 1 | 0.01 | Virusdie crawler/3.0 |
68 | 10 | 0.02 | 3 | 0.04 | Dispatch/0.11.3 |
69 | 10 | 0.02 | 3 | 0.04 | SafeDNSBot (https://www.safedns.com/sear... |
70 | 10 | 0.02 | 0 | 0.00 | XoviBot/2.0 |
71 | 9 | 0.02 | 1 | 0.01 | oBot/2.3.1 |
72 | 8 | 0.01 | 0 | 0.00 | Googlebot-Image/1.0 |
73 | 8 | 0.01 | 0 | 0.00 | NYU internet census |
74 | 7 | 0.01 | 5 | 0.07 | python-requests/2.10.0 |
75 | 7 | 0.01 | 7 | 0.10 | Firefox/2.0.0.4 |
76 | 7 | 0.01 | 7 | 0.10 | marketinggrader.com |
77 | 7 | 0.01 | 7 | 0.10 | YisouSpider |
78 | 7 | 0.01 | 1 | 0.01 | Apache-HttpClient/4.2.5 (java 1.5) |
79 | 6 | 0.01 | 0 | 0.00 | Twisted PageGetter |
80 | 6 | 0.01 | 0 | 0.00 | Telesphoreo |
81 | 6 | 0.01 | 4 | 0.06 | NetcraftSurveyAgent/1.0 |
82 | 6 | 0.01 | 3 | 0.04 | Yahoo! Slurp |
83 | 5 | 0.01 | 0 | 0.00 | the beast |
84 | 5 | 0.01 | 5 | 0.07 | Scanbot |
85 | 5 | 0.01 | 0 | 0.00 | MobileSafari/604.1 CFNetwork/887 Darwin/... |
86 | 4 | 0.01 | 4 | 0.06 | SuperPagesUrlVerifyBot/1.0 |
87 | 4 | 0.01 | 2 | 0.03 | Python-urllib/2.6 |
88 | 4 | 0.01 | 2 | 0.03 | rogerbot/1.1 (http://moz.com/help/guides... |
89 | 4 | 0.01 | 4 | 0.06 | Apache-HttpClient/4.5.2 (Java/1.7.0_55) |
90 | 4 | 0.01 | 0 | 0.00 | RPS/HTTP PROXY |
91 | 4 | 0.01 | 2 | 0.03 | www.probethenet.com scanner |
92 | 4 | 0.01 | 4 | 0.06 | masscan/1.0 (https://github.com/robertda... |
93 | 3 | 0.01 | 1 | 0.01 | Firefox/2.0.0.9 |
94 | 2 | 0.00 | 2 | 0.03 | rest-client/2.0.0.rc2 (linux-gnu x86_64)... |
95 | 2 | 0.00 | 0 | 0.00 | SiteExplorer/1.1b |
96 | 2 | 0.00 | 2 | 0.03 | curl |
97 | 2 | 0.00 | 2 | 0.03 | Ruby/Curb |
98 | 2 | 0.00 | 0 | 0.00 | PycURL/7.19.5 libcurl/7.38.0 GnuTLS/3.3.... |
99 | 2 | 0.00 | 2 | 0.03 | CRAZYWEBCRAWLER 0.9.10, http://www.crazy... |
100 | 2 | 0.00 | 2 | 0.03 | Python/3.6 aiohttp/2.2.5 |
101 | 2 | 0.00 | 1 | 0.01 | nutch-1.4/Nutch-1.4 |
102 | 2 | 0.00 | 1 | 0.01 | python-requests/2.18.4 |
103 | 2 | 0.00 | 2 | 0.03 | Microsoft Office Excel 2013 |
104 | 2 | 0.00 | 2 | 0.03 | Firefox/3.6.3 |
105 | 2 | 0.00 | 2 | 0.03 | ERIPPbot |
106 | 2 | 0.00 | 2 | 0.03 | facebookexternalhit/1.1 (+http://www.fac... |
107 | 2 | 0.00 | 2 | 0.03 | Nmap Scripting Engine |
108 | 2 | 0.00 | 2 | 0.03 | Firefox/15.0.0.1 |
109 | 2 | 0.00 | 0 | 0.00 | python-requests/2.13.0 |
110 | 2 | 0.00 | 0 | 0.00 | Win32 |
111 | 2 | 0.00 | 2 | 0.03 | Apache-HttpClient/4.3.4 (java 1.5) |
112 | 1 | 0.00 | 1 | 0.01 | libwww-perl 6.x |
113 | 1 | 0.00 | 0 | 0.00 | New Horizons |
114 | 1 | 0.00 | 1 | 0.01 | Apache-HttpClient/4.4.1 (Java/1.8.0_121) |
115 | 1 | 0.00 | 1 | 0.01 | Firefox/2.0.0.12 |
116 | 1 | 0.00 | 1 | 0.01 | Java/1.8.0_121 |
117 | 1 | 0.00 | 1 | 0.01 | Gecko/20100916 Iceape/2.0.8 |
118 | 1 | 0.00 | 1 | 0.01 | python-requests/2.8.1 |
119 | 1 | 0.00 | 1 | 0.01 | Java/1.7.0_111 |
120 | 1 | 0.00 | 0 | 0.00 | Mozilla Firebird/0.6 |
121 | 1 | 0.00 | 1 | 0.01 | (KHTML, like Gecko) Chrome/36.0.1944.0 S... |
122 | 1 | 0.00 | 1 | 0.01 | Firefox/3.6.2 |
123 | 1 | 0.00 | 0 | 0.00 | Saleslift |
124 | 1 | 0.00 | 1 | 0.01 | Gentoo Firefox/3.6.8 |