Classification rules
Counted by user agent and IP range. One log line can count toward several rules. Baiduspider, Googlebot are verified by reverse DNS: the IP must resolve to a hostname on the search engine's own domain, and that hostname must resolve back to the IP.
Baiduspider 百度蜘蛛
Googlebot 谷歌蜘蛛
Sogou 搜狗蜘蛛
360Spider 360蜘蛛
YisouSpider 神马蜘蛛
Yahoo 雅虎蜘蛛
123.125.68. 123.125.68沙盒
220.181.68. 220.181.68沙盒
220.181.7. 220.181.7预备抓取
123.125.66. 123.125.66预备抓取
121.14.89. 121.14.89新站考察
203.208.60. 203.208.60网站异常
210.72.225. 210.72.225巡逻
123.125.71.106 123.125.71.106低权重
123.125.71.95 123.125.71.95低权重
123.125.71.97 123.125.71.97低权重
123.125.71.117 123.125.71.117低权重
123.125.71. 123.125.71低权重汇总
220.181.108.95 220.181.108.95隔日快照
220.181.108.92 220.181.108.92权重抓取
220.181.108.91 220.181.108.91综合权重
220.181.108.75 220.181.108.75内页权重
220.181.108.86 220.181.108.86权重首页
220.181.108.89 220.181.108.89权重首页
220.181.108.94 220.181.108.94权重首页
220.181.108.97 220.181.108.97权重首页
220.181.108.80 220.181.108.80权重首页
220.181.108.77 220.181.108.77权重首页
220.181.108.83 220.181.108.83权重首页
220.181.108. 220.181.108权重蜘蛛汇总