分类规则
按 UA 和 IP 段数，一行日志可以同时算进好几条。Baiduspider、Googlebot 会反查 IP 核验真假：反查到的主机名得是它家的域名，再正查回来是这个 IP。
Baiduspider 百度蜘蛛
Googlebot 谷歌蜘蛛
Sogou 搜狗蜘蛛
360Spider 360蜘蛛
YisouSpider 神马蜘蛛
Yahoo 雅虎蜘蛛
123.125.68. 123.125.68沙盒
220.181.68. 220.181.68沙盒
220.181.7. 220.181.7预备抓取
123.125.66. 123.125.66预备抓取
121.14.89. 121.14.89新站考察
203.208.60. 203.208.60网站异常
210.72.225. 210.72.225巡逻
123.125.71.106 123.125.71.106低权重
123.125.71.95 123.125.71.95低权重
123.125.71.97 123.125.71.97低权重
123.125.71.117 123.125.71.117低权重
123.125.71. 123.125.71低权重汇总
220.181.108.95 220.181.108.95隔日快照
220.181.108.92 220.181.108.92权重抓取
220.181.108.91 220.181.108.91综合权重
220.181.108.75 220.181.108.75内页权重
220.181.108.86 220.181.108.86权重首页
220.181.108.89 220.181.108.89权重首页
220.181.108.94 220.181.108.94权重首页
220.181.108.97 220.181.108.97权重首页
220.181.108.80 220.181.108.80权重首页
220.181.108.77 220.181.108.77权重首页
220.181.108.83 220.181.108.83权重首页
220.181.108. 220.181.108权重蜘蛛汇总