log日志分析工具及百度蜘蛛IP字段判断分析

log日志分析是一个seo必要学会的手段,主要是用来判断蜘蛛爬取时段规律的根据多年总结已经摸清大部分重要蜘蛛的IP。一个大型网站的蜘蛛爬取和用户预览都是成千上万甚至几十万的。人工分析非常缓慢,给大家推荐一个工具水淼日志分析,百度网盘链接:https://pan.baidu.com/s/14T3T7zFmYCBhXVOSYE9oMA; 提取码:090g;

下面给大家介绍一下使用方法

第一步导入日志,日志格式例如:PDF名称.log或者是PDF名称.log-日期。


www.zhaojianseo.com的log日志表.jpg

打开水淼工具选择文件名.exe文件

水淼日志分析工具的打开方式图.jpg

第一步选择导入日志文件或者拖动log日志;第二步如果不是log为后缀的文件(不包括压缩文件)选择全部文件;第二步导出csv文件

水淼工具使用方式.jpg

打开csv文件,进行筛选Spider。

筛选百度蜘蛛.jpg

复制所有的baidudpider到另一个excel表中粘贴,添加判断蜘蛛条件进行判断即可。

百度蜘蛛IP字段判断分析.jpg

百度判断代码如下,可自行修改。

=IFS(COUNTIF(A1,"125.39.78.185"),"百度竞价蜘蛛",COUNTIF(A1,"61.135.165.134"),"百度竞价蜘蛛",COUNTIF(A1,"117.34.74.66"),"百度竞价蜘蛛",COUNTIF(A1,"118.122.188.194"),"百度竞价蜘蛛",COUNTIF(A1,"119.63.196.9"),"百度竞价蜘蛛",COUNTIF(A1,"218.30.118.*"),"K站沙盒蜘蛛",COUNTIF(A1,"220.181.68.*"),"K站沙盒蜘蛛",COUNTIF(A1,"123.125.68.*"),"K站沙盒蜘蛛",COUNTIF(A1,"123.125.71.*"),"内页收录质量不高",COUNTIF(A1,"203.208.60.*"),"新站不正常蜘蛛",COUNTIF(A1,"183.91.40.144"),"新站不正常蜘蛛",COUNTIF(A1,"220.181.7.*"),"准备抓取蜘蛛",COUNTIF(A1,"123.125.66.*"),"准备抓取蜘蛛",COUNTIF(A1,"61.135.186.*"),"百度统计蜘蛛",COUNTIF(A1,"121.14.89.*"),"新站考察蜘蛛",COUNTIF(A1,"123.15.**.**"),"百度图片蜘蛛",COUNTIF(A1,"123.125.68.*"),"降权蜘蛛",COUNTIF(A1,"210.72.225.*"),"酱油蜘蛛",COUNTIF(A1,"220.181.108.91"),"26小时索引",COUNTIF(A1,"220.181.108.75"),"27小时索引",COUNTIF(A1,"220.181.108.92"),"25小时索引",COUNTIF(A1,"220.181.108.95"),"24小时索引",COUNTIF(A1,"123.125.67.*"),"巡逻蜘蛛",COUNTIF(A1,"116.179.32.*"),"目录蜘蛛",COUNTIF(A1,"124.166.232.*"),"低质量蜘蛛",COUNTIF(A1,"220.181.51.*"),"sitemap蜘蛛",COUNTIF(A1,"220.181.108.*"),"抓取蜘蛛",COUNTIF(A1,"116.179.37.*"),"js图片蜘蛛",COUNTIF(A1,"111.206.221.*"),"图片蜘蛛",COUNTIF(A1,"116.179.32.*"),"目录蜘蛛",COUNTIF(A1,"117.25.139.*"),"301重定向蜘蛛",COUNTIF(A1,"119.29.65.*"),"后台抓取蜘蛛",COUNTIF(A1,"210.12.126.*"),"产品目录蜘蛛",COUNTIF(A1,"222.186.172.*"),"首页404蜘蛛",COUNTIF(A1,"220.181.108.86"),"首页权重蜘蛛",COUNTIF(A1,"220.181.108.89"),"首页权重蜘蛛",COUNTIF(A1,"220.181.108.94"),"首页权重蜘蛛",COUNTIF(A1,"220.181.108.97"),"首页权重蜘蛛",COUNTIF(A1,"220.181.108.80"),"首页权重蜘蛛",COUNTIF(A1,"220.181.108.77"),"首页权重蜘蛛",COUNTIF(A1,"220.181.108.83"),"首页权重蜘蛛",COUNTIF(A1,"60.172.229.61"),"准备抓取蜘蛛",COUNTIF(A1,"61.129.45.72"),"准备抓取蜘蛛",COUNTIF(A1,"61.135.162.*"),"准备抓取蜘蛛",COUNTIF(A1,"61.135.165.134"),"百度竞价蜘蛛",COUNTIF(A1,"117.34.74.66"),"百度竞价蜘蛛",COUNTIF(A1,"118.122.188.194"),"百度竞价蜘蛛",COUNTIF(A1,"119.63.196.9"),"百度竞价蜘蛛",COUNTIF(A1,"125.39.78.185"),"百度竞价蜘蛛",COUNTIF(A1,"123.125.71.106"),"怀疑非原创文章",COUNTIF(A1,"123.181.108.77"),"怀疑非原创文章",COUNTIF(A1,"123.125.71.97"),"怀疑非原创文章",COUNTIF(A1,"123.125.71.95"),"怀疑非原创文章",COUNTIF(A1,"220.181.158.107"),"降权蜘蛛",COUNTIF(A1,"180.76.5.87"),"降权蜘蛛",COUNTIF(A1,"180.76.5.*"),"降权蜘蛛",COUNTIF(A1,"159.226.50.*"),"降权蜘蛛",COUNTIF(A1,"121.10.141.*"),"站长工具",COUNTIF(A1,"119.147.114.213"),"站长工具",COUNTIF(A1,"117.28.255.42"),"站长工具",COUNTIF(A1,"117.21.220.245"),"站长工具",COUNTIF(A1,"113.98.254.245*"),"站长工具",COUNTIF(A1,"61.147.98.146"),"站长工具",COUNTIF(A1,"61.188.39.16"),"站长工具")