被源站屏蔽解决~采集标识

百度爬虫标识:
Mozilla/5.0 (compatible; Baiduspider/2.0; http://www.baidu.com/search/spider.html)

谷歌爬虫标识:
Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)

搜狗爬虫标识:
Sogou web spider/4.0( http://www.sogou.com/docs/help/webmasters.htm#07)

360爬虫标识:
Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-CN; rv:1.8.0.11) Gecko/20070312 Firefox/1.5.0.11; 360Spider

宜搜爬虫标识:
Mozilla/5.0 (compatible; EasouSpider; www.easou.com/search/spider.html)

必应爬虫标识:
Mozilla/5.0 (compatible; bingbot/2.0 http://www.bing.com/bingbot.htm)

百度转码标识:
Firefox 3.6 Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-CN; rv:1.9.2.8;baidu Transcoder) Gecko/20100722 Firefox/3.6.8 ( .NET CLR 3.5.30729)

谷歌转码标识:
Chrome Mozilla/5.0 (en-us) AppleWebKit/534.14 (KHTML, like Gecko; Google Wireless Transcoder) Chrome/9.0.597 Safari/534.14
新浪转码标识:
Mozilla 0.0 SINA_WEIBO; Mozilla/5.0 (Windows; U; Windows NT 5.1; MSIE8.0; zh-CN; rv:1.9.1.8) Gecko/20100202 Firef8 (.NET CLR 3.5.30729)

Leave a Comment