搜索引擎蜘蛛 IP 大全
用这些 IP 段识别访问你网站的爬虫，或反向屏蔽恶意爬虫。
Googlebot 谷歌爬虫
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
66.249.66.0/2466.249.64.0/2064.233.160.0/19Baiduspider 百度爬虫
Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
180.76.15.0/24220.181.108.0/24116.179.32.0/24Bingbot 必应爬虫
Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
40.77.167.0/24157.55.39.0/24207.46.13.0/24YandexBot 俄罗斯 Yandex
Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
141.8.142.0/24178.154.128.0/24DuckDuckBot DuckDuckGo 爬虫
DuckDuckBot/1.1; (+http://duckduckgo.com/duckduckbot.html)
72.94.249.0/2450.16.0.0/16Sogou Spider 搜狗爬虫
Sogou Pic Spider/3.0( http://www.sogou.com/docs/help/webmasters.htm)
220.181.124.0/2461.135.0.0/16360Spider 360 搜索爬虫
Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; 360Spider)
42.236.0.0/16180.153.0.0/16Applebot 苹果 Siri/Spotlight 爬虫
Mozilla/5.0 (compatible; Applebot/0.1; +http://www.apple.com/go/applebot)
17.0.0.0/8