python爬虫

pymongo+etree+requests+fake_useragent实现小说站点数据爬取，fake_useragent设置随机请求头，并保存数据到mongodb

lxml.etree进行xpath数据的解析和提取 子父节点数据获取，多属性匹配，顺序选择......

``` # coding=utf-8 import pymongo # 初始化连接 client = pymongo.MongoClient(host='localhost', port=27017)

``` # coding=utf-8 import pymongo # 初始化连接 client = pymongo.MongoClient(host='localhost', port=27017)

pymongo查询单条数据、多条数据、数据查询升降序、限制查询数、位置偏移、较大数据量的查询......

1.pymongo：pip install pymongo 2.mongodb：https://www.runoob.com/mongodb/mongodb-window-install.html