林中有神_君

本篇文章可能基于管道的文件保存有点问题，可以关闭管道直接在终端保存数据 保存为json scrapy crawl db -o ./douban.json 保存为csv scrapy crawl db -o ./douban.csv spider.from douban.class...

spider.from DD.class DdSpider(scrapy.allowed_domains = ['http://search.dangdang.start_urls = ['http://search.dangdang.url='http://search.dan...

spider.from bosi.class BsSpider(scrapy.allowed_domains = ['cqie.iflysse.start_urls = ['http://cqie.iflysse.com/Handler/Report/StuFileList.ur...

from bosi.class BsSpider(scrapy."User-Agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4...

目标网址： https://www.creprice.cn/rank/index.这一看就是个静态页面，没有用任何反爬措施所以很好爬。 直接发送请求解析数据就可以了。wb=openpyxl.sheet = wb.sheet.url="https://www.creprice.cn...

url='https://tieba.baidu."User-Agent":"Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.88 Safar...

import urllib.request,urllib.baseurl = "https://movie.douban.savepath="豆瓣电影Top250.print(time.findLink = re.compile(r'<a href="(.findImgSrc =...