开启掘金成长之旅！这是我参与「掘金日新计划 · 12 月更文挑战」的第22天，点击查看活动详情
分享使用爬虫时遇到的几个报错：
1.报错： SyntaxError: Non-UTF-8 code starting with ‘\xe7‘
今天抓取数据时使用re对数据进行提取时遇到的问题：syntaxError: Non-UTF-8 code starting with '\xe7',意思是有的中文字符无法转成utf-8的形式，如图所示：
这个是因为抓取的数据中有的中文字符识别不了，相应的数据如下：
class="sale-num">0</span>件</div> </div> </dd>
</dl> <dl class="item " data-id="658360334789"> <dt class="photo"> <a class="J_TGoldData" href="//item.taobao.com/item.htm?id=658360334789" target="_blank" data-gold-url="/inshopse" data-gold-data='{"gokey":"at_bucketid=&srppage=1&scid=&lf_aclog=20-658360334789-24-null-1672116384&?src=shopsystem--33.7.235.200&sort=popular:des&q=%E5%A8%BC%EE%86%BD%E7%A5%A6%E6%BF%82%E5%AE%A0%EE%97%8A%E7%BC%87%E7%95%8C%E7%B2%A7%E9%8F%88%EF
%BF%BD&tab=all&ss_bucket=18&rank_src=inshop_pc_tb&buyernick=tb089523630&shop_id=103889497&navigator=property&s=0&n=24&app=inshop&outfmt=json&stats_click=&rn=bf364af4330ca3ede3b1b5c333e63464", "cna": "BNQVHHXMNzMCATrRitnbrIZf","bc_type":"c" }' > <img src="https://p3-juejin.byteimg.com/tos-cn-i-k3u1fbpfcp/da3254a456564bcf8fcbe5b8737a4613~tplv-k3u1fbpfcp-zoom-1.image" >
</a> </dt> <dd class="detail"> <a class="item-name J_TGoldData" href="//item.taobao.com/item.htm?id=658360334789" target="_blank" data-gold-url="/inshopse" data-gold-data='{"gokey":"at_bucketid=&srppage=1&sci
d=&lf_aclog=20-658360334789-24-null-1672116384&?src=shopsystem--33.7.235.200&sort=popular:des&q=%E5%A8%BC%EE%86%BD%E7%A5%A6%E6%BF%82%E5%AE%A0%EE%97%8A%E7%BC%87%E7%95%8C%E7%B2%A7%E9%8F%88%EF%BF%BD
&tab=all&ss_bucket=18&
rank_src=inshop_pc_tb&buyernick=tb089523630&shop_id=103889497&navigator=property&s=0&n=24&app=inshop&outfmt=json&stats_click=&rn=bf364af4330ca3ede3b1b5c333e63464", "cna": "BNQVHHXMNzMCATrRitnbrIZf","bc_type":"c" }' > 秋季街头短款外套2021年新款女纯色百搭拉链连帽长袖卫衣直筒上衣</a> <div class="attribute"> <div class="cprice-area"><span class="symbol">¥</span><span class="c-price">89.00</span></div>
<div class="sprice-area"><span class="symbol">¥</span><span class="s-price">158.00 </span></div> <!--rsdata.showSaleData: true-->
<div class="sale-area">已售：<span class="sale-num">1</span>件</div> </div> </dd> </dl> <dl class="item last" data-id="6585372
76231"> <dt class="photo"> <a class="J_TGoldData" href="//item.taobao.com/item.htm?id=658537276231" target="_blank" data-gold-url="/inshopse" data-gold-
data='{"gokey":"at_bucketid=&srppage=1&scid=&lf_aclog=21-658537276231-24-null-1672116384&?src=shopsystem-
-33.7.235.200&sort=popular:des&q=%E5%A8%BC%EE%86%BD%E7%A5%A6%E6%BF%82%E5%AE%A0%EE%97%8A%E7%BC%87%E7%95%8C%E7%B2%A7%E9%8F%88%EF%BF%BD&tab=all&ss_bucket=18&rank_src=inshop_pc_tb&buyernick=tb089523630&a
mp;shop_id=103889497&navigator=property&s=0&n=24&app=inshop&outfmt=json&stats_click=&rn=bf364af4330ca3ede3b1b5c333e63464", "cna": "BNQVHHXMNzMCATrRitnbrIZf","bc_type":"c" }' > <img src="https://p3-juejin.byteimg.com/tos-cn-i-k3u1fbpfcp/79575d89208f4339a54cef9730294057~tplv-k3u1fbpfcp-zoom-1.image" > </a> </dt>
<dd class="detail"> <a class="item-name J_TGoldData" href="//item.taobao.com/item.htm?id=658537276231" target="_blank" data-gold-url="/inshopse" d
ata-gold-
data='{"gokey":"at_bucketid=&srppage=1&scid=&lf_aclog=21-658537276231-24-null-1672116384&?src=shopsystem-
-33.7.235.200&sort=popular:des&q=%E5%A8%BC%EE%86%BD%E7%A5%A6%E6%BF%82%E5%AE%A0%EE%97%8A%E7%BC%87%E7%95%8C%E7%B2%A7%E9%8F%88%EF%BF%BD&tab=all&ss_bucket=18&rank_src=inshop_pc_tb&buyernick=tb089523630&shop_id=103889497&navigator=property&s=0&n=24&app=inshop&outfmt=json&stats_click=&rn=bf364af4330ca3ede3b1b5c333e63464", "cna": "BNQVHHXMNzMCATrRitnbrIZf","bc_type":"c" }' > 2022秋冬欧美街头短款修身棉服女立领拉链加厚外套保暖休闲棉衣</a> <div class="attribute"> <div class="cprice-area"><span class="symbol">¥</span><span class="c-price">98.00</span></div> <div class="sprice-area"><span class="symbol">¥</span><span class="s-price">159.00 </span></div> <!--rsdata.showSaleData: true--> <div class="sale-area">已售：<span class="sal
e-num">100+</span>件</div> </div> </dd> </dl> </div> <div class="item3line1"> <dl class="item " data-id="659042741963"> <dt class="photo"> <a class="J_TGoldData" href="//item.taobao.com/item.htm?id=659042741963" target="_blank" data-gold-url="/inshopse" data-gold-data='{"gokey":"at_bucketid=&srppage=1&scid=&lf_aclog=22-659042741963-24-null-1672116384&?src=shopsystem--33.7.235.200&sort=popular:des&q=%E5%A8%BC%EE%86%BD%E7%A5%A6%E6%BF%82%E5%AE%A0%EE%97%8A%E7%BC%87%E7%95%8C%E7%B2%A7%E9%8F%88%EF%BF%BD&tab=all&ss_bucket=18&rank_src=inshop_pc_tb&buyernick=tb089523630&shop_id=103889497&navigator=property&s=0&n=24&app=inshop&outfmt=
json&stats_click=&rn=bf364af4330ca3ede3b1b5c333e63464", "cna": "BNQVHHXMNzMCATrRitnbrIZf","bc_type":"c" }' > <img src="https://p3-juejin.byteimg.com/tos-cn-i-k3u1fbpfcp/a59a3e6ce9f94beb896ce1cda898bdfd~tplv-k3u1fbpfcp-zoom-1.image" > </a> </dt> <dd class="detail"> <a class="item-name J_TGoldData" href="//item.taobao.com/item.htm?id=659042741963" target="_blank" data-gold-url="/inshopse" data-gold-data='{"gokey":"at_bucketid=&srppage=1&
;scid=&lf_aclog=22-659042741963-24-null-1672116384&?src=shopsystem--33.7.235.200&sort=popular:des&q=%E5%A8%BC%EE%86%BD%E7%A5%A6%E6%BF%82%E5%AE%A0%EE%97%8A%E7%BC%87%E7%95%8C%E7%B2%A7%E9%8F%88%EF%BF%BD&tab=all&ss_bucket=18&rank_src=inshop_pc_tb&buyernick=tb089523630&shop_id=103889497&navigator=property&s=0&n=24&app=inshop&outfmt=json&stats_click=&rn=bf364af4330ca3ede3b1b5c333e63464", "cna": "BNQVHHXMNzMCATrRitnbrIZ
f","bc_type":"c" }' > 2021冬新款镂空麻花条纹针织开衫女长袖连帽宽松拉链纯色休闲外套</a> <div class="attribute"> <div class="cprice-area"><span class="symbol">¥</span><span class="c-price">99.00</span></div> <div class="sprice-area"><span class="symbol">¥</span><span class="s-price">175.00 </span></div> <!--rsdata.showSaleData: true--> <div class="sale-area">已售：<span class="sale-num">0</span>件</div> </div> </dd> </dl> <dl class="item " data-id="659055837980"> <dt class="photo"> <a class="J_TGoldData" href="//item.taobao.com/item.htm?id=659055837980" target="_blank" data-gold-url="/inshopse" data-gold-data='{"gokey":"at_bucketid=&srppage=1&scid=&lf_aclog=23-659055837980-24-null-1672116384&?src=shopsystem--33.7.235.200&sort=popular:des&q=%E5%A8%BC%EE%86%BD%E7%A5%A6%E6%BF%82%E5%AE%A0%EE%97%8A%E7%BC%87%E7%95%8C%E7%B2%A7%E9%8F%88%EF%BF%BD&tab=all&ss_bucket=18&rank_src=inshop_pc_tb&buyernick=tb089523630&shop_id=103889497&navigator=property&s=0&n=24&app=inshop&outfmt=json&stats_click=&rn=bf364af4330ca3ede3b1b5c333e63464", "cna": "BNQVHHXMNzMCATrRitnbrIZf","bc_type":"c" }' > <img src="https://p3-juejin.byteimg.com/tos-cn-i-k3u1fbpfcp/3f18e42851ce42b0bd0cfdebc4f07cff~tplv-k3u1fbpfcp-zoom-1.image" > </a> </dt> <dd class="detail"> <a class="item-name J_TGoldData" href="//item.taobao.com/item.htm?id=659055837980" target="_blank" data-gold-url="/inshopse" data-gold-data='{"gokey":"at_bucketid=&srppage=1&scid=&lf_aclog=23-659055837980-24-null-1672116384&?src=shopsystem--33.7.235.200&sort=popular:des&q=%E5%A8%BC%EE%86%BD%E7%A5%A6%E6%BF%82%E5%AE%A0%EE%97%8A%E7%BC%87%E7%95%8C%E7%B2%A7%E9%8F%88%EF%BF%BD&tab=all&ss_bucket=18&rank_src=inshop_pc_tb&buyernick=tb089523630&shop_id=103889497&navigator=property&s=0&n=24&app=inshop&outfmt=json&stats_click=&rn=bf364af4330ca3ede3b1b5c333e63464", "cna": "BNQVHHXMNzMCATrRitnbrIZf","bc_type":"c" }' > 2021欧美街头风高腰紧身纯色短款上衣女长袖圆领拉链开衫外套洋气</a> <div class="attribute"> <div class="cprice-area"><span class="symbol">¥</span><span class="c-price">65.00</span></div> <div class="sprice-area"><span class="symbol">¥</span><span class="s-price">142.00 </span></div> <!--rsdata.showSaleData: true--> <div class="sale-area">已售：<span class="sale-num">6</span>件</div> </div> </dd> </dl> <dl class="item last" data-id="659059105719"> <dt class="photo"> <a class="J_TGoldData" href="//item.taobao.com/item.htm?id=659059105719" target="_blank" data-gold-url="/inshopse" data-gold-data='{"gokey":"at_bucketid=&srppage=1&scid=&lf_aclog=24-659059105719-24-null-1672116384&?src=shopsystem--33.7.235.200&sort=popular:des&q=%E5%A8%BC%EE%86%BD%E7%A5%A6%E6%BF%82%E5%AE%A0%EE%97%8A%E7%BC%87%E7%95%8C%E7%B2%A7%E9%8F%88%EF%BF%BD&tab=all&ss_bucket=18&rank_src=inshop_pc_tb&buyernick=tb089523630&shop_id=103889497&navigator=property&s=0&n=24&app=inshop&outfmt=json&stats_click=&rn=bf364af4330ca3ede3b1b5c333e63464", "cna": "BNQVHHXMNzMCATrRitnbrIZf","bc_type":"c" }' > <img src="https://p3-juejin.byteimg.com/tos-cn-i-k3u1fbpfcp/69884768365f489390859f7748021fc6~tplv-k3u1fbpfcp-zoom-1.image" > </a> </dt> <dd class="detail"> <a class="item-name J_TGoldData" href="//item.taobao.com/item.htm?id=659059105719" target="_blank" data-gold-url="/inshopse" data-gold-data='{"gokey":"at_bucketid=&srppage=1&scid=&lf_aclog=24-659059105719-24-null-1672116384&?src=shopsystem--33.7.235.200&sort=popular:des&q=%E5%A8%BC%EE%86%BD%E7%A5%A6%E6%BF%82%E5%AE%A0%EE%97%8A%E7%BC%87%E7%95%8C%E7%B2%A7%E9%8F%88%EF%BF%BD&tab=all&ss_bucket=18&rank_src=inshop_pc_tb&buyernick=tb089523630&shop_id=103889497&navigator=property&s=0&n=24&app=inshop&outfmt=json&stats_click=&rn=bf364af4330ca3ede3b1b5c333e63464", "cna": "BNQVHHXMNzMCATrRitnbrIZf","bc_type":"c" }' > 2022秋冬新款短款卫衣女欧美街头宽松套头运动健身半拉链翻领上衣</a> <div class="attribute"> <div class="cprice-area"><span class="symbol">¥</span><span class="c-price">69.00</span></div> <div class="sprice-area"><span class="symbol">¥</span><span class="s-price">155.00 </span></div> <!--rsdata.showSaleData: true--> <div class="sale-area">已售：<span class="sale-num">76</span>件</div> </div> </dd> </dl> </div> <div class="pagination"> <a class="disable">上一页</a> <a class="page-cur">1</a> <a class="J_SearchAsync" href="//shop103889497.taobao.com/search.htm?input_charset=gbk&mid=w-23677803207-0&wid=23677803207&path=%2Fsearch.htm&search=y&searcy_type=item&s_from=newHeader&ssid=s5-e&keyword=%E6%BD%AE%E6%B5%81%E5%A5%B3%E8%A3%85%E7%BE%BD%E7%BB%92%E6%9C%3F&pageNo=2#anchor">2</a> <a class="J_SearchAsync" href="//shop103889497.taobao.com/search.htm?input_charset=gbk&mid=w-23677803207-0&wid=23677803207&path=%2Fsearch.htm&search=y&searcy_type=item&s_from=newHeader&ssid=s5-e&keyword=%E6%BD%AE%E6%B5%81%E5%A5%B3%E8%A3%85%E7%BE%BD%E7%BB%92%E6%9C%3F&pageNo=3#anchor">3</a> <a class="J_SearchAsync next" href="//shop103889497.taobao.com/search.htm?input_charset=gbk&mid=w-23677803207-0&wid=23677803207&path=%2Fsearch.htm&search=y&searcy_type=item&s_from=newHeader&ssid=s5-e&keyword=%E6%BD%AE%E6%B5%81%E5%A5%B3%E8%A3%85%E7%BE%BD%E7%BB%92%E6%9C%3F&pageNo=2#anchor">下一页</a> <form action="//shop103889497.taobao.com/search.htm" method="get"> <input type="hidden" name="input_charset" value="gbk"> <input type="hidden" name="mid" value="w-23677803207-0"> <input type="hidden" name="wid" value="23677803207"> <input type="hidden" name="path" value="%2Fsearch.htm"> <input type="hidden" name="search" value="y"> <input type="hidden" name="searcy_type" value="item"> <input type="hidden" name="s_from" value="newHeader"> <input type="hidden" name="ssid" value="s5-e"> 到第 <input type="text" value="1" size="3" name="pageNo"> 页 <button type="submit">确定</button> </form> <!--END OF pagination--> </div> </div> </div>
解决方法：在脚本最上方添加
coding=utf-8即可
2.报错：TypeError: 'bool' object is not iterable
使用jsonpath提取数据的时候出的问题，报错显示
TypeError: 'bool' object is not iterable
提取的数据数据样式如下：
提取的代码如下：
shop_url = jsonpath(shop_data,"$..shoplist.data.shopItems.shopUrl") print("店铺的url信息：",shop_url)
shop_auctions = jsonpath(shop_data,"$..shoplist.data.shopItems.auctionsInshop") print("店铺的热销榜的数据：",shop_auctions) 后面发现shopItems是个列表，所有使用jsonpath提取出列表以后再对列表进行遍历即可
