Task8、项目实战 -某知名弹幕网站

304 阅读1小时+

Task8、项目实战 -某知名弹幕网站

8.1、确定目标网站和需求

8.2、分析页面,获取对应数据包

8.3、核对数据包的数据

8.4、工具辅助我们准确获取参数的对应数据

复制好我们要的内容后,打开Json解析工具页面 www.json.cn/# ,如下

8.5、确定数据包链接参数含义

通过上述步骤,我们可以获得链接: api.bilibili.com/x/web-inter…

通过数据包展示的数据,我们可以看到,在list下总共有20个视频信息,如下图所示

那么该目标页面展示的数据远远不止20个,但由于该页面是Ajax加载的,所以我们持续往下翻滚页面的时候,配合调试页面,可以观察到链接有以下的变化

当我们翻滚页面时,我们可以发现一直有变化的其实试pn这个参数,随着1、2、3、4....的变化,我们可以确定pn代表的就是页数,而ps一直没有变化,且每个数据包都是展示20个视频信息,则可以确定ps代表的就是视频数据数量

8.6、分析结束,手撕代码

这里有个小疑问,就是我们难道每一次都要亲自去写对应链接的请求方式吗?有没有偷懒的方式呢? 当然是有的,打开该工具链接 curl.trillworks.com/ ,接下来按我的操作会有神奇简便快速的效果

将复制的内容复制到 curl.trillworks.com/ 的左框内,可以看到右框的转换

这个时候将右框生成的代码复制下来

import requests

headers = {
    'authority': 'api.bilibili.com',
    'sec-ch-ua': '"Google Chrome";v="93", " Not;A Brand";v="99", "Chromium";v="93"',
    'sec-ch-ua-mobile': '?0',
    'user-agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/93.0.4577.63 Safari/537.36',
    'sec-ch-ua-platform': '"Windows"',
    'accept': '*/*',
    'origin': 'https://www.bilibili.com',
    'sec-fetch-site': 'same-site',
    'sec-fetch-mode': 'cors',
    'sec-fetch-dest': 'empty',
    'referer': 'https://www.bilibili.com/',
    'accept-language': 'zh-CN,zh;q=0.9',
    'cookie': '_uuid=2E7C0255-A2C9-61E6-FE71-6F0A139E068457593infoc; blackside_state=1; rpdid=|(u))lklk)mm0J\'uYk~muk|Ym; SESSDATA=cf38f4f4%2C1643464099%2C9b221%2A81; bili_jct=2e758c3d77523db21486280f0b4b9435; DedeUserID=27912419; DedeUserID__ckMd5=9e75a98514221fcc; sid=6cjnti2r; CURRENT_BLACKGAP=1; buvid3=493A764F-40D7-454E-AC6D-F1339D0B7926148798infoc; LIVE_BUVID=AUTO1316304182076881; buvid_fp=493A764F-40D7-454E-AC6D-F1339D0B7926148798infoc; fingerprint=5d7e917597f8f08dbc1374e9c64052ab; buvid_fp_plain=493A764F-40D7-454E-AC6D-F1339D0B7926148798infoc; CURRENT_QUALITY=80; CURRENT_FNVAL=976; bp_t_offset_27912419=582420740989726215; PVID=2; bp_video_offset_27912419=582467216824846921; bfe_id=6f285c892d9d3c1f8f020adad8bed553; innersign=0',
}

params = (
    ('ps', '20'),
    ('pn', '1'),
)

response = requests.get('https://api.bilibili.com/x/web-interface/popular', headers=headers, params=params)

#NB. Original query string below. It seems impossible to parse and
#reproduce query strings 100% accurately so the one below is given
#in case the reproduced version is not "correct".
# response = requests.get('https://api.bilibili.com/x/web-interface/popular?ps=20&pn=1', headers=headers)

上面的代码就是原封不动复制下来,无论是get请求还是post请求,包括对应的参数都会自动便捷的帮我们生成

我们可以同text方式打印出我们要的数据,数据如下

print(response.text)  
{"code":0,"message":"0","ttl":1,"data":{"list":[{"aid":891055102,"videos":1,"tid":27,"tname":"综合","copyright":1,"pic":"http://i1.hdslb.com/bfs/archive/15a717ddb259f2369928fcd94543d7925a2ffcca.jpg","title":"“完 全 一 致”","pubdate":1634356817,"ctime":1634356861,"desc":"BGM:《命运战士》——陈致逸(铠甲勇士主题曲)\n素材:\n《偷懒的猫》《汤姆猫演唱会》\n《太阳系的猫叫声》《强力牛乳》\n《杰瑞的远亲》《秃鹰变奏曲》\n《耶诞夜》《天上普斯》\n《老鼠罐头工厂》《幽灵又出现》\n《西部牛仔》《猎鸭记》\n《房间里的老鼠》《猫儿钓鱼记》\n《保镖》《三只小猫》\n《饥饿的老鼠》《会飞的巫婆》\n《飞行猫》《午睡纠纷》\n《父子烤肉野餐》《笼中鸟》\n《国王的侍卫》《猫变老鼠》\n《请保持安静》《有恩必报》\n《小鬼难缠》《狗屋》\n《浪漫小夜曲》《又香又干净的乖儿子》\n《可爱的猫女孩》《鼠来晚餐》","state":0,"duration":129,"mission_id":169108,"rights":{"bp":0,"elec":0,"download":0,"movie":0,"pay":0,"hd5":0,"no_reprint":1,"autoplay":1,"ugc_pay":0,"is_cooperation":0,"ugc_pay_preview":0,"no_background":0},"owner":{"mid":130130236,"name":"枫泽雨畔","face":"http://i1.hdslb.com/bfs/face/8b475425171ce60abc3fadee80439f21f83bc0b8.jpg"},"stat":{"aid":891055102,"view":332874,"danmaku":406,"reply":379,"favorite":4969,"coin":4963,"share":1308,"now_rank":0,"his_rank":0,"like":23116,"dislike":0},"dynamic":"","cid":425812534,"dimension":{"width":1920,"height":1080,"rotate":0},"short_link":"https://b23.tv/BV1pP4y1t7RX","short_link_v2":"https://b23.tv/BV1pP4y1t7RX","first_frame":"http://i1.hdslb.com/bfs/storyff/n211016a21vn9rojqv6lzh22bvgmv9p3_firsti.jpg","bvid":"BV1pP4y1t7RX","season_type":0,"is_ogv":false,"ogv_info":null,"rcmd_reason":{"content":"","corner_mark":0}},{"aid":506035906,"videos":1,"tid":138,"tname":"搞笑","copyright":1,"pic":"http://i1.hdslb.com/bfs/archive/75da889565354d4f5cfd07fa8ff56bbf2ab2c544.jpg","title":"太夸张了!!随机挑战居然把王嘉尔请到了我家!!","pubdate":1634355939,"ctime":1634355625,"desc":"点赞过50w 我们继续做下一期!!绝对不鸽!!\n想看到谁也可以在评论区打出他的名字我们尽力!!\n这个世界太魔幻了 大家太牛了!!\n第一期:BV1hv41137iA\n喜欢的话请点赞\n喜欢的话请点赞\n喜欢的话请点赞\n喜欢的话请点赞","state":0,"duration":1551,"mission_id":151946,"rights":{"bp":0,"elec":0,"download":0,"movie":0,"pay":0,"hd5":1,"no_reprint":1,"autoplay":1,"ugc_pay":0,"is_cooperation":1,"ugc_pay_preview":0,"no_background":0},"owner":{"mid":7552204,"name":"啊吗粽","face":"http://i1.hdslb.com/bfs/face/90d81ca398508963069f1918df0ff37b3e3b22d2.jpg"},"stat":{"aid":506035906,"view":5627683,"danmaku":67325,"reply":26202,"favorite":154049,"coin":554052,"share":82310,"now_rank":0,"his_rank":1,"like":1013138,"dislike":0},"dynamic":"太夸张了!!!","cid":425901536,"dimension":{"width":1920,"height":1080,"rotate":0},"short_link":"https://b23.tv/BV1xu411Z7gc","short_link_v2":"https://b23.tv/BV1xu411Z7gc","first_frame":"http://i2.hdslb.com/bfs/storyff/n211016qn5wamiwfsi81a24slp2n76cm_firsti.jpg","bvid":"BV1xu411Z7gc","season_type":0,"is_ogv":false,"ogv_info":null,"rcmd_reason":{"content":"百万播放","corner_mark":0}},{"aid":421056643,"videos":1,"tid":182,"tname":"影视杂谈","copyright":1,"pic":"http://i2.hdslb.com/bfs/archive/cf3204a9355230a641a8f553f4a39edaca0298a6.jpg","title":"【啊粥】人民的名义:李达康如何反杀汉大帮?","pubdate":1634322190,"ctime":1634322190,"desc":"李达康如何反杀汉大帮","state":0,"duration":1917,"mission_id":134472,"rights":{"bp":0,"elec":0,"download":0,"movie":0,"pay":0,"hd5":0,"no_reprint":1,"autoplay":1,"ugc_pay":0,"is_cooperation":0,"ugc_pay_preview":0,"no_background":0},"owner":{"mid":8096990,"name":"啊粥粥啊粥","face":"http://i2.hdslb.com/bfs/face/b0be1ad0a4c1040266f83c7c9a863611de636fb9.jpg"},"stat":{"aid":421056643,"view":663957,"danmaku":8219,"reply":2215,"favorite":10030,"coin":42547,"share":1814,"now_rank":0,"his_rank":91,"like":48736,"dislike":0},"dynamic":"","cid":425752187,"dimension":{"width":1920,"height":1080,"rotate":0},"short_link":"https://b23.tv/BV1n3411C7gP","short_link_v2":"https://b23.tv/BV1n3411C7gP","first_frame":"http://i0.hdslb.com/bfs/storyff/n211016a2rk9882mdn73nyursmh5rt3q_firsti.jpg","bvid":"BV1n3411C7gP","season_type":0,"is_ogv":false,"ogv_info":null,"rcmd_reason":{"content":"影视杂谈·人气飙升","corner_mark":1}},{"aid":251103305,"videos":1,"tid":201,"tname":"科学科普","copyright":1,"pic":"http://i2.hdslb.com/bfs/archive/25ba1ebbc492faa9dc2b7bf3aa2631b7ac037cda.jpg","title":"高能预警!快放1000倍,带你看受精卵分裂全过程","pubdate":1634386010,"ctime":1634386010,"desc":"拍过闪电,也拍过魔术,这次我们把相机对准了生命的起源——受精卵。\n感谢Eason提供的场地,才能把这么神奇的一个过程分享给屏幕前的你们!\n如果你喜欢本期视频,记得给我们一键三连!三连!","state":0,"duration":1006,"mission_id":166436,"rights":{"bp":0,"elec":0,"download":0,"movie":0,"pay":0,"hd5":0,"no_reprint":1,"autoplay":1,"ugc_pay":0,"is_cooperation":0,"ugc_pay_preview":0,"no_background":0},"owner":{"mid":407054668,"name":"亿点点不一样","face":"http://i1.hdslb.com/bfs/face/9a2c23800387d9c871f3b5dd3620dc1c3c50d2f9.jpg"},"stat":{"aid":251103305,"view":1181628,"danmaku":8744,"reply":1653,"favorite":73260,"coin":241861,"share":10945,"now_rank":0,"his_rank":6,"like":214418,"dislike":0},"dynamic":"又去整活了!","cid":426137903,"dimension":{"width":3840,"height":1920,"rotate":0},"short_link":"https://b23.tv/BV1Ev411375K","short_link_v2":"https://b23.tv/BV1Ev411375K","first_frame":"http://i2.hdslb.com/bfs/storyff/n211016a21bje9h0os2262h9z72z3i1o_firsti.jpg","bvid":"BV1Ev411375K","season_type":0,"is_ogv":false,"ogv_info":null,"rcmd_reason":{"content":"百万播放","corner_mark":1}},{"aid":848646785,"videos":1,"tid":159,"tname":"时尚潮流","copyright":1,"pic":"http://i2.hdslb.com/bfs/archive/94a4a2f068ac6d590b5c6dba297da9ccb43cd5a8.jpg","title":"“他们不像是走秀,倒像是来赴宴的......”| 前方高能·国风盛典混剪","pubdate":1634394777,"ctime":1634394777,"desc":"bgm:象王行(特别版)- 关大洲\n素材:2021国风大典国韵大秀","state":0,"duration":177,"mission_id":166887,"rights":{"bp":0,"elec":0,"download":0,"movie":0,"pay":0,"hd5":0,"no_reprint":1,"autoplay":1,"ugc_pay":0,"is_cooperation":0,"ugc_pay_preview":0,"no_background":0},"owner":{"mid":11860785,"name":"w花酒不是花洒_","face":"http://i0.hdslb.com/bfs/face/f07dfc2368c3df24ecc7c73ef0a5055654f50459.jpg"},"stat":{"aid":848646785,"view":271845,"danmaku":770,"reply":871,"favorite":12961,"coin":7016,"share":2239,"now_rank":0,"his_rank":0,"like":29333,"dislike":0},"dynamic":"","cid":426227287,"dimension":{"width":1920,"height":1080,"rotate":0},"short_link":"https://b23.tv/BV1EL4y1B7Gw","short_link_v2":"https://b23.tv/BV1EL4y1B7Gw","first_frame":"http://i0.hdslb.com/bfs/storyff/n211016a22ykf0m1x3poln11qqevg11e_firsti.jpg","bvid":"BV1EL4y1B7Gw","season_type":0,"is_ogv":false,"ogv_info":null,"rcmd_reason":{"content":"","corner_mark":1}},{"aid":336023684,"videos":1,"tid":205,"tname":"社会","copyright":1,"pic":"http://i2.hdslb.com/bfs/archive/b0ba215cc7e5199f83c3b112cc8599b7592b4d3b.jpg","title":"男孩误以为自己中毒,于是从国家到妈妈,事无巨细说“遗言”","pubdate":1634288167,"ctime":1634288168,"desc":"10月14日,上海一位妈妈分享视频。孩子误食水彩颜料以为自己中毒,从国家到妈妈,事无巨细说“遗言”,悲痛大哭:我还那么年轻!","state":0,"duration":38,"mission_id":178497,"rights":{"bp":0,"elec":0,"download":0,"movie":0,"pay":0,"hd5":1,"no_reprint":1,"autoplay":1,"ugc_pay":0,"is_cooperation":0,"ugc_pay_preview":0,"no_background":0},"owner":{"mid":487614876,"name":"四川观察","face":"http://i0.hdslb.com/bfs/face/4ff9d5780bcb995290e316d1b9439c95cf43f938.jpg"},"stat":{"aid":336023684,"view":987630,"danmaku":1143,"reply":2102,"favorite":9215,"coin":2855,"share":13539,"now_rank":0,"his_rank":0,"like":64052,"dislike":0},"dynamic":"","cid":425470798,"dimension":{"width":1920,"height":1080,"rotate":0},"short_link":"https://b23.tv/BV17R4y1H7FA","short_link_v2":"https://b23.tv/BV17R4y1H7FA","up_from_v2":9,"first_frame":"http://i1.hdslb.com/bfs/storyff/n211015a24dspcwrlmkcw29gfl7rrta5_firsti.jpg","bvid":"BV17R4y1H7FA","season_type":0,"is_ogv":false,"ogv_info":null,"rcmd_reason":{"content":"6万点赞","corner_mark":1}},{"aid":763701838,"videos":1,"tid":213,"tname":"美食测评","copyright":1,"pic":"http://i0.hdslb.com/bfs/archive/51ecfa332e359ec65bfc2db3d4dcf9afe17559b5.jpg","title":"芬兰邻居姐姐挑战做爆汁生煎包,第一次吃包子的他们香到舔手指!!","pubdate":1634443218,"ctime":1634421132,"desc":"我的芬兰好邻居第一次和大家见面\n请大家多多关照啊!\n第一次挑战就是做包子,邻居姐姐兴致很高\n还让我以后多教他做其他的中国美食\n大家有推荐的可以一起做的美食吗?\n\n*本视频是由【吉列小云刀】赞助,感谢品牌爸爸","state":0,"duration":1117,"mission_id":149948,"rights":{"bp":0,"elec":0,"download":0,"movie":0,"pay":0,"hd5":0,"no_reprint":1,"autoplay":1,"ugc_pay":0,"is_cooperation":0,"ugc_pay_preview":0,"no_background":0},"owner":{"mid":323024456,"name":"雨琪在芬兰","face":"http://i2.hdslb.com/bfs/face/59f832f5fdb0a01391339ce842e4dae00c2f504a.jpg"},"stat":{"aid":763701838,"view":114452,"danmaku":2103,"reply":674,"favorite":913,"coin":5548,"share":64,"now_rank":0,"his_rank":0,"like":16677,"dislike":0},"dynamic":"我的芬兰好邻居第一次和大家见面\n第一次挑战就是做包子,邻居姐姐兴致很高,反应好玩极了\n她还让我以后多教他做其他的中国美食,大家有推荐的吗?","cid":426351044,"dimension":{"width":1920,"height":1080,"rotate":0},"short_link":"https://b23.tv/BV1Ur4y1y72U","short_link_v2":"https://b23.tv/BV1Ur4y1y72U","first_frame":"http://i0.hdslb.com/bfs/storyff/n211017ko3pgu3yk29nia2g2xhspj8wb_firsti.jpg","bvid":"BV1Ur4y1y72U","season_type":0,"is_ogv":false,"ogv_info":null,"rcmd_reason":{"content":"美食测评·人气飙升","corner_mark":1}},{"aid":378575215,"videos":1,"tid":85,"tname":"短片","copyright":1,"pic":"http://i2.hdslb.com/bfs/archive/c6a25f4705f91a5cf3c98b77086fb3e09a2e3ea6.jpg","title":"我不高","pubdate":1634029210,"ctime":1634029215,"desc":"多高,还是有可能不够高。\n\n故事 / 编剧:林沛儒 Link\n动画 / 配音:林沛儒 Link\n\n配乐:林沛儒 Link\n\n原声带 (+ 一首)\nhttps://music.163.com/#/album?id=134598491\n\n我的网易云\nhttps://music.163.com/#/artist?id=48423624\n\n@LinkMusicNow\n\nwww.LinkMusicNow.com","state":0,"duration":426,"mission_id":143124,"rights":{"bp":0,"elec":0,"download":0,"movie":0,"pay":0,"hd5":0,"no_reprint":1,"autoplay":1,"ugc_pay":0,"is_cooperation":0,"ugc_pay_preview":0,"no_background":0},"owner":{"mid":511365691,"name":"LinkMusicNow","face":"http://i1.hdslb.com/bfs/face/19820d9ab5ed0ac9772260113d70430dc3706b23.jpg"},"stat":{"aid":378575215,"view":1454856,"danmaku":3326,"reply":1826,"favorite":66516,"coin":85219,"share":15404,"now_rank":0,"his_rank":15,"like":146091,"dislike":0},"dynamic":"","cid":423322238,"dimension":{"width":2720,"height":1530,"rotate":0},"short_link":"https://b23.tv/BV1Gf4y1g7b1","short_link_v2":"https://b23.tv/BV1Gf4y1g7b1","first_frame":"http://i1.hdslb.com/bfs/storyff/n211011qn38qlwautgmuq4193akuxxu4_firsti.jpg","bvid":"BV1Gf4y1g7b1","season_type":0,"is_ogv":false,"ogv_info":null,"rcmd_reason":{"content":"百万播放","corner_mark":1}},{"aid":421052911,"videos":1,"tid":205,"tname":"社会","copyright":1,"pic":"http://i1.hdslb.com/bfs/archive/24ea1a3b0a33af72b575fa7933465ef861dd7bc0.jpg","title":"92岁抗美援朝老兵,拨通了报警电话……","pubdate":1634292009,"ctime":1634292040,"desc":"9月13日,92岁的抗美援朝老兵拨通了福建厦门110报警电话,民警问后得知,老人是要找到一个叫做“倩倩”的女警,向她说声谢谢。(厦门公安)","state":0,"duration":127,"rights":{"bp":0,"elec":0,"download":0,"movie":0,"pay":0,"hd5":1,"no_reprint":1,"autoplay":1,"ugc_pay":0,"is_cooperation":0,"ugc_pay_preview":0,"no_background":0},"owner":{"mid":472807480,"name":"中国长安网","face":"http://i1.hdslb.com/bfs/face/b079f36574d3eddcdff567d6e76c7900d19596f0.jpg"},"stat":{"aid":421052911,"view":490058,"danmaku":471,"reply":798,"favorite":4858,"coin":6810,"share":460,"now_rank":0,"his_rank":0,"like":59138,"dislike":0},"dynamic":"9月13日,92岁的抗美援朝老兵拨通了福建厦门110报警电话,民警问后得知,老人是要找到一个叫做“倩倩”的女警,向她说声谢谢。","cid":425340813,"dimension":{"width":1920,"height":1080,"rotate":0},"short_link":"https://b23.tv/BV1J3411C7c5","short_link_v2":"https://b23.tv/BV1J3411C7c5","first_frame":"http://i2.hdslb.com/bfs/storyff/n211015qn7hx5j71l13du5ovo4zc7ptz_firsti.jpg","bvid":"BV1J3411C7c5","season_type":0,"is_ogv":false,"ogv_info":null,"rcmd_reason":{"content":"5万点赞","corner_mark":1}},{"aid":676179854,"videos":1,"tid":27,"tname":"综合","copyright":1,"pic":"http://i2.hdslb.com/bfs/archive/70b492c68de9e5464a7a575b0c007782eaadb7c5.jpg","title":"火力少女王唐可可","pubdate":1634410824,"ctime":1634410824,"desc":"我再也不要做任何涉及特效的片子了。","state":0,"duration":84,"rights":{"bp":0,"elec":0,"download":0,"movie":0,"pay":0,"hd5":1,"no_reprint":1,"autoplay":1,"ugc_pay":0,"is_cooperation":0,"ugc_pay_preview":0,"no_background":0},"owner":{"mid":3051837,"name":"星无","face":"http://i0.hdslb.com/bfs/face/8f95bf1ba5ddf1ce9f6f07b5c746f0ca33c94eef.jpg"},"stat":{"aid":676179854,"view":248031,"danmaku":314,"reply":751,"favorite":4977,"coin":8710,"share":3210,"now_rank":0,"his_rank":0,"like":20894,"dislike":0},"dynamic":"","cid":426342287,"dimension":{"width":1920,"height":1080,"rotate":0},"short_link":"https://b23.tv/BV1yU4y1F7Ho","short_link_v2":"https://b23.tv/BV1yU4y1F7Ho","first_frame":"http://i0.hdslb.com/bfs/storyff/n211017a22s7k2gnnqklfv1pqq7awrcr_firsti.jpg","bvid":"BV1yU4y1F7Ho","season_type":0,"is_ogv":false,"ogv_info":null,"rcmd_reason":{"content":"","corner_mark":1}},{"aid":891124339,"videos":1,"tid":138,"tname":"搞笑","copyright":1,"pic":"http://i0.hdslb.com/bfs/archive/eb5c0242d21509f3efabb2f4c7dbe5894a2fd24d.jpg","title":"警长:遇见这样的直接开枪吧","pubdate":1634363129,"ctime":1634363129,"desc":"微博@逗比的雀大巢 呜呜呜 求关注求三连!!!求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连","state":0,"duration":287,"mission_id":151947,"rights":{"bp":0,"elec":0,"download":0,"movie":0,"pay":0,"hd5":1,"no_reprint":1,"autoplay":1,"ugc_pay":0,"is_cooperation":0,"ugc_pay_preview":0,"no_background":0},"owner":{"mid":5294454,"name":"逗比的雀巢","face":"http://i0.hdslb.com/bfs/face/e56d8c14d3b74b4e32fbaf2ac4af119328c56c93.jpg"},"stat":{"aid":891124339,"view":2374380,"danmaku":4971,"reply":4227,"favorite":51168,"coin":140598,"share":10045,"now_rank":0,"his_rank":3,"like":330153,"dislike":0},"dynamic":"这期视频好玩的东西都在后面\n求三连啊 求三连!","cid":425930382,"dimension":{"width":1920,"height":1080,"rotate":0},"short_link":"https://b23.tv/BV1yP4y1t7vj","short_link_v2":"https://b23.tv/BV1yP4y1t7vj","first_frame":"http://i0.hdslb.com/bfs/storyff/n211016a2hrw4fp06bw3726kzgo3yebf_firsti.jpg","bvid":"BV1yP4y1t7vj","season_type":0,"is_ogv":false,"ogv_info":null,"rcmd_reason":{"content":"百万播放","corner_mark":1}},{"aid":506044642,"videos":1,"tid":47,"tname":"短片·手书·配音","copyright":1,"pic":"http://i2.hdslb.com/bfs/archive/63ce2397b789a8ea0afa43a75b7274517ac4659b.jpg","title":"听君一席话,全是废话 2.0 !!!","pubdate":1634355011,"ctime":1634305215,"desc":"谁能告诉我\n所以姐夫的姐夫到底应该叫什么?!","state":0,"duration":154,"mission_id":169109,"rights":{"bp":0,"elec":0,"download":0,"movie":0,"pay":0,"hd5":1,"no_reprint":1,"autoplay":1,"ugc_pay":0,"is_cooperation":0,"ugc_pay_preview":0,"no_background":0},"owner":{"mid":90361813,"name":"三十六贱笑","face":"http://i1.hdslb.com/bfs/face/f6e06b72259561746f1ff0d92d91c18fb1f5d48f.jpg"},"stat":{"aid":506044642,"view":988896,"danmaku":15946,"reply":1310,"favorite":28214,"coin":74560,"share":6398,"now_rank":0,"his_rank":17,"like":130112,"dislike":0},"dynamic":"好久不见!!本期无广~~\n奇葩问题版套娃,听君一席话全是废话·2.0来啦[打call]\n不要忘记三连哟!!\n最近拍了很多有趣的视频(多多三连明天给大家cos个伏地魔[doge])\n所以耽搁了一下下更新~~~接下来就回复正常啦!\n所以说姐夫的姐夫到底应该叫什么?!\n\n#搞笑##配音##动画##搞笑视频##校园小子##搞笑配音##沙雕##高能##脑洞#","cid":425610298,"dimension":{"width":1920,"height":1080,"rotate":0},"short_link":"https://b23.tv/BV16u411Z7Ja","short_link_v2":"https://b23.tv/BV16u411Z7Ja","first_frame":"http://i2.hdslb.com/bfs/storyff/n211015a23co18ecq254vo2osaa8x68j_firsti.jpg","bvid":"BV16u411Z7Ja","season_type":0,"is_ogv":false,"ogv_info":null,"rcmd_reason":{"content":"12万点赞","corner_mark":1}},{"aid":633687415,"videos":1,"tid":76,"tname":"美食制作","copyright":1,"pic":"http://i2.hdslb.com/bfs/archive/f39f2a5f08b1b5bfe2c4de1368933015e36ec25c.jpg","title":"家庭版芦荟汁教程来了!最后结尾亮了!","pubdate":1634444127,"ctime":1634444127,"desc":"-","state":0,"duration":549,"rights":{"bp":0,"elec":0,"download":0,"movie":0,"pay":0,"hd5":0,"no_reprint":1,"autoplay":1,"ugc_pay":0,"is_cooperation":0,"ugc_pay_preview":0,"no_background":0},"owner":{"mid":533459953,"name":"刘庸干净又卫生","face":"http://i1.hdslb.com/bfs/face/3001915989cb5b9dd859899d5b992e56a6423217.jpg"},"stat":{"aid":633687415,"view":708176,"danmaku":10211,"reply":4398,"favorite":2979,"coin":17570,"share":3914,"now_rank":0,"his_rank":0,"like":66801,"dislike":0},"dynamic":"","cid":426451703,"dimension":{"width":1920,"height":1080,"rotate":0},"short_link":"https://b23.tv/BV17b4y1h7wP","short_link_v2":"https://b23.tv/BV17b4y1h7wP","up_from_v2":9,"first_frame":"http://i2.hdslb.com/bfs/storyff/n211017a22dezu56kt4tai2ljqzq75x7_firsti.jpg","bvid":"BV17b4y1h7wP","season_type":0,"is_ogv":false,"ogv_info":null,"rcmd_reason":{"content":"6万点赞","corner_mark":1}},{"aid":806086303,"videos":1,"tid":171,"tname":"电子竞技","copyright":1,"pic":"http://i1.hdslb.com/bfs/archive/8c66b9a80c084163e8daf4a313b8960ab29be304.jpg","title":"两位数!要杀他两位数!","pubdate":1634311498,"ctime":1634311498,"desc":"两位数!一定要抓他两位数!!!","state":0,"duration":504,"mission_id":166574,"rights":{"bp":0,"elec":0,"download":0,"movie":0,"pay":0,"hd5":1,"no_reprint":1,"autoplay":1,"ugc_pay":0,"is_cooperation":0,"ugc_pay_preview":0,"no_background":0},"owner":{"mid":10901294,"name":"怪盗配音","face":"http://i2.hdslb.com/bfs/face/65a4c39cd024d3405554a5af6215a1f59ced0fde.jpg"},"stat":{"aid":806086303,"view":1551540,"danmaku":2960,"reply":2005,"favorite":22236,"coin":66711,"share":28732,"now_rank":0,"his_rank":22,"like":113897,"dislike":0},"dynamic":"两位数!一定要抓他两位数!!!","cid":426138960,"dimension":{"width":1920,"height":960,"rotate":0},"short_link":"https://b23.tv/BV1t34y1S7ZZ","short_link_v2":"https://b23.tv/BV1t34y1S7ZZ","first_frame":"http://i0.hdslb.com/bfs/storyff/n211016a2d8dni8f6d3uf24ahjkw5y4i_firsti.jpg","bvid":"BV1t34y1S7ZZ","season_type":0,"is_ogv":false,"ogv_info":null,"rcmd_reason":{"content":"百万播放","corner_mark":1}},{"aid":421068588,"videos":1,"tid":29,"tname":"音乐现场","copyright":2,"pic":"http://i1.hdslb.com/bfs/archive/fd62a33f3055219875dd279c2976fe845b4761c1.jpg","title":"【4K60FPS】陈奕迅《富士山下》神级现场!你听懂了吗?","pubdate":1634378695,"ctime":1634378696,"desc":"官方演唱会现场\n自购陈奕迅《DUO》原盘提取制作,进行了调整\n其实一直以来,很多人都比较喜欢2007年的版本\n但我最近重新看了一下2010年DUO这个演唱会\n发现这个版本,更多了一些意味深长的沧桑感\n填的转载,祝大家开心","state":0,"duration":298,"rights":{"bp":0,"elec":0,"download":0,"movie":0,"pay":0,"hd5":0,"no_reprint":0,"autoplay":1,"ugc_pay":0,"is_cooperation":0,"ugc_pay_preview":0,"no_background":0},"owner":{"mid":229733301,"name":"音乐私藏馆","face":"http://i0.hdslb.com/bfs/face/91a6526445f61e2d491523242b532d5e76f0435a.jpg"},"stat":{"aid":421068588,"view":507070,"danmaku":1546,"reply":1413,"favorite":18843,"coin":13341,"share":4190,"now_rank":0,"his_rank":0,"like":50607,"dislike":0},"dynamic":"","cid":426064004,"dimension":{"width":3840,"height":2160,"rotate":0},"short_link":"https://b23.tv/BV1H3411C7ZJ","short_link_v2":"https://b23.tv/BV1H3411C7ZJ","first_frame":"http://i0.hdslb.com/bfs/storyff/n211016a220i49i0p63h7n3a49hs1y3t_firsti.jpg","bvid":"BV1H3411C7ZJ","season_type":0,"is_ogv":false,"ogv_info":null,"rcmd_reason":{"content":"5万点赞","corner_mark":1}},{"aid":548744650,"videos":1,"tid":17,"tname":"单机游戏","copyright":1,"pic":"http://i0.hdslb.com/bfs/archive/1312f1f2a5aff43cceb21d12025bed3db61984db.jpg","title":"当年火爆的恐怖游戏!用病毒改变人类基因?","pubdate":1634449950,"ctime":1634449950,"desc":"也许,与线粒体有关的故事还在继纟\n\n\n\n\n\n\n\n很长的一期视频,耗费不少时间,还请联合上期视频观看,如果喜欢这期视频的话,请给个三连支持一下!","state":0,"duration":2148,"mission_id":165570,"rights":{"bp":0,"elec":0,"download":0,"movie":0,"pay":0,"hd5":0,"no_reprint":1,"autoplay":1,"ugc_pay":0,"is_cooperation":0,"ugc_pay_preview":0,"no_background":0},"owner":{"mid":10558098,"name":"黑镖客梦回","face":"http://i0.hdslb.com/bfs/face/eea214e23f627cedaa364deccd61ba67ecd120f1.jpg"},"stat":{"aid":548744650,"view":231657,"danmaku":2832,"reply":701,"favorite":4965,"coin":8963,"share":132,"now_rank":0,"his_rank":0,"like":33526,"dislike":0},"dynamic":"很长的一期视频,耗费不少时间,还请联合上期视频观看,如果喜欢这期视频的话,请给个三连支持一下!","cid":426502715,"dimension":{"width":1920,"height":1080,"rotate":0},"short_link":"https://b23.tv/BV1tq4y1G7Ua","short_link_v2":"https://b23.tv/BV1tq4y1G7Ua","first_frame":"http://i2.hdslb.com/bfs/storyff/n211017qnwjtclylgioi4rcnlswtfdrg_firsti.jpg","bvid":"BV1tq4y1G7Ua","season_type":0,"is_ogv":false,"ogv_info":null,"rcmd_reason":{"content":"单机游戏·人气飙升","corner_mark":1}},{"aid":721116346,"videos":1,"tid":182,"tname":"影视杂谈","copyright":1,"pic":"http://i0.hdslb.com/bfs/archive/294bd1b215b5c70997bd3fc478b0c610904bc778.jpg","title":"《鱿鱼游戏》成爆款?盘点刺激好看的「大逃杀」类影视剧!【非凡情报局11】","pubdate":1634364302,"ctime":1634362606,"desc":"好久不见!今天我们顺着全球爆火的《鱿鱼游戏》\n来盘一盘那些紧张刺激的「大逃杀」类影视剧!\n\n《大逃杀》、《饥饿游戏》、《赌博默示录》……\n你看过几部?\n「我承认我有赌的成分」是什么梗?\n还有话剧迷必刷的「乌镇戏剧节」攻略!\n\n本期点赞过7万\n情报局将会在下周与大家见面!","state":0,"duration":1113,"mission_id":144563,"rights":{"bp":0,"elec":0,"download":0,"movie":0,"pay":0,"hd5":1,"no_reprint":1,"autoplay":1,"ugc_pay":0,"is_cooperation":1,"ugc_pay_preview":0,"no_background":0},"owner":{"mid":927587,"name":"木鱼水心","face":"http://i2.hdslb.com/bfs/face/e922d9dc09a2d21f1400ad0f02f75ecf1b3575c8.jpg"},"stat":{"aid":721116346,"view":641256,"danmaku":2976,"reply":2222,"favorite":7116,"coin":13352,"share":707,"now_rank":0,"his_rank":0,"like":62625,"dislike":0},"dynamic":"《鱿鱼游戏》成爆款?\n盘点刺激好看的「大逃杀」类影视剧!\n\n#非凡情报局##鱿鱼游戏##弥留之国的爱丽丝#","cid":425878396,"dimension":{"width":1920,"height":1080,"rotate":0},"short_link":"https://b23.tv/BV1PQ4y1z7kW","short_link_v2":"https://b23.tv/BV1PQ4y1z7kW","first_frame":"http://i1.hdslb.com/bfs/storyff/n211016qnx4ka4zl5wkg7qo1wpfx54gv_firsti.jpg","bvid":"BV1PQ4y1z7kW","season_type":0,"is_ogv":false,"ogv_info":null,"rcmd_reason":{"content":"6万点赞","corner_mark":1}},{"aid":633650933,"videos":1,"tid":76,"tname":"美食制作","copyright":1,"pic":"http://i0.hdslb.com/bfs/archive/1ee1106a4b61511cb9b85b3db159abdf3b55a388.jpg","title":"离谱了:600块一个麦当劳汉堡  吃起来是什么味道","pubdate":1634456301,"ctime":1634456301,"desc":"本期不含任何商业推广\n这个做起来是真的不难\n汉堡酱:\n200克蛋黄酱\n150克番茄酱\n50克黄芥末\n5克蒜粉\n一勺腌黄瓜水\n\n牛肉馅:\n牛排部位推荐上脑和西冷\n瘦肉和肥肉比例:65 :35\n每块肉饼称100-120克\n\n切达芝士(片)\n\n沙拉:\n生菜\n腌黄瓜(酸甜味)","state":0,"duration":399,"mission_id":149948,"rights":{"bp":0,"elec":0,"download":0,"movie":0,"pay":0,"hd5":0,"no_reprint":1,"autoplay":1,"ugc_pay":0,"is_cooperation":0,"ugc_pay_preview":0,"no_background":0},"owner":{"mid":473524263,"name":"澳洲阿彭","face":"http://i0.hdslb.com/bfs/face/954547cf631e4f986e5f9e3bfd65328600184b6f.jpg"},"stat":{"aid":633650933,"view":110589,"danmaku":1451,"reply":397,"favorite":2241,"coin":8462,"share":375,"now_rank":0,"his_rank":0,"like":17556,"dislike":0},"dynamic":"就是说这是史上用料最扎实的汉堡","cid":426554984,"dimension":{"width":3840,"height":2160,"rotate":0},"short_link":"https://b23.tv/BV1Lb4y1h7Dr","short_link_v2":"https://b23.tv/BV1Lb4y1h7Dr","first_frame":"http://i1.hdslb.com/bfs/storyff/n211017a21eaa2wfcspkap2atd9mw80u_firsti.jpg","bvid":"BV1Lb4y1h7Dr","season_type":0,"is_ogv":false,"ogv_info":null,"rcmd_reason":{"content":"","corner_mark":1}},{"aid":463589974,"videos":1,"tid":21,"tname":"日常","copyright":1,"pic":"http://i0.hdslb.com/bfs/archive/14c3131de99fa74efd50725b62ef3db5a5cf7d93.jpg","title":"西安体育学院新生断网后,楼梯道内以武会友代替自我介绍","pubdate":1634043100,"ctime":1634043100,"desc":"-","state":0,"duration":46,"mission_id":122904,"rights":{"bp":0,"elec":0,"download":0,"movie":0,"pay":0,"hd5":1,"no_reprint":0,"autoplay":1,"ugc_pay":0,"is_cooperation":0,"ugc_pay_preview":0,"no_background":0},"owner":{"mid":182635667,"name":"新君plus","face":"http://i2.hdslb.com/bfs/face/bb738728c6dfc90f28ecd35adac82341b2e00e32.jpg"},"stat":{"aid":463589974,"view":3566119,"danmaku":1603,"reply":4375,"favorite":26851,"coin":5163,"share":11915,"now_rank":0,"his_rank":9,"like":269533,"dislike":0},"dynamic":"","cid":424081700,"dimension":{"width":1080,"height":1920,"rotate":0},"short_link":"https://b23.tv/BV1GL411G71H","short_link_v2":"https://b23.tv/BV1GL411G71H","up_from_v2":19,"first_frame":"http://i2.hdslb.com/bfs/storyff/n211012a22kp8kwjeorolz2t9klrk9el_firsti.jpg","bvid":"BV1GL411G71H","season_type":0,"is_ogv":false,"ogv_info":null,"rcmd_reason":{"content":"百万播放","corner_mark":1}},{"aid":721095617,"videos":1,"tid":71,"tname":"综艺","copyright":2,"pic":"http://i1.hdslb.com/bfs/archive/74803d663848a8778e802d94fe234454ef392d15.jpg","title":"【一年一度喜剧大赛】互联网要素过多笑不活了  点开之前没想过这么好笑","pubdate":1634357660,"ctime":1634357660,"desc":"网络","state":0,"duration":507,"rights":{"bp":0,"elec":0,"download":0,"movie":0,"pay":0,"hd5":0,"no_reprint":0,"autoplay":1,"ugc_pay":0,"is_cooperation":0,"ugc_pay_preview":0,"no_background":0},"owner":{"mid":33994983,"name":"甜酒煮元宵","face":"http://i0.hdslb.com/bfs/face/3d4f20fd7126f7606dbab1a36a91eaff1a9392a3.jpg"},"stat":{"aid":721095617,"view":277287,"danmaku":810,"reply":510,"favorite":6745,"coin":2296,"share":15049,"now_rank":0,"his_rank":0,"like":12090,"dislike":0},"dynamic":"每一秒都感同身受  每个梗都让我想疯狂爆灯的程度","cid":425880338,"dimension":{"width":2560,"height":1440,"rotate":0},"short_link":"https://b23.tv/BV1MQ4y1z7Qd","short_link_v2":"https://b23.tv/BV1MQ4y1z7Qd","first_frame":"http://i2.hdslb.com/bfs/storyff/n211016a21agh4111uw0ib19fkxp5h3w_firsti.jpg","bvid":"BV1MQ4y1z7Qd","season_type":0,"is_ogv":false,"ogv_info":null,"rcmd_reason":{"content":"1万分享","corner_mark":1}}],"no_more":false}}

但是我们要注意的一点,我们请求下来的数据其实是json格式,这个其实很方便的结果,因为这样我们不需要用到正则表达或则xpath着类解析库去提取,直接以JSON格式去提取我们要的就可以

print(response.json())
{'code': 0, 'message': '0', 'ttl': 1, 'data': {'list': [{'aid': 891055102, 'videos': 1, 'tid': 27, 'tname': '综合', 'copyright': 1, 'pic': 'http://i1.hdslb.com/bfs/archive/15a717ddb259f2369928fcd94543d7925a2ffcca.jpg', 'title': '“完 全 一 致”', 'pubdate': 1634356817, 'ctime': 1634356861, 'desc': 'BGM:《命运战士》——陈致逸(铠甲勇士主题曲)\n素材:\n《偷懒的猫》《汤姆猫演唱会》\n《太阳系的猫叫声》《强力牛乳》\n《杰瑞的远亲》《秃鹰变奏曲》\n《耶诞夜》《天上普斯》\n《老鼠罐头工厂》《幽灵又出现》\n《西部牛仔》《猎鸭记》\n《房间里的老鼠》《猫儿钓鱼记》\n《保镖》《三只小猫》\n《饥饿的老鼠》《会飞的巫婆》\n《飞行猫》《午睡纠纷》\n《父子烤肉野餐》《笼中鸟》\n《国王的侍卫》《猫变老鼠》\n《请保持安静》《有恩必报》\n《小鬼难缠》《狗屋》\n《浪漫小夜曲》《又香又干净的乖儿子》\n《可爱的猫女孩》《鼠来晚餐》', 'state': 0, 'duration': 129, 'mission_id': 169108, 'rights': {'bp': 0, 'elec': 0, 'download': 0, 'movie': 0, 'pay': 0, 'hd5': 0, 'no_reprint': 1, 'autoplay': 1, 'ugc_pay': 0, 'is_cooperation': 0, 'ugc_pay_preview': 0, 'no_background': 0}, 'owner': {'mid': 130130236, 'name': '枫泽雨畔', 'face': 'http://i1.hdslb.com/bfs/face/8b475425171ce60abc3fadee80439f21f83bc0b8.jpg'}, 'stat': {'aid': 891055102, 'view': 332874, 'danmaku': 406, 'reply': 379, 'favorite': 4969, 'coin': 4963, 'share': 1308, 'now_rank': 0, 'his_rank': 0, 'like': 23116, 'dislike': 0}, 'dynamic': '', 'cid': 425812534, 'dimension': {'width': 1920, 'height': 1080, 'rotate': 0}, 'short_link': 'https://b23.tv/BV1pP4y1t7RX', 'short_link_v2': 'https://b23.tv/BV1pP4y1t7RX', 'first_frame': 'http://i1.hdslb.com/bfs/storyff/n211016a21vn9rojqv6lzh22bvgmv9p3_firsti.jpg', 'bvid': 'BV1pP4y1t7RX', 'season_type': 0, 'is_ogv': False, 'ogv_info': None, 'rcmd_reason': {'content': '', 'corner_mark': 0}}, {'aid': 506035906, 'videos': 1, 'tid': 138, 'tname': '搞笑', 'copyright': 1, 'pic': 'http://i1.hdslb.com/bfs/archive/75da889565354d4f5cfd07fa8ff56bbf2ab2c544.jpg', 'title': '太夸张了!!随机挑战居然把王嘉尔请到了我家!!', 'pubdate': 1634355939, 'ctime': 1634355625, 'desc': '点赞过50w 我们继续做下一期!!绝对不鸽!!\n想看到谁也可以在评论区打出他的名字我们尽力!!\n这个世界太魔幻了 大家太牛了!!\n第一期:BV1hv41137iA\n喜欢的话请点赞\n喜欢的话请点赞\n喜欢的话请点赞\n喜欢的话请点赞', 'state': 0, 'duration': 1551, 'mission_id': 151946, 'rights': {'bp': 0, 'elec': 0, 'download': 0, 'movie': 0, 'pay': 0, 'hd5': 1, 'no_reprint': 1, 'autoplay': 1, 'ugc_pay': 0, 'is_cooperation': 1, 'ugc_pay_preview': 0, 'no_background': 0}, 'owner': {'mid': 7552204, 'name': '啊吗粽', 'face': 'http://i1.hdslb.com/bfs/face/90d81ca398508963069f1918df0ff37b3e3b22d2.jpg'}, 'stat': {'aid': 506035906, 'view': 5627683, 'danmaku': 67325, 'reply': 26202, 'favorite': 154049, 'coin': 554052, 'share': 82310, 'now_rank': 0, 'his_rank': 1, 'like': 1013138, 'dislike': 0}, 'dynamic': '太夸张了!!!', 'cid': 425901536, 'dimension': {'width': 1920, 'height': 1080, 'rotate': 0}, 'short_link': 'https://b23.tv/BV1xu411Z7gc', 'short_link_v2': 'https://b23.tv/BV1xu411Z7gc', 'first_frame': 'http://i2.hdslb.com/bfs/storyff/n211016qn5wamiwfsi81a24slp2n76cm_firsti.jpg', 'bvid': 'BV1xu411Z7gc', 'season_type': 0, 'is_ogv': False, 'ogv_info': None, 'rcmd_reason': {'content': '百万播放', 'corner_mark': 0}}, {'aid': 421056643, 'videos': 1, 'tid': 182, 'tname': '影视杂谈', 'copyright': 1, 'pic': 'http://i2.hdslb.com/bfs/archive/cf3204a9355230a641a8f553f4a39edaca0298a6.jpg', 'title': '【啊粥】人民的名义:李达康如何反杀汉大帮?', 'pubdate': 1634322190, 'ctime': 1634322190, 'desc': '李达康如何反杀汉大帮', 'state': 0, 'duration': 1917, 'mission_id': 134472, 'rights': {'bp': 0, 'elec': 0, 'download': 0, 'movie': 0, 'pay': 0, 'hd5': 0, 'no_reprint': 1, 'autoplay': 1, 'ugc_pay': 0, 'is_cooperation': 0, 'ugc_pay_preview': 0, 'no_background': 0}, 'owner': {'mid': 8096990, 'name': '啊粥粥啊粥', 'face': 'http://i2.hdslb.com/bfs/face/b0be1ad0a4c1040266f83c7c9a863611de636fb9.jpg'}, 'stat': {'aid': 421056643, 'view': 663957, 'danmaku': 8219, 'reply': 2215, 'favorite': 10030, 'coin': 42547, 'share': 1814, 'now_rank': 0, 'his_rank': 91, 'like': 48736, 'dislike': 0}, 'dynamic': '', 'cid': 425752187, 'dimension': {'width': 1920, 'height': 1080, 'rotate': 0}, 'short_link': 'https://b23.tv/BV1n3411C7gP', 'short_link_v2': 'https://b23.tv/BV1n3411C7gP', 'first_frame': 'http://i0.hdslb.com/bfs/storyff/n211016a2rk9882mdn73nyursmh5rt3q_firsti.jpg', 'bvid': 'BV1n3411C7gP', 'season_type': 0, 'is_ogv': False, 'ogv_info': None, 'rcmd_reason': {'content': '影视杂谈·人气飙升', 'corner_mark': 1}}, {'aid': 251103305, 'videos': 1, 'tid': 201, 'tname': '科学科普', 'copyright': 1, 'pic': 'http://i2.hdslb.com/bfs/archive/25ba1ebbc492faa9dc2b7bf3aa2631b7ac037cda.jpg', 'title': '高能预警!快放1000倍,带你看受精卵分裂全过程', 'pubdate': 1634386010, 'ctime': 1634386010, 'desc': '拍过闪电,也拍过魔术,这次我们把相机对准了生命的起源——受精卵。\n感谢Eason提供的场地,才能把这么神奇的一个过程分享给屏幕前的你们!\n如果你喜欢本期视频,记得给我们一键三连!三连!', 'state': 0, 'duration': 1006, 'mission_id': 166436, 'rights': {'bp': 0, 'elec': 0, 'download': 0, 'movie': 0, 'pay': 0, 'hd5': 0, 'no_reprint': 1, 'autoplay': 1, 'ugc_pay': 0, 'is_cooperation': 0, 'ugc_pay_preview': 0, 'no_background': 0}, 'owner': {'mid': 407054668, 'name': '亿点点不一样', 'face': 'http://i1.hdslb.com/bfs/face/9a2c23800387d9c871f3b5dd3620dc1c3c50d2f9.jpg'}, 'stat': {'aid': 251103305, 'view': 1181628, 'danmaku': 8744, 'reply': 1653, 'favorite': 73260, 'coin': 241861, 'share': 10945, 'now_rank': 0, 'his_rank': 6, 'like': 214418, 'dislike': 0}, 'dynamic': '又去整活了!', 'cid': 426137903, 'dimension': {'width': 3840, 'height': 1920, 'rotate': 0}, 'short_link': 'https://b23.tv/BV1Ev411375K', 'short_link_v2': 'https://b23.tv/BV1Ev411375K', 'first_frame': 'http://i2.hdslb.com/bfs/storyff/n211016a21bje9h0os2262h9z72z3i1o_firsti.jpg', 'bvid': 'BV1Ev411375K', 'season_type': 0, 'is_ogv': False, 'ogv_info': None, 'rcmd_reason': {'content': '百万播放', 'corner_mark': 1}}, {'aid': 848646785, 'videos': 1, 'tid': 159, 'tname': '时尚潮流', 'copyright': 1, 'pic': 'http://i2.hdslb.com/bfs/archive/94a4a2f068ac6d590b5c6dba297da9ccb43cd5a8.jpg', 'title': '“他们不像是走秀,倒像是来赴宴的......”| 前方高能·国风盛典混剪', 'pubdate': 1634394777, 'ctime': 1634394777, 'desc': 'bgm:象王行(特别版)- 关大洲\n素材:2021国风大典国韵大秀', 'state': 0, 'duration': 177, 'mission_id': 166887, 'rights': {'bp': 0, 'elec': 0, 'download': 0, 'movie': 0, 'pay': 0, 'hd5': 0, 'no_reprint': 1, 'autoplay': 1, 'ugc_pay': 0, 'is_cooperation': 0, 'ugc_pay_preview': 0, 'no_background': 0}, 'owner': {'mid': 11860785, 'name': 'w花酒不是花洒_', 'face': 'http://i0.hdslb.com/bfs/face/f07dfc2368c3df24ecc7c73ef0a5055654f50459.jpg'}, 'stat': {'aid': 848646785, 'view': 271845, 'danmaku': 770, 'reply': 871, 'favorite': 12961, 'coin': 7016, 'share': 2239, 'now_rank': 0, 'his_rank': 0, 'like': 29333, 'dislike': 0}, 'dynamic': '', 'cid': 426227287, 'dimension': {'width': 1920, 'height': 1080, 'rotate': 0}, 'short_link': 'https://b23.tv/BV1EL4y1B7Gw', 'short_link_v2': 'https://b23.tv/BV1EL4y1B7Gw', 'first_frame': 'http://i0.hdslb.com/bfs/storyff/n211016a22ykf0m1x3poln11qqevg11e_firsti.jpg', 'bvid': 'BV1EL4y1B7Gw', 'season_type': 0, 'is_ogv': False, 'ogv_info': None, 'rcmd_reason': {'content': '', 'corner_mark': 1}}, {'aid': 336023684, 'videos': 1, 'tid': 205, 'tname': '社会', 'copyright': 1, 'pic': 'http://i2.hdslb.com/bfs/archive/b0ba215cc7e5199f83c3b112cc8599b7592b4d3b.jpg', 'title': '男孩误以为自己中毒,于是从国家到妈妈,事无巨细说“遗言”', 'pubdate': 1634288167, 'ctime': 1634288168, 'desc': '10月14日,上海一位妈妈分享视频。孩子误食水彩颜料以为自己中毒,从国家到妈妈,事无巨细说“遗言”,悲痛大哭:我还那么年轻!', 'state': 0, 'duration': 38, 'mission_id': 178497, 'rights': {'bp': 0, 'elec': 0, 'download': 0, 'movie': 0, 'pay': 0, 'hd5': 1, 'no_reprint': 1, 'autoplay': 1, 'ugc_pay': 0, 'is_cooperation': 0, 'ugc_pay_preview': 0, 'no_background': 0}, 'owner': {'mid': 487614876, 'name': '四川观察', 'face': 'http://i0.hdslb.com/bfs/face/4ff9d5780bcb995290e316d1b9439c95cf43f938.jpg'}, 'stat': {'aid': 336023684, 'view': 987630, 'danmaku': 1143, 'reply': 2102, 'favorite': 9215, 'coin': 2855, 'share': 13539, 'now_rank': 0, 'his_rank': 0, 'like': 64052, 'dislike': 0}, 'dynamic': '', 'cid': 425470798, 'dimension': {'width': 1920, 'height': 1080, 'rotate': 0}, 'short_link': 'https://b23.tv/BV17R4y1H7FA', 'short_link_v2': 'https://b23.tv/BV17R4y1H7FA', 'up_from_v2': 9, 'first_frame': 'http://i1.hdslb.com/bfs/storyff/n211015a24dspcwrlmkcw29gfl7rrta5_firsti.jpg', 'bvid': 'BV17R4y1H7FA', 'season_type': 0, 'is_ogv': False, 'ogv_info': None, 'rcmd_reason': {'content': '6万点赞', 'corner_mark': 1}}, {'aid': 763701838, 'videos': 1, 'tid': 213, 'tname': '美食测评', 'copyright': 1, 'pic': 'http://i0.hdslb.com/bfs/archive/51ecfa332e359ec65bfc2db3d4dcf9afe17559b5.jpg', 'title': '芬兰邻居姐姐挑战做爆汁生煎包,第一次吃包子的他们香到舔手指!!', 'pubdate': 1634443218, 'ctime': 1634421132, 'desc': '我的芬兰好邻居第一次和大家见面\n请大家多多关照啊!\n第一次挑战就是做包子,邻居姐姐兴致很高\n还让我以后多教他做其他的中国美食\n大家有推荐的可以一起做的美食吗?\n\n*本视频是由【吉列小云刀】赞助,感谢品牌爸爸', 'state': 0, 'duration': 1117, 'mission_id': 149948, 'rights': {'bp': 0, 'elec': 0, 'download': 0, 'movie': 0, 'pay': 0, 'hd5': 0, 'no_reprint': 1, 'autoplay': 1, 'ugc_pay': 0, 'is_cooperation': 0, 'ugc_pay_preview': 0, 'no_background': 0}, 'owner': {'mid': 323024456, 'name': '雨琪在芬兰', 'face': 'http://i2.hdslb.com/bfs/face/59f832f5fdb0a01391339ce842e4dae00c2f504a.jpg'}, 'stat': {'aid': 763701838, 'view': 114452, 'danmaku': 2103, 'reply': 674, 'favorite': 913, 'coin': 5548, 'share': 64, 'now_rank': 0, 'his_rank': 0, 'like': 16677, 'dislike': 0}, 'dynamic': '我的芬兰好邻居第一次和大家见面\n第一次挑战就是做包子,邻居姐姐兴致很高,反应好玩极了\n她还让我以后多教他做其他的中国美食,大家有推荐的吗?', 'cid': 426351044, 'dimension': {'width': 1920, 'height': 1080, 'rotate': 0}, 'short_link': 'https://b23.tv/BV1Ur4y1y72U', 'short_link_v2': 'https://b23.tv/BV1Ur4y1y72U', 'first_frame': 'http://i0.hdslb.com/bfs/storyff/n211017ko3pgu3yk29nia2g2xhspj8wb_firsti.jpg', 'bvid': 'BV1Ur4y1y72U', 'season_type': 0, 'is_ogv': False, 'ogv_info': None, 'rcmd_reason': {'content': '美食测评·人气飙升', 'corner_mark': 1}}, {'aid': 378575215, 'videos': 1, 'tid': 85, 'tname': '短片', 'copyright': 1, 'pic': 'http://i2.hdslb.com/bfs/archive/c6a25f4705f91a5cf3c98b77086fb3e09a2e3ea6.jpg', 'title': '我不高', 'pubdate': 1634029210, 'ctime': 1634029215, 'desc': '多高,还是有可能不够高。\n\n故事 / 编剧:林沛儒\xa0Link\n动画 / 配音:林沛儒 Link\n\n配乐:林沛儒 Link\n\n原声带 (+ 一首)\nhttps://music.163.com/#/album?id=134598491\n\n我的网易云\nhttps://music.163.com/#/artist?id=48423624\n\n@LinkMusicNow\n\nwww.LinkMusicNow.com', 'state': 0, 'duration': 426, 'mission_id': 143124, 'rights': {'bp': 0, 'elec': 0, 'download': 0, 'movie': 0, 'pay': 0, 'hd5': 0, 'no_reprint': 1, 'autoplay': 1, 'ugc_pay': 0, 'is_cooperation': 0, 'ugc_pay_preview': 0, 'no_background': 0}, 'owner': {'mid': 511365691, 'name': 'LinkMusicNow', 'face': 'http://i1.hdslb.com/bfs/face/19820d9ab5ed0ac9772260113d70430dc3706b23.jpg'}, 'stat': {'aid': 378575215, 'view': 1454856, 'danmaku': 3326, 'reply': 1826, 'favorite': 66516, 'coin': 85219, 'share': 15404, 'now_rank': 0, 'his_rank': 15, 'like': 146091, 'dislike': 0}, 'dynamic': '', 'cid': 423322238, 'dimension': {'width': 2720, 'height': 1530, 'rotate': 0}, 'short_link': 'https://b23.tv/BV1Gf4y1g7b1', 'short_link_v2': 'https://b23.tv/BV1Gf4y1g7b1', 'first_frame': 'http://i1.hdslb.com/bfs/storyff/n211011qn38qlwautgmuq4193akuxxu4_firsti.jpg', 'bvid': 'BV1Gf4y1g7b1', 'season_type': 0, 'is_ogv': False, 'ogv_info': None, 'rcmd_reason': {'content': '百万播放', 'corner_mark': 1}}, {'aid': 421052911, 'videos': 1, 'tid': 205, 'tname': '社会', 'copyright': 1, 'pic': 'http://i1.hdslb.com/bfs/archive/24ea1a3b0a33af72b575fa7933465ef861dd7bc0.jpg', 'title': '92岁抗美援朝老兵,拨通了报警电话……', 'pubdate': 1634292009, 'ctime': 1634292040, 'desc': '9月13日,92岁的抗美援朝老兵拨通了福建厦门110报警电话,民警问后得知,老人是要找到一个叫做“倩倩”的女警,向她说声谢谢。(厦门公安)', 'state': 0, 'duration': 127, 'rights': {'bp': 0, 'elec': 0, 'download': 0, 'movie': 0, 'pay': 0, 'hd5': 1, 'no_reprint': 1, 'autoplay': 1, 'ugc_pay': 0, 'is_cooperation': 0, 'ugc_pay_preview': 0, 'no_background': 0}, 'owner': {'mid': 472807480, 'name': '中国长安网', 'face': 'http://i1.hdslb.com/bfs/face/b079f36574d3eddcdff567d6e76c7900d19596f0.jpg'}, 'stat': {'aid': 421052911, 'view': 490058, 'danmaku': 471, 'reply': 798, 'favorite': 4858, 'coin': 6810, 'share': 460, 'now_rank': 0, 'his_rank': 0, 'like': 59138, 'dislike': 0}, 'dynamic': '9月13日,92岁的抗美援朝老兵拨通了福建厦门110报警电话,民警问后得知,老人是要找到一个叫做“倩倩”的女警,向她说声谢谢。', 'cid': 425340813, 'dimension': {'width': 1920, 'height': 1080, 'rotate': 0}, 'short_link': 'https://b23.tv/BV1J3411C7c5', 'short_link_v2': 'https://b23.tv/BV1J3411C7c5', 'first_frame': 'http://i2.hdslb.com/bfs/storyff/n211015qn7hx5j71l13du5ovo4zc7ptz_firsti.jpg', 'bvid': 'BV1J3411C7c5', 'season_type': 0, 'is_ogv': False, 'ogv_info': None, 'rcmd_reason': {'content': '5万点赞', 'corner_mark': 1}}, {'aid': 676179854, 'videos': 1, 'tid': 27, 'tname': '综合', 'copyright': 1, 'pic': 'http://i2.hdslb.com/bfs/archive/70b492c68de9e5464a7a575b0c007782eaadb7c5.jpg', 'title': '火力少女王唐可可', 'pubdate': 1634410824, 'ctime': 1634410824, 'desc': '我再也不要做任何涉及特效的片子了。', 'state': 0, 'duration': 84, 'rights': {'bp': 0, 'elec': 0, 'download': 0, 'movie': 0, 'pay': 0, 'hd5': 1, 'no_reprint': 1, 'autoplay': 1, 'ugc_pay': 0, 'is_cooperation': 0, 'ugc_pay_preview': 0, 'no_background': 0}, 'owner': {'mid': 3051837, 'name': '星无', 'face': 'http://i0.hdslb.com/bfs/face/8f95bf1ba5ddf1ce9f6f07b5c746f0ca33c94eef.jpg'}, 'stat': {'aid': 676179854, 'view': 248031, 'danmaku': 314, 'reply': 751, 'favorite': 4977, 'coin': 8710, 'share': 3210, 'now_rank': 0, 'his_rank': 0, 'like': 20894, 'dislike': 0}, 'dynamic': '', 'cid': 426342287, 'dimension': {'width': 1920, 'height': 1080, 'rotate': 0}, 'short_link': 'https://b23.tv/BV1yU4y1F7Ho', 'short_link_v2': 'https://b23.tv/BV1yU4y1F7Ho', 'first_frame': 'http://i0.hdslb.com/bfs/storyff/n211017a22s7k2gnnqklfv1pqq7awrcr_firsti.jpg', 'bvid': 'BV1yU4y1F7Ho', 'season_type': 0, 'is_ogv': False, 'ogv_info': None, 'rcmd_reason': {'content': '', 'corner_mark': 1}}, {'aid': 891124339, 'videos': 1, 'tid': 138, 'tname': '搞笑', 'copyright': 1, 'pic': 'http://i0.hdslb.com/bfs/archive/eb5c0242d21509f3efabb2f4c7dbe5894a2fd24d.jpg', 'title': '警长:遇见这样的直接开枪吧', 'pubdate': 1634363129, 'ctime': 1634363129, 'desc': '微博@逗比的雀大巢 呜呜呜 求关注求三连!!!求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连', 'state': 0, 'duration': 287, 'mission_id': 151947, 'rights': {'bp': 0, 'elec': 0, 'download': 0, 'movie': 0, 'pay': 0, 'hd5': 1, 'no_reprint': 1, 'autoplay': 1, 'ugc_pay': 0, 'is_cooperation': 0, 'ugc_pay_preview': 0, 'no_background': 0}, 'owner': {'mid': 5294454, 'name': '逗比的雀巢', 'face': 'http://i0.hdslb.com/bfs/face/e56d8c14d3b74b4e32fbaf2ac4af119328c56c93.jpg'}, 'stat': {'aid': 891124339, 'view': 2374380, 'danmaku': 4971, 'reply': 4227, 'favorite': 51168, 'coin': 140598, 'share': 10045, 'now_rank': 0, 'his_rank': 3, 'like': 330153, 'dislike': 0}, 'dynamic': '这期视频好玩的东西都在后面\n求三连啊 求三连!', 'cid': 425930382, 'dimension': {'width': 1920, 'height': 1080, 'rotate': 0}, 'short_link': 'https://b23.tv/BV1yP4y1t7vj', 'short_link_v2': 'https://b23.tv/BV1yP4y1t7vj', 'first_frame': 'http://i0.hdslb.com/bfs/storyff/n211016a2hrw4fp06bw3726kzgo3yebf_firsti.jpg', 'bvid': 'BV1yP4y1t7vj', 'season_type': 0, 'is_ogv': False, 'ogv_info': None, 'rcmd_reason': {'content': '百万播放', 'corner_mark': 1}}, {'aid': 506044642, 'videos': 1, 'tid': 47, 'tname': '短片·手书·配音', 'copyright': 1, 'pic': 'http://i2.hdslb.com/bfs/archive/63ce2397b789a8ea0afa43a75b7274517ac4659b.jpg', 'title': '听君一席话,全是废话 2.0 !!!', 'pubdate': 1634355011, 'ctime': 1634305215, 'desc': '谁能告诉我\n所以姐夫的姐夫到底应该叫什么?!', 'state': 0, 'duration': 154, 'mission_id': 169109, 'rights': {'bp': 0, 'elec': 0, 'download': 0, 'movie': 0, 'pay': 0, 'hd5': 1, 'no_reprint': 1, 'autoplay': 1, 'ugc_pay': 0, 'is_cooperation': 0, 'ugc_pay_preview': 0, 'no_background': 0}, 'owner': {'mid': 90361813, 'name': '三十六贱笑', 'face': 'http://i1.hdslb.com/bfs/face/f6e06b72259561746f1ff0d92d91c18fb1f5d48f.jpg'}, 'stat': {'aid': 506044642, 'view': 988896, 'danmaku': 15946, 'reply': 1310, 'favorite': 28214, 'coin': 74560, 'share': 6398, 'now_rank': 0, 'his_rank': 17, 'like': 130112, 'dislike': 0}, 'dynamic': '好久不见!!本期无广~~\n奇葩问题版套娃,听君一席话全是废话·2.0来啦[打call]\n不要忘记三连哟!!\n最近拍了很多有趣的视频(多多三连明天给大家cos个伏地魔[doge])\n所以耽搁了一下下更新~~~接下来就回复正常啦!\n所以说姐夫的姐夫到底应该叫什么?!\n\n#搞笑##配音##动画##搞笑视频##校园小子##搞笑配音##沙雕##高能##脑洞#', 'cid': 425610298, 'dimension': {'width': 1920, 'height': 1080, 'rotate': 0}, 'short_link': 'https://b23.tv/BV16u411Z7Ja', 'short_link_v2': 'https://b23.tv/BV16u411Z7Ja', 'first_frame': 'http://i2.hdslb.com/bfs/storyff/n211015a23co18ecq254vo2osaa8x68j_firsti.jpg', 'bvid': 'BV16u411Z7Ja', 'season_type': 0, 'is_ogv': False, 'ogv_info': None, 'rcmd_reason': {'content': '12万点赞', 'corner_mark': 1}}, {'aid': 633687415, 'videos': 1, 'tid': 76, 'tname': '美食制作', 'copyright': 1, 'pic': 'http://i2.hdslb.com/bfs/archive/f39f2a5f08b1b5bfe2c4de1368933015e36ec25c.jpg', 'title': '家庭版芦荟汁教程来了!最后结尾亮了!', 'pubdate': 1634444127, 'ctime': 1634444127, 'desc': '-', 'state': 0, 'duration': 549, 'rights': {'bp': 0, 'elec': 0, 'download': 0, 'movie': 0, 'pay': 0, 'hd5': 0, 'no_reprint': 1, 'autoplay': 1, 'ugc_pay': 0, 'is_cooperation': 0, 'ugc_pay_preview': 0, 'no_background': 0}, 'owner': {'mid': 533459953, 'name': '刘庸干净又卫生', 'face': 'http://i1.hdslb.com/bfs/face/3001915989cb5b9dd859899d5b992e56a6423217.jpg'}, 'stat': {'aid': 633687415, 'view': 708176, 'danmaku': 10211, 'reply': 4398, 'favorite': 2979, 'coin': 17570, 'share': 3914, 'now_rank': 0, 'his_rank': 0, 'like': 66801, 'dislike': 0}, 'dynamic': '', 'cid': 426451703, 'dimension': {'width': 1920, 'height': 1080, 'rotate': 0}, 'short_link': 'https://b23.tv/BV17b4y1h7wP', 'short_link_v2': 'https://b23.tv/BV17b4y1h7wP', 'up_from_v2': 9, 'first_frame': 'http://i2.hdslb.com/bfs/storyff/n211017a22dezu56kt4tai2ljqzq75x7_firsti.jpg', 'bvid': 'BV17b4y1h7wP', 'season_type': 0, 'is_ogv': False, 'ogv_info': None, 'rcmd_reason': {'content': '6万点赞', 'corner_mark': 1}}, {'aid': 806086303, 'videos': 1, 'tid': 171, 'tname': '电子竞技', 'copyright': 1, 'pic': 'http://i1.hdslb.com/bfs/archive/8c66b9a80c084163e8daf4a313b8960ab29be304.jpg', 'title': '两位数!要杀他两位数!', 'pubdate': 1634311498, 'ctime': 1634311498, 'desc': '两位数!一定要抓他两位数!!!', 'state': 0, 'duration': 504, 'mission_id': 166574, 'rights': {'bp': 0, 'elec': 0, 'download': 0, 'movie': 0, 'pay': 0, 'hd5': 1, 'no_reprint': 1, 'autoplay': 1, 'ugc_pay': 0, 'is_cooperation': 0, 'ugc_pay_preview': 0, 'no_background': 0}, 'owner': {'mid': 10901294, 'name': '怪盗配音', 'face': 'http://i2.hdslb.com/bfs/face/65a4c39cd024d3405554a5af6215a1f59ced0fde.jpg'}, 'stat': {'aid': 806086303, 'view': 1551540, 'danmaku': 2960, 'reply': 2005, 'favorite': 22236, 'coin': 66711, 'share': 28732, 'now_rank': 0, 'his_rank': 22, 'like': 113897, 'dislike': 0}, 'dynamic': '两位数!一定要抓他两位数!!!', 'cid': 426138960, 'dimension': {'width': 1920, 'height': 960, 'rotate': 0}, 'short_link': 'https://b23.tv/BV1t34y1S7ZZ', 'short_link_v2': 'https://b23.tv/BV1t34y1S7ZZ', 'first_frame': 'http://i0.hdslb.com/bfs/storyff/n211016a2d8dni8f6d3uf24ahjkw5y4i_firsti.jpg', 'bvid': 'BV1t34y1S7ZZ', 'season_type': 0, 'is_ogv': False, 'ogv_info': None, 'rcmd_reason': {'content': '百万播放', 'corner_mark': 1}}, {'aid': 421068588, 'videos': 1, 'tid': 29, 'tname': '音乐现场', 'copyright': 2, 'pic': 'http://i1.hdslb.com/bfs/archive/fd62a33f3055219875dd279c2976fe845b4761c1.jpg', 'title': '【4K60FPS】陈奕迅《富士山下》神级现场!你听懂了吗?', 'pubdate': 1634378695, 'ctime': 1634378696, 'desc': '官方演唱会现场\n自购陈奕迅《DUO》原盘提取制作,进行了调整\n其实一直以来,很多人都比较喜欢2007年的版本\n但我最近重新看了一下2010年DUO这个演唱会\n发现这个版本,更多了一些意味深长的沧桑感\n填的转载,祝大家开心', 'state': 0, 'duration': 298, 'rights': {'bp': 0, 'elec': 0, 'download': 0, 'movie': 0, 'pay': 0, 'hd5': 0, 'no_reprint': 0, 'autoplay': 1, 'ugc_pay': 0, 'is_cooperation': 0, 'ugc_pay_preview': 0, 'no_background': 0}, 'owner': {'mid': 229733301, 'name': '音乐私藏馆', 'face': 'http://i0.hdslb.com/bfs/face/91a6526445f61e2d491523242b532d5e76f0435a.jpg'}, 'stat': {'aid': 421068588, 'view': 507070, 'danmaku': 1546, 'reply': 1413, 'favorite': 18843, 'coin': 13341, 'share': 4190, 'now_rank': 0, 'his_rank': 0, 'like': 50607, 'dislike': 0}, 'dynamic': '', 'cid': 426064004, 'dimension': {'width': 3840, 'height': 2160, 'rotate': 0}, 'short_link': 'https://b23.tv/BV1H3411C7ZJ', 'short_link_v2': 'https://b23.tv/BV1H3411C7ZJ', 'first_frame': 'http://i0.hdslb.com/bfs/storyff/n211016a220i49i0p63h7n3a49hs1y3t_firsti.jpg', 'bvid': 'BV1H3411C7ZJ', 'season_type': 0, 'is_ogv': False, 'ogv_info': None, 'rcmd_reason': {'content': '5万点赞', 'corner_mark': 1}}, {'aid': 548744650, 'videos': 1, 'tid': 17, 'tname': '单机游戏', 'copyright': 1, 'pic': 'http://i0.hdslb.com/bfs/archive/1312f1f2a5aff43cceb21d12025bed3db61984db.jpg', 'title': '当年火爆的恐怖游戏!用病毒改变人类基因?', 'pubdate': 1634449950, 'ctime': 1634449950, 'desc': '也许,与线粒体有关的故事还在继纟\n\n\n\n\n\n\n\n很长的一期视频,耗费不少时间,还请联合上期视频观看,如果喜欢这期视频的话,请给个三连支持一下!', 'state': 0, 'duration': 2148, 'mission_id': 165570, 'rights': {'bp': 0, 'elec': 0, 'download': 0, 'movie': 0, 'pay': 0, 'hd5': 0, 'no_reprint': 1, 'autoplay': 1, 'ugc_pay': 0, 'is_cooperation': 0, 'ugc_pay_preview': 0, 'no_background': 0}, 'owner': {'mid': 10558098, 'name': '黑镖客梦回', 'face': 'http://i0.hdslb.com/bfs/face/eea214e23f627cedaa364deccd61ba67ecd120f1.jpg'}, 'stat': {'aid': 548744650, 'view': 231657, 'danmaku': 2832, 'reply': 701, 'favorite': 4965, 'coin': 8963, 'share': 132, 'now_rank': 0, 'his_rank': 0, 'like': 33526, 'dislike': 0}, 'dynamic': '很长的一期视频,耗费不少时间,还请联合上期视频观看,如果喜欢这期视频的话,请给个三连支持一下!', 'cid': 426502715, 'dimension': {'width': 1920, 'height': 1080, 'rotate': 0}, 'short_link': 'https://b23.tv/BV1tq4y1G7Ua', 'short_link_v2': 'https://b23.tv/BV1tq4y1G7Ua', 'first_frame': 'http://i2.hdslb.com/bfs/storyff/n211017qnwjtclylgioi4rcnlswtfdrg_firsti.jpg', 'bvid': 'BV1tq4y1G7Ua', 'season_type': 0, 'is_ogv': False, 'ogv_info': None, 'rcmd_reason': {'content': '单机游戏·人气飙升', 'corner_mark': 1}}, {'aid': 721116346, 'videos': 1, 'tid': 182, 'tname': '影视杂谈', 'copyright': 1, 'pic': 'http://i0.hdslb.com/bfs/archive/294bd1b215b5c70997bd3fc478b0c610904bc778.jpg', 'title': '《鱿鱼游戏》成爆款?盘点刺激好看的「大逃杀」类影视剧!【非凡情报局11】', 'pubdate': 1634364302, 'ctime': 1634362606, 'desc': '好久不见!今天我们顺着全球爆火的《鱿鱼游戏》\n来盘一盘那些紧张刺激的「大逃杀」类影视剧!\n\n《大逃杀》、《饥饿游戏》、《赌博默示录》……\n你看过几部?\n「我承认我有赌的成分」是什么梗?\n还有话剧迷必刷的「乌镇戏剧节」攻略!\n\n本期点赞过7万\n情报局将会在下周与大家见面!', 'state': 0, 'duration': 1113, 'mission_id': 144563, 'rights': {'bp': 0, 'elec': 0, 'download': 0, 'movie': 0, 'pay': 0, 'hd5': 1, 'no_reprint': 1, 'autoplay': 1, 'ugc_pay': 0, 'is_cooperation': 1, 'ugc_pay_preview': 0, 'no_background': 0}, 'owner': {'mid': 927587, 'name': '木鱼水心', 'face': 'http://i2.hdslb.com/bfs/face/e922d9dc09a2d21f1400ad0f02f75ecf1b3575c8.jpg'}, 'stat': {'aid': 721116346, 'view': 641256, 'danmaku': 2976, 'reply': 2222, 'favorite': 7116, 'coin': 13352, 'share': 707, 'now_rank': 0, 'his_rank': 0, 'like': 62625, 'dislike': 0}, 'dynamic': '《鱿鱼游戏》成爆款?\n盘点刺激好看的「大逃杀」类影视剧!\n\n#非凡情报局##鱿鱼游戏##弥留之国的爱丽丝#', 'cid': 425878396, 'dimension': {'width': 1920, 'height': 1080, 'rotate': 0}, 'short_link': 'https://b23.tv/BV1PQ4y1z7kW', 'short_link_v2': 'https://b23.tv/BV1PQ4y1z7kW', 'first_frame': 'http://i1.hdslb.com/bfs/storyff/n211016qnx4ka4zl5wkg7qo1wpfx54gv_firsti.jpg', 'bvid': 'BV1PQ4y1z7kW', 'season_type': 0, 'is_ogv': False, 'ogv_info': None, 'rcmd_reason': {'content': '6万点赞', 'corner_mark': 1}}, {'aid': 633650933, 'videos': 1, 'tid': 76, 'tname': '美食制作', 'copyright': 1, 'pic': 'http://i0.hdslb.com/bfs/archive/1ee1106a4b61511cb9b85b3db159abdf3b55a388.jpg', 'title': '离谱了:600块一个麦当劳汉堡  吃起来是什么味道', 'pubdate': 1634456301, 'ctime': 1634456301, 'desc': '本期不含任何商业推广\n这个做起来是真的不难\n汉堡酱:\n200克蛋黄酱\n150克番茄酱\n50克黄芥末\n5克蒜粉\n一勺腌黄瓜水\n\n牛肉馅:\n牛排部位推荐上脑和西冷\n瘦肉和肥肉比例:65 :35\n每块肉饼称100-120克\n\n切达芝士(片)\n\n沙拉:\n生菜\n腌黄瓜(酸甜味)', 'state': 0, 'duration': 399, 'mission_id': 149948, 'rights': {'bp': 0, 'elec': 0, 'download': 0, 'movie': 0, 'pay': 0, 'hd5': 0, 'no_reprint': 1, 'autoplay': 1, 'ugc_pay': 0, 'is_cooperation': 0, 'ugc_pay_preview': 0, 'no_background': 0}, 'owner': {'mid': 473524263, 'name': '澳洲阿彭', 'face': 'http://i0.hdslb.com/bfs/face/954547cf631e4f986e5f9e3bfd65328600184b6f.jpg'}, 'stat': {'aid': 633650933, 'view': 110589, 'danmaku': 1451, 'reply': 397, 'favorite': 2241, 'coin': 8462, 'share': 375, 'now_rank': 0, 'his_rank': 0, 'like': 17556, 'dislike': 0}, 'dynamic': '就是说这是史上用料最扎实的汉堡', 'cid': 426554984, 'dimension': {'width': 3840, 'height': 2160, 'rotate': 0}, 'short_link': 'https://b23.tv/BV1Lb4y1h7Dr', 'short_link_v2': 'https://b23.tv/BV1Lb4y1h7Dr', 'first_frame': 'http://i1.hdslb.com/bfs/storyff/n211017a21eaa2wfcspkap2atd9mw80u_firsti.jpg', 'bvid': 'BV1Lb4y1h7Dr', 'season_type': 0, 'is_ogv': False, 'ogv_info': None, 'rcmd_reason': {'content': '', 'corner_mark': 1}}, {'aid': 463589974, 'videos': 1, 'tid': 21, 'tname': '日常', 'copyright': 1, 'pic': 'http://i0.hdslb.com/bfs/archive/14c3131de99fa74efd50725b62ef3db5a5cf7d93.jpg', 'title': '西安体育学院新生断网后,楼梯道内以武会友代替自我介绍', 'pubdate': 1634043100, 'ctime': 1634043100, 'desc': '-', 'state': 0, 'duration': 46, 'mission_id': 122904, 'rights': {'bp': 0, 'elec': 0, 'download': 0, 'movie': 0, 'pay': 0, 'hd5': 1, 'no_reprint': 0, 'autoplay': 1, 'ugc_pay': 0, 'is_cooperation': 0, 'ugc_pay_preview': 0, 'no_background': 0}, 'owner': {'mid': 182635667, 'name': '新君plus', 'face': 'http://i2.hdslb.com/bfs/face/bb738728c6dfc90f28ecd35adac82341b2e00e32.jpg'}, 'stat': {'aid': 463589974, 'view': 3566119, 'danmaku': 1603, 'reply': 4375, 'favorite': 26851, 'coin': 5163, 'share': 11915, 'now_rank': 0, 'his_rank': 9, 'like': 269533, 'dislike': 0}, 'dynamic': '', 'cid': 424081700, 'dimension': {'width': 1080, 'height': 1920, 'rotate': 0}, 'short_link': 'https://b23.tv/BV1GL411G71H', 'short_link_v2': 'https://b23.tv/BV1GL411G71H', 'up_from_v2': 19, 'first_frame': 'http://i2.hdslb.com/bfs/storyff/n211012a22kp8kwjeorolz2t9klrk9el_firsti.jpg', 'bvid': 'BV1GL411G71H', 'season_type': 0, 'is_ogv': False, 'ogv_info': None, 'rcmd_reason': {'content': '百万播放', 'corner_mark': 1}}, {'aid': 721095617, 'videos': 1, 'tid': 71, 'tname': '综艺', 'copyright': 2, 'pic': 'http://i1.hdslb.com/bfs/archive/74803d663848a8778e802d94fe234454ef392d15.jpg', 'title': '【一年一度喜剧大赛】互联网要素过多笑不活了  点开之前没想过这么好笑', 'pubdate': 1634357660, 'ctime': 1634357660, 'desc': '网络', 'state': 0, 'duration': 507, 'rights': {'bp': 0, 'elec': 0, 'download': 0, 'movie': 0, 'pay': 0, 'hd5': 0, 'no_reprint': 0, 'autoplay': 1, 'ugc_pay': 0, 'is_cooperation': 0, 'ugc_pay_preview': 0, 'no_background': 0}, 'owner': {'mid': 33994983, 'name': '甜酒煮元宵', 'face': 'http://i0.hdslb.com/bfs/face/3d4f20fd7126f7606dbab1a36a91eaff1a9392a3.jpg'}, 'stat': {'aid': 721095617, 'view': 277287, 'danmaku': 810, 'reply': 510, 'favorite': 6745, 'coin': 2296, 'share': 15049, 'now_rank': 0, 'his_rank': 0, 'like': 12090, 'dislike': 0}, 'dynamic': '每一秒都感同身受  每个梗都让我想疯狂爆灯的程度', 'cid': 425880338, 'dimension': {'width': 2560, 'height': 1440, 'rotate': 0}, 'short_link': 'https://b23.tv/BV1MQ4y1z7Qd', 'short_link_v2': 'https://b23.tv/BV1MQ4y1z7Qd', 'first_frame': 'http://i2.hdslb.com/bfs/storyff/n211016a21agh4111uw0ib19fkxp5h3w_firsti.jpg', 'bvid': 'BV1MQ4y1z7Qd', 'season_type': 0, 'is_ogv': False, 'ogv_info': None, 'rcmd_reason': {'content': '1万分享', 'corner_mark': 1}}], 'no_more': False}}

接下来就是提取关键数据

按上图提取我们要的数据,先提取 data -> list

datas = response.json()['data']['list']
print(len(datas))
20

20 就是20条视频信息,接下来只需要遍历一下,在每个视频下获取我们要的数据既可以

每一个参数对应的意思,可以看我代码的注释就可以,如何确定这是数据的对应的意思呢?没有捷径,只有自己一一去网站上对应

results = []  # 用于追加每个视频详情数
for data in datas:
    result = {
        '标题': data['title'],
        '视频分类':data['tname'],
        'aid': data['aid'],
        'bvid': data['bvid'],
        '视频描述': data['desc'],
        '视频封面': data['pic'],
        'up主': data['owner']['name'], 
        '视频链接': data['short_link'],
        '投币数': data['stat']['coin'],
        '收藏数': data['stat']['favorite'],
        '弹幕数': data['stat']['danmaku'],
        '喜欢数': data['stat']['like'],
        '观看数': data['stat']['view'],
        '分享数': data['stat']['share'],
    }
    results.append(result)
    print(result)
{'标题': '“完 全 一 致”', '视频分类': '综合', 'aid': 891055102, 'bvid': 'BV1pP4y1t7RX', '视频描述': 'BGM:《命运战士》——陈致逸(铠甲勇士主题曲)\n素材:\n《偷懒的猫》《汤姆猫演唱会》\n《太阳系的猫叫声》《强力牛乳》\n《杰瑞的远亲》《秃鹰变奏曲》\n《耶诞夜》《天上普斯》\n《老鼠罐头工厂》《幽灵又出现》\n《西部牛仔》《猎鸭记》\n《房间里的老鼠》《猫儿钓鱼记》\n《保镖》《三只小猫》\n《饥饿的老鼠》《会飞的巫婆》\n《飞行猫》《午睡纠纷》\n《父子烤肉野餐》《笼中鸟》\n《国王的侍卫》《猫变老鼠》\n《请保持安静》《有恩必报》\n《小鬼难缠》《狗屋》\n《浪漫小夜曲》《又香又干净的乖儿子》\n《可爱的猫女孩》《鼠来晚餐》', '视频封面': 'http://i1.hdslb.com/bfs/archive/15a717ddb259f2369928fcd94543d7925a2ffcca.jpg', 'up主': '枫泽雨畔', '视频链接': 'https://b23.tv/BV1pP4y1t7RX', '投币数': 4963, '收藏数': 4969, '弹幕数': 406, '喜欢数': 23116, '观看数': 332874, '分享数': 1308}
{'标题': '太夸张了!!随机挑战居然把王嘉尔请到了我家!!', '视频分类': '搞笑', 'aid': 506035906, 'bvid': 'BV1xu411Z7gc', '视频描述': '点赞过50w 我们继续做下一期!!绝对不鸽!!\n想看到谁也可以在评论区打出他的名字我们尽力!!\n这个世界太魔幻了 大家太牛了!!\n第一期:BV1hv41137iA\n喜欢的话请点赞\n喜欢的话请点赞\n喜欢的话请点赞\n喜欢的话请点赞', '视频封面': 'http://i1.hdslb.com/bfs/archive/75da889565354d4f5cfd07fa8ff56bbf2ab2c544.jpg', 'up主': '啊吗粽', '视频链接': 'https://b23.tv/BV1xu411Z7gc', '投币数': 554052, '收藏数': 154049, '弹幕数': 67325, '喜欢数': 1013138, '观看数': 5627683, '分享数': 82310}
{'标题': '【啊粥】人民的名义:李达康如何反杀汉大帮?', '视频分类': '影视杂谈', 'aid': 421056643, 'bvid': 'BV1n3411C7gP', '视频描述': '李达康如何反杀汉大帮', '视频封面': 'http://i2.hdslb.com/bfs/archive/cf3204a9355230a641a8f553f4a39edaca0298a6.jpg', 'up主': '啊粥粥啊粥', '视频链接': 'https://b23.tv/BV1n3411C7gP', '投币数': 42547, '收藏数': 10030, '弹幕数': 8219, '喜欢数': 48736, '观看数': 663957, '分享数': 1814}
{'标题': '高能预警!快放1000倍,带你看受精卵分裂全过程', '视频分类': '科学科普', 'aid': 251103305, 'bvid': 'BV1Ev411375K', '视频描述': '拍过闪电,也拍过魔术,这次我们把相机对准了生命的起源——受精卵。\n感谢Eason提供的场地,才能把这么神奇的一个过程分享给屏幕前的你们!\n如果你喜欢本期视频,记得给我们一键三连!三连!', '视频封面': 'http://i2.hdslb.com/bfs/archive/25ba1ebbc492faa9dc2b7bf3aa2631b7ac037cda.jpg', 'up主': '亿点点不一样', '视频链接': 'https://b23.tv/BV1Ev411375K', '投币数': 241861, '收藏数': 73260, '弹幕数': 8744, '喜欢数': 214418, '观看数': 1181628, '分享数': 10945}
{'标题': '“他们不像是走秀,倒像是来赴宴的......”| 前方高能·国风盛典混剪', '视频分类': '时尚潮流', 'aid': 848646785, 'bvid': 'BV1EL4y1B7Gw', '视频描述': 'bgm:象王行(特别版)- 关大洲\n素材:2021国风大典国韵大秀', '视频封面': 'http://i2.hdslb.com/bfs/archive/94a4a2f068ac6d590b5c6dba297da9ccb43cd5a8.jpg', 'up主': 'w花酒不是花洒_', '视频链接': 'https://b23.tv/BV1EL4y1B7Gw', '投币数': 7016, '收藏数': 12961, '弹幕数': 770, '喜欢数': 29333, '观看数': 271845, '分享数': 2239}
{'标题': '男孩误以为自己中毒,于是从国家到妈妈,事无巨细说“遗言”', '视频分类': '社会', 'aid': 336023684, 'bvid': 'BV17R4y1H7FA', '视频描述': '10月14日,上海一位妈妈分享视频。孩子误食水彩颜料以为自己中毒,从国家到妈妈,事无巨细说“遗言”,悲痛大哭:我还那么年轻!', '视频封面': 'http://i2.hdslb.com/bfs/archive/b0ba215cc7e5199f83c3b112cc8599b7592b4d3b.jpg', 'up主': '四川观察', '视频链接': 'https://b23.tv/BV17R4y1H7FA', '投币数': 2855, '收藏数': 9215, '弹幕数': 1143, '喜欢数': 64052, '观看数': 987630, '分享数': 13539}
{'标题': '芬兰邻居姐姐挑战做爆汁生煎包,第一次吃包子的他们香到舔手指!!', '视频分类': '美食测评', 'aid': 763701838, 'bvid': 'BV1Ur4y1y72U', '视频描述': '我的芬兰好邻居第一次和大家见面\n请大家多多关照啊!\n第一次挑战就是做包子,邻居姐姐兴致很高\n还让我以后多教他做其他的中国美食\n大家有推荐的可以一起做的美食吗?\n\n*本视频是由【吉列小云刀】赞助,感谢品牌爸爸', '视频封面': 'http://i0.hdslb.com/bfs/archive/51ecfa332e359ec65bfc2db3d4dcf9afe17559b5.jpg', 'up主': '雨琪在芬兰', '视频链接': 'https://b23.tv/BV1Ur4y1y72U', '投币数': 5548, '收藏数': 913, '弹幕数': 2103, '喜欢数': 16677, '观看数': 114452, '分享数': 64}
{'标题': '我不高', '视频分类': '短片', 'aid': 378575215, 'bvid': 'BV1Gf4y1g7b1', '视频描述': '多高,还是有可能不够高。\n\n故事 / 编剧:林沛儒\xa0Link\n动画 / 配音:林沛儒 Link\n\n配乐:林沛儒 Link\n\n原声带 (+ 一首)\nhttps://music.163.com/#/album?id=134598491\n\n我的网易云\nhttps://music.163.com/#/artist?id=48423624\n\n@LinkMusicNow\n\nwww.LinkMusicNow.com', '视频封面': 'http://i2.hdslb.com/bfs/archive/c6a25f4705f91a5cf3c98b77086fb3e09a2e3ea6.jpg', 'up主': 'LinkMusicNow', '视频链接': 'https://b23.tv/BV1Gf4y1g7b1', '投币数': 85219, '收藏数': 66516, '弹幕数': 3326, '喜欢数': 146091, '观看数': 1454856, '分享数': 15404}
{'标题': '92岁抗美援朝老兵,拨通了报警电话……', '视频分类': '社会', 'aid': 421052911, 'bvid': 'BV1J3411C7c5', '视频描述': '9月13日,92岁的抗美援朝老兵拨通了福建厦门110报警电话,民警问后得知,老人是要找到一个叫做“倩倩”的女警,向她说声谢谢。(厦门公安)', '视频封面': 'http://i1.hdslb.com/bfs/archive/24ea1a3b0a33af72b575fa7933465ef861dd7bc0.jpg', 'up主': '中国长安网', '视频链接': 'https://b23.tv/BV1J3411C7c5', '投币数': 6810, '收藏数': 4858, '弹幕数': 471, '喜欢数': 59138, '观看数': 490058, '分享数': 460}
{'标题': '火力少女王唐可可', '视频分类': '综合', 'aid': 676179854, 'bvid': 'BV1yU4y1F7Ho', '视频描述': '我再也不要做任何涉及特效的片子了。', '视频封面': 'http://i2.hdslb.com/bfs/archive/70b492c68de9e5464a7a575b0c007782eaadb7c5.jpg', 'up主': '星无', '视频链接': 'https://b23.tv/BV1yU4y1F7Ho', '投币数': 8710, '收藏数': 4977, '弹幕数': 314, '喜欢数': 20894, '观看数': 248031, '分享数': 3210}
{'标题': '警长:遇见这样的直接开枪吧', '视频分类': '搞笑', 'aid': 891124339, 'bvid': 'BV1yP4y1t7vj', '视频描述': '微博@逗比的雀大巢 呜呜呜 求关注求三连!!!求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连求关注求三连', '视频封面': 'http://i0.hdslb.com/bfs/archive/eb5c0242d21509f3efabb2f4c7dbe5894a2fd24d.jpg', 'up主': '逗比的雀巢', '视频链接': 'https://b23.tv/BV1yP4y1t7vj', '投币数': 140598, '收藏数': 51168, '弹幕数': 4971, '喜欢数': 330153, '观看数': 2374380, '分享数': 10045}
{'标题': '听君一席话,全是废话 2.0 !!!', '视频分类': '短片·手书·配音', 'aid': 506044642, 'bvid': 'BV16u411Z7Ja', '视频描述': '谁能告诉我\n所以姐夫的姐夫到底应该叫什么?!', '视频封面': 'http://i2.hdslb.com/bfs/archive/63ce2397b789a8ea0afa43a75b7274517ac4659b.jpg', 'up主': '三十六贱笑', '视频链接': 'https://b23.tv/BV16u411Z7Ja', '投币数': 74560, '收藏数': 28214, '弹幕数': 15946, '喜欢数': 130112, '观看数': 988896, '分享数': 6398}
{'标题': '家庭版芦荟汁教程来了!最后结尾亮了!', '视频分类': '美食制作', 'aid': 633687415, 'bvid': 'BV17b4y1h7wP', '视频描述': '-', '视频封面': 'http://i2.hdslb.com/bfs/archive/f39f2a5f08b1b5bfe2c4de1368933015e36ec25c.jpg', 'up主': '刘庸干净又卫生', '视频链接': 'https://b23.tv/BV17b4y1h7wP', '投币数': 17570, '收藏数': 2979, '弹幕数': 10211, '喜欢数': 66801, '观看数': 708176, '分享数': 3914}
{'标题': '两位数!要杀他两位数!', '视频分类': '电子竞技', 'aid': 806086303, 'bvid': 'BV1t34y1S7ZZ', '视频描述': '两位数!一定要抓他两位数!!!', '视频封面': 'http://i1.hdslb.com/bfs/archive/8c66b9a80c084163e8daf4a313b8960ab29be304.jpg', 'up主': '怪盗配音', '视频链接': 'https://b23.tv/BV1t34y1S7ZZ', '投币数': 66711, '收藏数': 22236, '弹幕数': 2960, '喜欢数': 113897, '观看数': 1551540, '分享数': 28732}
{'标题': '【4K60FPS】陈奕迅《富士山下》神级现场!你听懂了吗?', '视频分类': '音乐现场', 'aid': 421068588, 'bvid': 'BV1H3411C7ZJ', '视频描述': '官方演唱会现场\n自购陈奕迅《DUO》原盘提取制作,进行了调整\n其实一直以来,很多人都比较喜欢2007年的版本\n但我最近重新看了一下2010年DUO这个演唱会\n发现这个版本,更多了一些意味深长的沧桑感\n填的转载,祝大家开心', '视频封面': 'http://i1.hdslb.com/bfs/archive/fd62a33f3055219875dd279c2976fe845b4761c1.jpg', 'up主': '音乐私藏馆', '视频链接': 'https://b23.tv/BV1H3411C7ZJ', '投币数': 13341, '收藏数': 18843, '弹幕数': 1546, '喜欢数': 50607, '观看数': 507070, '分享数': 4190}
{'标题': '当年火爆的恐怖游戏!用病毒改变人类基因?', '视频分类': '单机游戏', 'aid': 548744650, 'bvid': 'BV1tq4y1G7Ua', '视频描述': '也许,与线粒体有关的故事还在继纟\n\n\n\n\n\n\n\n很长的一期视频,耗费不少时间,还请联合上期视频观看,如果喜欢这期视频的话,请给个三连支持一下!', '视频封面': 'http://i0.hdslb.com/bfs/archive/1312f1f2a5aff43cceb21d12025bed3db61984db.jpg', 'up主': '黑镖客梦回', '视频链接': 'https://b23.tv/BV1tq4y1G7Ua', '投币数': 8963, '收藏数': 4965, '弹幕数': 2832, '喜欢数': 33526, '观看数': 231657, '分享数': 132}
{'标题': '《鱿鱼游戏》成爆款?盘点刺激好看的「大逃杀」类影视剧!【非凡情报局11】', '视频分类': '影视杂谈', 'aid': 721116346, 'bvid': 'BV1PQ4y1z7kW', '视频描述': '好久不见!今天我们顺着全球爆火的《鱿鱼游戏》\n来盘一盘那些紧张刺激的「大逃杀」类影视剧!\n\n《大逃杀》、《饥饿游戏》、《赌博默示录》……\n你看过几部?\n「我承认我有赌的成分」是什么梗?\n还有话剧迷必刷的「乌镇戏剧节」攻略!\n\n本期点赞过7万\n情报局将会在下周与大家见面!', '视频封面': 'http://i0.hdslb.com/bfs/archive/294bd1b215b5c70997bd3fc478b0c610904bc778.jpg', 'up主': '木鱼水心', '视频链接': 'https://b23.tv/BV1PQ4y1z7kW', '投币数': 13352, '收藏数': 7116, '弹幕数': 2976, '喜欢数': 62625, '观看数': 641256, '分享数': 707}
{'标题': '离谱了:600块一个麦当劳汉堡  吃起来是什么味道', '视频分类': '美食制作', 'aid': 633650933, 'bvid': 'BV1Lb4y1h7Dr', '视频描述': '本期不含任何商业推广\n这个做起来是真的不难\n汉堡酱:\n200克蛋黄酱\n150克番茄酱\n50克黄芥末\n5克蒜粉\n一勺腌黄瓜水\n\n牛肉馅:\n牛排部位推荐上脑和西冷\n瘦肉和肥肉比例:65 :35\n每块肉饼称100-120克\n\n切达芝士(片)\n\n沙拉:\n生菜\n腌黄瓜(酸甜味)', '视频封面': 'http://i0.hdslb.com/bfs/archive/1ee1106a4b61511cb9b85b3db159abdf3b55a388.jpg', 'up主': '澳洲阿彭', '视频链接': 'https://b23.tv/BV1Lb4y1h7Dr', '投币数': 8462, '收藏数': 2241, '弹幕数': 1451, '喜欢数': 17556, '观看数': 110589, '分享数': 375}
{'标题': '西安体育学院新生断网后,楼梯道内以武会友代替自我介绍', '视频分类': '日常', 'aid': 463589974, 'bvid': 'BV1GL411G71H', '视频描述': '-', '视频封面': 'http://i0.hdslb.com/bfs/archive/14c3131de99fa74efd50725b62ef3db5a5cf7d93.jpg', 'up主': '新君plus', '视频链接': 'https://b23.tv/BV1GL411G71H', '投币数': 5163, '收藏数': 26851, '弹幕数': 1603, '喜欢数': 269533, '观看数': 3566119, '分享数': 11915}
{'标题': '【一年一度喜剧大赛】互联网要素过多笑不活了  点开之前没想过这么好笑', '视频分类': '综艺', 'aid': 721095617, 'bvid': 'BV1MQ4y1z7Qd', '视频描述': '网络', '视频封面': 'http://i1.hdslb.com/bfs/archive/74803d663848a8778e802d94fe234454ef392d15.jpg', 'up主': '甜酒煮元宵', '视频链接': 'https://b23.tv/BV1MQ4y1z7Qd', '投币数': 2296, '收藏数': 6745, '弹幕数': 810, '喜欢数': 12090, '观看数': 277287, '分享数': 15049}
# 核对数量
print(len(results))
20

尝试实现第二页

import requests

headers = {
    'authority': 'api.bilibili.com',
    'sec-ch-ua': '"Google Chrome";v="93", " Not;A Brand";v="99", "Chromium";v="93"',
    'sec-ch-ua-mobile': '?0',
    'user-agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/93.0.4577.63 Safari/537.36',
    'sec-ch-ua-platform': '"Windows"',
    'accept': '*/*',
    'origin': 'https://www.bilibili.com',
    'sec-fetch-site': 'same-site',
    'sec-fetch-mode': 'cors',
    'sec-fetch-dest': 'empty',
    'referer': 'https://www.bilibili.com/',
    'accept-language': 'zh-CN,zh;q=0.9',
    'cookie': '_uuid=2E7C0255-A2C9-61E6-FE71-6F0A139E068457593infoc; blackside_state=1; rpdid=|(u))lklk)mm0J\'uYk~muk|Ym; SESSDATA=cf38f4f4%2C1643464099%2C9b221%2A81; bili_jct=2e758c3d77523db21486280f0b4b9435; DedeUserID=27912419; DedeUserID__ckMd5=9e75a98514221fcc; sid=6cjnti2r; CURRENT_BLACKGAP=1; buvid3=493A764F-40D7-454E-AC6D-F1339D0B7926148798infoc; LIVE_BUVID=AUTO1316304182076881; buvid_fp=493A764F-40D7-454E-AC6D-F1339D0B7926148798infoc; fingerprint=5d7e917597f8f08dbc1374e9c64052ab; buvid_fp_plain=493A764F-40D7-454E-AC6D-F1339D0B7926148798infoc; CURRENT_QUALITY=80; CURRENT_FNVAL=976; bp_t_offset_27912419=582420740989726215; PVID=2; bp_video_offset_27912419=582467216824846921; bfe_id=6f285c892d9d3c1f8f020adad8bed553; innersign=0',
}

params = (
    ('ps', '20'),
    ('pn', '2'),  # pn代表页数
)

response = requests.get('https://api.bilibili.com/x/web-interface/popular', headers=headers, params=params)
datas = response.json()['data']['list']
results = []  # 用于追加每个视频详情数
for data in datas:
    result = {
        '标题': data['title'],
        '视频分类':data['tname'],
        'aid': data['aid'],
        'bvid': data['bvid'],
        '视频描述': data['desc'],
        '视频封面': data['pic'],
        'up主': data['owner']['name'], 
        '视频链接': data['short_link'],
        '投币数': data['stat']['coin'],
        '收藏数': data['stat']['favorite'],
        '弹幕数': data['stat']['danmaku'],
        '喜欢数': data['stat']['like'],
        '观看数': data['stat']['view'],
        '分享数': data['stat']['share'],
    }
    results.append(result)
    
print('>> 视频数量',len(results))
print(results[0])
>> 视频数量 20
{'标题': '相恋5年,仍在异地,我们结婚了', '视频分类': '搞笑', 'aid': 421171109, 'bvid': 'BV1P3411y7KC', '视频描述': '拍摄设备:索尼A7C iPhone13 Pro\n求婚成功啦!\n2016年,我和谢宝在一起了,那时候她刚进社会,天天哭鼻子,我也贪玩爱打游戏。\n在一起5年,我们一起成长,互相包容,我做梦也没有想到自己可以真的做一个UP主,\n变得有责任感,上进了,\n谢宝也变得可以独当一面,勇敢面对生活的难题。\n也许这就是爱情对我们来说的意义吧。\n两个人因为彼此,变得越来越好。\n两个孤独的灵魂,有了依靠。\n现在我们马上就要跨入人生下一个阶段了,\n说实话还有点恍惚,不过谢宝放心,\n未来,就放在我肩上吧。', '视频封面': 'http://i1.hdslb.com/bfs/archive/11feb29a3657447546108a471e5a19752c318093.jpg', 'up主': '饲养员小谢', '视频链接': 'https://b23.tv/BV1P3411y7KC', '投币数': 15906, '收藏数': 2793, '弹幕数': 1166, '喜欢数': 13975, '观看数': 124801, '分享数': 779}

正常访问,那么接下来就是整合代码了

# 导入库
import re
import requests
import random
import time
import pandas as pd

# 获取随机useragent
def get_useragent():
    head = [
    "Mozilla/5.0 (Windows NT 6.0; rv:2.0) Gecko/20100101 Firefox/4.0 Opera 12.14",
    "Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.0) Opera 12.14",
    "Opera/12.80 (Windows NT 5.1; U; en) Presto/2.10.289 Version/12.02",
    "Opera/9.80 (Windows NT 6.1; U; es-ES) Presto/2.9.181 Version/12.00",
    "Opera/9.80 (Windows NT 5.1; U; zh-sg) Presto/2.9.181 Version/12.00",
    "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.77 Safari/537.36"
]
    return random.choice(head)  

def get_datas(p):
    headers = {
        'authority': 'api.bilibili.com',
        'sec-ch-ua': '"Google Chrome";v="93", " Not;A Brand";v="99", "Chromium";v="93"',
        'sec-ch-ua-mobile': '?0',
        'user-agent': get_useragent(),  # 调用函数get_useragent 获取随机useragent
        'sec-ch-ua-platform': '"Windows"',
        'accept': '*/*',
        'origin': 'https://www.bilibili.com',
        'sec-fetch-site': 'same-site',
        'sec-fetch-mode': 'cors',
        'sec-fetch-dest': 'empty',
        'referer': 'https://www.bilibili.com/',
        'accept-language': 'zh-CN,zh;q=0.9',
        'cookie': '_uuid=2E7C0255-A2C9-61E6-FE71-6F0A139E068457593infoc; blackside_state=1; rpdid=|(u))lklk)mm0J\'uYk~muk|Ym; SESSDATA=cf38f4f4%2C1643464099%2C9b221%2A81; bili_jct=2e758c3d77523db21486280f0b4b9435; DedeUserID=27912419; DedeUserID__ckMd5=9e75a98514221fcc; sid=6cjnti2r; CURRENT_BLACKGAP=1; buvid3=493A764F-40D7-454E-AC6D-F1339D0B7926148798infoc; LIVE_BUVID=AUTO1316304182076881; buvid_fp=493A764F-40D7-454E-AC6D-F1339D0B7926148798infoc; fingerprint=5d7e917597f8f08dbc1374e9c64052ab; buvid_fp_plain=493A764F-40D7-454E-AC6D-F1339D0B7926148798infoc; CURRENT_QUALITY=80; CURRENT_FNVAL=976; bp_t_offset_27912419=582420740989726215; PVID=2; bp_video_offset_27912419=582467216824846921; bfe_id=6f285c892d9d3c1f8f020adad8bed553; innersign=0',
    }
    
    params = (
        ('ps', '20'),
        ('pn', p),  # p代表页数
    )
    
    response = requests.get('https://api.bilibili.com/x/web-interface/popular', headers=headers, params=params)
    datas = response.json()['data']['list']
    results = []  # 用于追加每个视频详情数
    for data in datas:
        result = {
            '标题': data['title'],
            '视频分类':data['tname'],
            'aid': data['aid'],
            'bvid': data['bvid'],
            '视频描述': data['desc'],
            '视频封面': data['pic'],
            'up主': data['owner']['name'], 
            '视频链接': data['short_link'],
            '投币数': data['stat']['coin'],
            '收藏数': data['stat']['favorite'],
            '弹幕数': data['stat']['danmaku'],
            '喜欢数': data['stat']['like'],
            '观看数': data['stat']['view'],
            '分享数': data['stat']['share'],
        }
        results.append(result)
    return results
    
def main():
    result_all = []
    # 因为页数只有10页
    for p in range(1,11):
        print(f'>>> 正在获取:{p}页')
        results = get_datas(p)
        [result_all.append(result) for result in results]  # 每次传递过来有20个,再次遍历保存在result_all,将全部页数数据保存于此
        time.sleep(3)  # 设置休眠时间,防止访问过于频繁,减轻服务器压力
    
    # 保存数据
    df = pd.DataFrame(result_all)
    df.to_excel('B站.xlsx', index=False)
    print('保存成功')

if __name__ == '__main__':
    main()
>>> 正在获取:1>>> 正在获取:2>>> 正在获取:3>>> 正在获取:4>>> 正在获取:5>>> 正在获取:6>>> 正在获取:7>>> 正在获取:8>>> 正在获取:9>>> 正在获取:10页
保存成功

最终保存的结果如下

小问题:

1、这里面总共是10页的数据,也意味着总共要请求10次,每次20个视频数据,那么有没有办法说可以在获取同样的数据的同时,减少访问次数呢?

我想是有的,我们可以看一下接下来的操作尝试:

因为这个请求是get请求,我们可以直接将 api.bilibili.com/x/web-inter… 复制到浏览器中,如图所示返回以下数据

那么当我们将页数,调为本不该存在的11页时,会返回什么情况呢?如下:

很显然数据 list 是空的,那么接下来就是重点了,我们可以改变pn的参数去改变页数,那能不能改变ps参数,去改变返回数量呢?

试一下就知道了,如图所示,我们将页数改为30,也就是返回30个数据,看看能否正常访问

可以看到能够正常访问,那把ps改为100,会怎样

结果是不能访问,那么可以确定ps 就是在30 - 100 之间,那么最终判断可以确定是 50

将数据复制到 json转换页面最终确定一下

params = (
        ('ps', '50'),  # 将 ps 改为50
        ('pn', 1),  # p代表页数
    )

那么访问次数就只要4次就可以了,不需要访问这么多次了

问题2:这里的翻页我们是确定为10页,但是假设有100也,或者是369页的情况下,我们还有人为去翻页确定吗?

我想是没有必要的,我们可以看到如下图,当我们超出页数的时候,list 返回的是空的,那么我们可以判断当 list 是空的时候,我们直接就停止了,

对此我们可以将以下的代码改一下:

import requests
 
headers = {
    'authority': 'api.bilibili.com',
    'sec-ch-ua': '"Google Chrome";v="93", " Not;A Brand";v="99", "Chromium";v="93"',
    'sec-ch-ua-mobile': '?0',
    'user-agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/93.0.4577.63 Safari/537.36',
    'sec-ch-ua-platform': '"Windows"',
    'accept': '*/*',
    'origin': 'https://www.bilibili.com',
    'sec-fetch-site': 'same-site',
    'sec-fetch-mode': 'cors',
    'sec-fetch-dest': 'empty',
    'referer': 'https://www.bilibili.com/',
    'accept-language': 'zh-CN,zh;q=0.9',
    'cookie': '_uuid=2E7C0255-A2C9-61E6-FE71-6F0A139E068457593infoc; blackside_state=1; rpdid=|(u))lklk)mm0J\'uYk~muk|Ym; SESSDATA=cf38f4f4%2C1643464099%2C9b221%2A81; bili_jct=2e758c3d77523db21486280f0b4b9435; DedeUserID=27912419; DedeUserID__ckMd5=9e75a98514221fcc; sid=6cjnti2r; CURRENT_BLACKGAP=1; buvid3=493A764F-40D7-454E-AC6D-F1339D0B7926148798infoc; LIVE_BUVID=AUTO1316304182076881; buvid_fp=493A764F-40D7-454E-AC6D-F1339D0B7926148798infoc; fingerprint=5d7e917597f8f08dbc1374e9c64052ab; buvid_fp_plain=493A764F-40D7-454E-AC6D-F1339D0B7926148798infoc; CURRENT_QUALITY=80; CURRENT_FNVAL=976; bp_t_offset_27912419=582420740989726215; PVID=2; bp_video_offset_27912419=582467216824846921; bfe_id=6f285c892d9d3c1f8f020adad8bed553; innersign=0',
}
 
params = (
    ('ps', '20'),
    ('pn', '11'),
)
 
response = requests.get('https://api.bilibili.com/x/web-interface/popular', headers=headers, params=params)

print(response.json())
{'code': 0, 'message': '0', 'ttl': 1, 'data': {'list': [], 'no_more': True}}
datas = response.json()['data']['list']
print(len(datas))
if len(datas) == 0:
    print(">>> 够了")
0
>>> 够了

结合上面两个问题,我们可以优化如下:

# 导入库
import re
import requests
import random
import time
import pandas as pd


# 获取随机useragent
def get_useragent():
    head = [
        "Mozilla/5.0 (Windows NT 6.0; rv:2.0) Gecko/20100101 Firefox/4.0 Opera 12.14",
        "Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.0) Opera 12.14",
        "Opera/12.80 (Windows NT 5.1; U; en) Presto/2.10.289 Version/12.02",
        "Opera/9.80 (Windows NT 6.1; U; es-ES) Presto/2.9.181 Version/12.00",
        "Opera/9.80 (Windows NT 5.1; U; zh-sg) Presto/2.9.181 Version/12.00",
        "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.77 Safari/537.36"
    ]
    return random.choice(head)


def get_datas(p):

    headers = {
        'authority': 'api.bilibili.com',
        'sec-ch-ua': '"Google Chrome";v="93", " Not;A Brand";v="99", "Chromium";v="93"',
        'sec-ch-ua-mobile': '?0',
        'user-agent': get_useragent(),  # 调用函数get_useragent 获取随机useragent
        'sec-ch-ua-platform': '"Windows"',
        'accept': '*/*',
        'origin': 'https://www.bilibili.com',
        'sec-fetch-site': 'same-site',
        'sec-fetch-mode': 'cors',
        'sec-fetch-dest': 'empty',
        'referer': 'https://www.bilibili.com/',
        'accept-language': 'zh-CN,zh;q=0.9',
        'cookie': '_uuid=2E7C0255-A2C9-61E6-FE71-6F0A139E068457593infoc; blackside_state=1; rpdid=|(u))lklk)mm0J\'uYk~muk|Ym; SESSDATA=cf38f4f4%2C1643464099%2C9b221%2A81; bili_jct=2e758c3d77523db21486280f0b4b9435; DedeUserID=27912419; DedeUserID__ckMd5=9e75a98514221fcc; sid=6cjnti2r; CURRENT_BLACKGAP=1; buvid3=493A764F-40D7-454E-AC6D-F1339D0B7926148798infoc; LIVE_BUVID=AUTO1316304182076881; buvid_fp=493A764F-40D7-454E-AC6D-F1339D0B7926148798infoc; fingerprint=5d7e917597f8f08dbc1374e9c64052ab; buvid_fp_plain=493A764F-40D7-454E-AC6D-F1339D0B7926148798infoc; CURRENT_QUALITY=80; CURRENT_FNVAL=976; bp_t_offset_27912419=582420740989726215; PVID=2; bp_video_offset_27912419=582467216824846921; bfe_id=6f285c892d9d3c1f8f020adad8bed553; innersign=0',
    }

    params = (
        ('ps', '50'),
        ('pn', p),  # p代表页数
    )

    response = requests.get('https://api.bilibili.com/x/web-interface/popular', headers=headers, params=params)

    datas = response.json()['data']['list']
    
    # 加code判断是否超出,如果超出就给 code赋值为 “空”
    code = ''
    if len(datas) == 0:
        code = '空'

    results = []  # 用于追加每个视频详情数
    for data in datas:
        result = {
            '标题': data['title'],
            '视频分类': data['tname'],
            'aid': data['aid'],
            'bvid': data['bvid'],
            '视频描述': data['desc'],
            '视频封面': data['pic'],
            'up主': data['owner']['name'],
            '视频链接': data['short_link'],
            '投币数': data['stat']['coin'],
            '收藏数': data['stat']['favorite'],
            '弹幕数': data['stat']['danmaku'],
            '喜欢数': data['stat']['like'],
            '观看数': data['stat']['view'],
            '分享数': data['stat']['share'],
        }
        results.append(result)
    return results , code  # 多了一个返回参数


def main():
    result_all = []
    # 因为页数只有10页
    for p in range(1, 11):
        print(f'>>> 正在获取:{p}页')
        results , code = get_datas(p)  # 多了个返回参数 code 做为判断
        if code == '空': 
            print('>> 够了')
            break  # 当出现“空” 直接break停止接下来的循环
        [result_all.append(result) for result in results]  # 每次传递过来有20个,再次遍历保存在result_all,将全部页数数据保存于此
        time.sleep(3)  # 设置休眠时间,防止访问过于频繁,减轻服务器压力

    # 保存数据
    df = pd.DataFrame(result_all)
    df.to_excel('B站.xlsx', index=False)
    print('保存成功')


if __name__ == '__main__':
    main()
>>> 正在获取:1页
>>> 正在获取:2页
>>> 正在获取:3页
>>> 正在获取:4页
>>> 正在获取:5页
>> 够了
保存成功

可以看到运行情况,当准备获取第5页时候,其实已经没有数据了,接下来的6、7、8后面的页数是不会再请求的了

Task8、作业

获取该页面下每周必看的所有视频的详情数据,并保存为excel文件既可以,其他保存方式都可以,保存的字段不限制,无论是标题还是链接,根据你自己想要的既可以

!! 温馨提示,该项目只作为练习,切勿做出对目标网站有所压力的行为