这是笔者研一时刚开始学python时，对爬虫很感兴趣。自己试着爬了爬今日头条的新闻。
爬取了新闻标题、新闻链接、公众号、评论数、公众号链接等。
发送请求时要带上一个cookie哦，防止被禁爬虫。
先写这么多叭，代码里都有注释，以后有时间再详细讲讲！
代码
import requests
import json
from openpyxl import Workbook
import time
import hashlib
import os
import datetime
import pandas as pd
start_url = 'https://www.toutiao.com/api/pc/feed/?category=news_hot&utm_source=toutiao&widen=1&max_behot_time='
url = 'https://www.toutiao.com'
headers = {
'user-agent': 'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 Safari/537.36'
}
cookies = {'tt_webid': '6925668574955062791;'} # 此处cookies可从浏览器中查找，为了避免被头条禁止爬虫
max_behot_time = '0' # 链接参数
title = [] # 存储新闻标题
source_url = [] # 存储新闻的链接
s_url = [] # 存储新闻的完整链接
source = [] # 存储发布新闻的公众号
media_url = {} # 存储公众号的完整链接
comments_count = [] # 存储评论量
def get_as_cp(): # 该函数主要是为了获取as和cp参数，程序参考今日头条中的加密js文件：home_4abea46.js
zz = {}
now = round(time.time())
print(now) # 获取当前计算机时间
e = hex(int(now)).upper()[2:] #hex()转换一个整数对象为16进制的字符串表示 前两位大写。
print('e:', e)
a = hashlib.md5() #hashlib.md5().hexdigest()创建hash对象并返回16进制结果
print('a:', a)
a.update(str(int(now)).encode('utf-8'))
i = a.hexdigest().upper()
print('i:', i)
if len(e)!=8:
zz = {'as':'479BB4B7254C150',
'cp':'7E0AC8874BB0985'}
return zz
n = i[:5]
a = i[-5:]
r = ''
s = ''
for i in range(5):
s= s+n[i]+e[i]
for j in range(5):
r = r+e[j+3]+a[j]
zz ={
'as':'A1'+s+e[-3:],
'cp':e[0:3]+r+'E1'
}
print('zz:', zz)
return zz
def getdata(url, headers, cookies): # 解析网页函数
r = requests.get(url, headers=headers,cookies=cookies)
print(url)
data = json.loads(r.text)
return data
def savedata(title, s_url, source, media_url,comments_count): # 存储数据到文件
# 存储数据到xlxs文件
wb = Workbook()
if not os.path.isdir(os.getcwd()+'/result'): # 判断文件夹是否存在
os.makedirs(os.getcwd()+'/result') # 新建存储文件夹
filename = os.getcwd()+'/result/result-' + \
datetime.datetime.now().strftime('%Y-%m-%d-%H-%m')+'.xlsx' # 新建存储结果的excel文件
ws = wb.active
ws.title = 'data' # 更改工作表的标题
ws['A1'] = '标题' # 对表格加入标题
ws['B1'] = '新闻链接'
ws['C1'] = '头条号'
ws['D1'] = '头条号链接'
ws['E1'] = '评论量'
for row in range(2, len(title)+2): # 将数据写入表格
_ = ws.cell(column=1, row=row, value=title[row-2])
_ = ws.cell(column=2, row=row, value=s_url[row-2])
_ = ws.cell(column=3, row=row, value=source[row-2])
_ = ws.cell(column=4, row=row, value=media_url[source[row-2]])
_ = ws.cell(column=5, row=row, value=comments_count[row-2])
wb.save(filename=filename) # 保存文件
###按照评论量进行排序并生成排序后的文件
data = pd.read_excel(filename)
data.sort_values(by='评论量', ascending=False, inplace=True)
data.to_csv('result.csv', encoding='utf-8', index=False,
header=['title', 's_url', 'source', 'media_url', 'comments_count'])
print(data)
def main(max_behot_time, title, source_url, s_url, source, media_url,comments_count): # 主函数
for i in range(10): # 此处的数字类似于你刷新新闻的次数，正常情况下刷新一次会出现10条新闻，但也存在少于10条的情况；所以最后的结果并不一定是10的倍数
ascp = get_as_cp() # 获取as和cp参数的函数
demo = getdata(start_url+max_behot_time+'&max_behot_time_tmp='+max_behot_time +
'&tadrequire=true&as='+ascp['as']+'&cp='+ascp['cp'] + '&_signature=', headers, cookies)
# print(demo)
time.sleep(1)
for j in range(len(demo['data'])):
# print(demo['data'][j]['title'])
if demo['data'][j]['title'] not in title:
title.append(demo['data'][j]['title']) # 获取新闻标题
source_url.append(demo['data'][j]['source_url']) # 获取新闻链接
source.append(demo['data'][j]['source']) # 获取发布新闻的公众号
# if demo['data'][j]['comments_count'] not in comments_count:
if 'comments_count' in demo['data'][j].keys():
# demo['data'][j]['comments_count'] = demo['data'][j]['comments_count']
pass
else:
demo['data'][j]['comments_count'] = 0
comments_count.append(int(demo['data'][j]['comments_count'])) ##获取评论量
if demo['data'][j]['source'] not in media_url:
if 'media_url' in demo['data'][j].keys():
media_url[demo['data'][j]['source']] = url + demo['data'][j]['media_url'] # 获取公众号链接
else:
media_url[demo['data'][j]['source']] = ''
print(max_behot_time)
# 获取下一个链接的max_behot_time参数的值
max_behot_time = str(demo['next']['max_behot_time'])
for index in range(len(title)):
print('标题：', title[index])
if 'https' not in source_url[index]:
s_url.append(url+source_url[index])
print('新闻链接：', url+source_url[index])
else:
print('新闻链接：', source_url[index])
s_url.append(source_url[index])
# print('源链接：', url+source_url[index])
print('头条号：', source[index])
print(len(title)) # 获取的新闻数量
if __name__ == '__main__':
main(max_behot_time, title, source_url, s_url, source, media_url,comments_count)
savedata(title, s_url, source, media_url, comments_count)
爬取的结果
title,s_url,source,media_url,comments_count
中国队提前锁定乒乓球女单金银牌,https://www.toutiao.com/group/6990306654713692684/,快讯,,9991
郎平说没想到朱婷伤这么重,https://www.toutiao.com/group/6990290649061065224/,环球网,https://www.toutiao.com/c/user/token/MS4wLjABAAAAvazHMceCo3MeM9IJbll231AC8GkJDcrd__iZFw2hi4o/,8916
肖若腾“被打低分”无缘金牌后，当场执法印度裁判被曝曾发文：“应有人阻止中国大获全胜”,https://www.toutiao.com/group/6989940497737351687/,环球网,https://www.toutiao.com/c/user/token/MS4wLjABAAAAvazHMceCo3MeM9IJbll231AC8GkJDcrd__iZFw2hi4o/,4593
被孙颖莎4:0横扫之后，伊藤美诚哭了说“很不甘心”,https://www.toutiao.com/group/6990172947449201185/,环球网,https://www.toutiao.com/c/user/token/MS4wLjABAAAAvazHMceCo3MeM9IJbll231AC8GkJDcrd__iZFw2hi4o/,4107
美国公开天津会谈内幕，谢尔曼直接给中国定罪，为何要激怒中方？,https://www.toutiao.com/group/6990269163658871335/,刘晓非说,https://www.toutiao.com/c/user/token/MS4wLjABAAAAnYr4heorrcdDCgReFRaoqAL17AFKmjwAuJlK-QlZdGQ/,4001
暴打伊藤！女单半决赛第二局孙颖莎3-9落后 连得8分完成超级逆转,https://www.toutiao.com/group/6990184480505856525/,直播吧,https://www.toutiao.com/c/user/token/MS4wLjABAAAAjiGR2WNpvlGgfhkn8pdqhsZsQmqE-hliqNfXcbFp4pU/,3523
“水跟方便面真的不要再捐了”说明了什么,https://www.toutiao.com/group/6990172994395963907/,中国青年网,https://www.toutiao.com/c/user/token/MS4wLjABAAAAxvhRvfp8QotIo15bD0cWxFiKWMXaUldeG_Ep2unxBqM/,3284
伊藤美诚哭着离开赛场，日本媒体问孙颖莎：是带着复仇之心来比的吗？,https://www.toutiao.com/group/6990288257569489440/,中国青年网,https://www.toutiao.com/c/user/token/MS4wLjABAAAAxvhRvfp8QotIo15bD0cWxFiKWMXaUldeG_Ep2unxBqM/,1929
4-0横扫日本队 打哭伊藤美诚！孙颖莎一个词形容：过瘾！,https://www.toutiao.com/group/6990292906766500382/,海客新闻,https://www.toutiao.com/c/user/token/MS4wLjABAAAA63pjcWNVfgiI6PNOuz4JGvZeMPDtlHVHwCnnPgCjYp7hm6Kt76qsqcUxURAL9dy8/,1789
中国奥运史最伟大的十位人物：郭晶晶上榜，李宁林丹无悬念,https://www.toutiao.com/group/6990189536336839182/,舒克儿播报员,https://www.toutiao.com/c/user/token/MS4wLjABAAAAc3qZ--Asazs-8RMqXAaoUpON7nEpc0-LW-VX-z0vvvKnFTGmP8F0kX3Cs60c3fgN/,1477
战胜伊藤美诚！孙颖莎挺进决赛，国乒提前包揽女单金银牌,https://www.toutiao.com/group/6990172947449201185/,河北新闻网,https://www.toutiao.com/c/user/token/MS4wLjABAAAAJkLb_8yBQtCNYX-gGxkwjSNzTTq4wNzjjzN_Q3xCXSE/,1358
日本电视台问如何看待与伊藤的决赛？陈梦：等她进了决赛再说,https://www.toutiao.com/group/6990227616611762719/,直播吧,https://www.toutiao.com/c/user/token/MS4wLjABAAAAjiGR2WNpvlGgfhkn8pdqhsZsQmqE-hliqNfXcbFp4pU/,1299
又是中国包揽冠亚军，日本网友：以后单打冠军送你们得了,https://www.toutiao.com/group/6990246795137843751/,体育大朋说,https://www.toutiao.com/c/user/token/MS4wLjABAAAA8JP7BFDerPv9KUBVKElfevozix6bV3qP7CnEgMaiI5g/,827
福州21岁大学生暑期打工失联7天，凌晨外出曾答应舍友帮忙带烧烤,https://www.toutiao.com/group/6990324045896122916/,极目新闻,https://www.toutiao.com/c/user/token/MS4wLjABAAAAeateBb9Su8I3MJOZozmvyzWktmba5LMlliRDz1KffnM/,724
美国退路早已准备好？巨额债务即将到期，给世界释放了什么信号？,https://www.toutiao.com/group/6990172947449201185/,葛剑生,https://www.toutiao.com/c/user/token/MS4wLjABAAAAVO6-BUQlnPQL_joQwZpACi_qk1vjnPL7J92oIy7Ie7c/,704
河南暴雨致医院仪器被淹，损失或达10亿，贵重设备为何放在一楼？,https://www.toutiao.com/group/6990169450687414795/,钟铭聊科学,https://www.toutiao.com/c/user/token/MS4wLjABAAAANSRK-Vin1c6X7tMx3wsSCs39Y6IAHDhJjEbZOMPpLQQ/,668
四川攀枝花：满足2个条件，二胎三胎每月补贴500元，直到孩子3岁,https://www.toutiao.com/group/6990292906766500382/,蜂部落,https://www.toutiao.com/c/user/token/MS4wLjABAAAAB13Wizbtb5Otwt4GUkX0yY4Z9XkALkleTwXVKcbxslo/,663
孙颖莎4比0横扫伊藤美诚，中国队提前锁定乒乓球女单冠亚军,https://www.toutiao.com/group/6990269163658871335/,环球网,https://www.toutiao.com/c/user/token/MS4wLjABAAAAvazHMceCo3MeM9IJbll231AC8GkJDcrd__iZFw2hi4o/,605
郑州奔驰堵了全车库 整个地下停车场全军覆没 车主涉罪吗？,https://www.toutiao.com/group/6990267676161589771/,个案说法,https://www.toutiao.com/c/user/token/MS4wLjABAAAANpQB3smRhklkaQjlUPL8lkENcn_0R-8zd15oWkSjeGc/,584
最后一棒，李冰洁硬刚莱德基！河北“天才少女”守住奇迹,https://www.toutiao.com/group/6990184480505856525/,红星新闻,https://www.toutiao.com/c/user/token/MS4wLjABAAAAjtBwvR3OD0QmhA9w_LoIHcbufaw2GM6-i2fNvseUEL0/,502
举国狂欢！89万人口小岛又夺金牌，全队围成一圈，泣不成声,https://www.toutiao.com/group/6990184480505856525/,叶青足球世界,https://www.toutiao.com/c/user/token/MS4wLjABAAAAZHePnmndvR3fhJYsGQd8WUiQEy70mpYV4y1mTCJwEMw/,492
2：3，中国女排遗憾输给俄罗斯奥运队，出线渺茫！详细看这里,https://www.toutiao.com/group/6990285261942833699/,呆呆讲道理,https://www.toutiao.com/c/user/token/MS4wLjABAAAArBYiJJmsKNT-umm4OJ6EiCRtXdyb2uUn9QiUY2Bvmws/,400
“教主”俞敏洪，这次是真的怒了,https://www.toutiao.com/group/6989940497737351687/,蒋东文,https://www.toutiao.com/c/user/token/MS4wLjABAAAARlxgLFCf7QArSBsxNgNT9f8k4Ufstc79zyK_9i7TA4w/,367
韩红救灾是作秀？蓝天救援队怒斥伪慈善，鸿星尔克诈捐真相大白,https://www.toutiao.com/group/6990285261942833699/,理娱探长,https://www.toutiao.com/c/user/token/MS4wLjABAAAAfxsfvNKQPUJuhEbqQeCLnNlqbAMxdIe7j4bnQLkO-IF_3k3LLz5oBlVHlPU-G4a6/,310
孙颖莎横扫伊藤美诚！李隼：国乒女队练了五年就为这场球,https://www.toutiao.com/group/6990288257569489440/,直播吧,https://www.toutiao.com/c/user/token/MS4wLjABAAAAjiGR2WNpvlGgfhkn8pdqhsZsQmqE-hliqNfXcbFp4pU/,305
快乐的暑假亲子游是怎么变成一场悲剧的？从失守的南京到旺季的张家界 大连、成都4户家庭的湘西之旅,https://www.toutiao.com/group/6990227616611762719/,浙医在线,https://www.toutiao.com/c/user/token/MS4wLjABAAAAndFkyyYgEss8NONwo8586RLb-dAmfW14QWBYDFbaLz0/,303
大数据 | 感染已达15人！那几天张家界的游客来自哪些城市,https://www.toutiao.com/group/6990220867439428107/,第一财经,https://www.toutiao.com/c/user/token/MS4wLjABAAAAH3-cqP0z1oD8ZOK2KTLGNk_HE4d9BhSbz35axhPE47U/,298
26岁女大学生弑母后“装疯卖傻”，她能否逃脱法律的惩罚？,https://www.toutiao.com/group/6990279522385986087/,辛晴如梦,https://www.toutiao.com/c/user/token/MS4wLjABAAAA9zNMBrGVbDQF6_pnoUiXEMSryq7qOOFVGknjbF2CiiH1wb1De7HS9FfY4fX0GkDo/,239
这个代表团仅11人参赛却有2人摘得金牌！看看这些了不起的奥运迷你团,https://www.toutiao.com/group/6990214159535178271/,极目新闻,https://www.toutiao.com/c/user/token/MS4wLjABAAAAeateBb9Su8I3MJOZozmvyzWktmba5LMlliRDz1KffnM/,203
伊藤美诚哭着离开赛场，日媒问孙颖莎：是带着复仇之心来比的吗,https://www.toutiao.com/group/6990290649061065224/,源头资讯,https://www.toutiao.com/c/user/token/MS4wLjABAAAA2Pr0TFCwk4j6FyoBa5nmO9xQw9ng-sg3sFeotBFdpCDmOtm_2fbZVfBUeG5_lDL0/,180
7月28日东京奥运会金牌榜出炉,https://www.toutiao.com/group/6990185425163780638/,北青网,https://www.toutiao.com/c/user/token/MS4wLjABAAAAkBInTefEXGPcS0avMIcyzcyDIb8T8hL6gUlrrWDJxIw/,171
三人女篮登上奥运领奖台 最高兴是姚明 他太需要这奖牌发展中国篮球,https://www.toutiao.com/group/6990267676161589771/,星辉体育,https://www.toutiao.com/c/user/token/MS4wLjABAAAA3VjgjWibGzExtNTg8UyYlwOK9UVvjMre2DUv3G512XY/,146
感染链再延长，或已形成南京张家界疫情传播双中心,https://www.toutiao.com/group/6990178013673849376/,中国青年网,https://www.toutiao.com/c/user/token/MS4wLjABAAAAxvhRvfp8QotIo15bD0cWxFiKWMXaUldeG_Ep2unxBqM/,143
第2次了！千只猴子在马路中间火拼，导致交通中断，场面不输电影,https://www.toutiao.com/group/6990238671802892837/,趣聊科学,https://www.toutiao.com/c/user/token/MS4wLjABAAAAKg99nPMis_M0j94VHmZ79JV-NQdzZH3kktVal_1AqRs/,135
怀孕妻子看望河南救灾消防员丈夫求抱抱，丈夫：“不要抱，我身上可脏了”,https://www.toutiao.com/group/6990306654713692684/,潇湘晨报,https://www.toutiao.com/c/user/token/MS4wLjABAAAAv0QcUypFz9CErjgw6EaDRg4siwvBJU-eNiX-kZSlWgM/,134
守住上半区！陈梦4-0击溃超级黑马，国乒有望连续4届包揽金银,https://www.toutiao.com/group/6990172994395963907/,橙汁的味道,https://www.toutiao.com/c/user/token/MS4wLjABAAAASCBRaLh8UjNXjdG4KJS9r-SSTu-W0dOlmvPwZmdzcQY/,133
小魔王孙颖莎大战日本乒乓一姐伊藤美诚，谁才是真正的王者？,https://www.toutiao.com/group/6989985068341002783/,易乒乓YPP,https://www.toutiao.com/c/user/token/MS4wLjABAAAAkkWerEh6KWk4HX8B1DEE7CDXm_Py8osUXD1PhNYQaiY/,119
内蒙古呼伦贝尔急寻3名密接者的接触人员 行程轨迹公布,https://www.toutiao.com/group/6990238671802892837/,环球网,https://www.toutiao.com/c/user/token/MS4wLjABAAAAvazHMceCo3MeM9IJbll231AC8GkJDcrd__iZFw2hi4o/,100
亿万球迷见证伊藤美诚发球“自杀”！0-4崩了，被孙颖莎打哭了,https://www.toutiao.com/group/6990249763912401445/,源点资讯E站,https://www.toutiao.com/c/user/token/MS4wLjABAAAAgcbziZNGzVgGDQXE-rBYEiAJ6XPktWUyrRSjzKNi6lYgr1mKB0Z5H1Fk91p7m0wD/,100
华为P50系列手机正式亮相,https://www.toutiao.com/group/6990315143649624612/,品玩,https://www.toutiao.com/c/user/token/MS4wLjABAAAAT1hEjU75BlTx1C07J-faCtgSF7v649xTams0LUPIDlI/,86
陈梦晋级乒乓球女单决赛,https://www.toutiao.com/group/6990315143649624612/,观察者网,https://www.toutiao.com/c/user/token/MS4wLjABAAAAjMIvjM9ZCTBrb2fOwv_KpFPQ6MJh6iHm2OlIm9xgyJk/,75
网红前去河南偷冲锋舟谎称救人！遭救援队员破口大骂：你们是人渣,https://www.toutiao.com/group/6990178013673849376/,盖饭娱乐官方号,https://www.toutiao.com/c/user/token/MS4wLjABAAAAcj8OYxYbAPcNcYS1FYckAUF4Cu-v8BFZaOTW5Ii28os/,71
听听秦刚大使给力的英文！“我喝口水啊，然后我就用英文讲”,https://www.toutiao.com/group/6990246795137843751/,记者韩鹏,https://www.toutiao.com/c/user/token/MS4wLjABAAAANpUnmuexmruQEmb1R1cBRCCkmGMp3ZhonBqJn70TaKM/,70
来自电子垃圾里面的它，东京奥运会奖牌能不能咬？看纯度拼心理,https://www.toutiao.com/group/6990315143649624612/,李将平老师,https://www.toutiao.com/c/user/token/MS4wLjABAAAASCry-TKCerO_k518jbDs13jkfNVM04mo0qjxg-jmEmU/,69
太厉害了！张雨菲一小时内连夺两金，破完奥运纪录，又破世界纪录,https://www.toutiao.com/group/6990285261942833699/,玺侃女排,https://www.toutiao.com/c/user/token/MS4wLjABAAAAFcYGSR7-rk68EZ03dsKN_sS2ZrbOPBpYElZzJLyQRkk/,60
郑州地铁5号线逆行护士：那晚接手9位遇难者，我用纸和湿巾为他们整理遗容,https://www.toutiao.com/group/6990306654713692684/,九派深度,https://www.toutiao.com/c/user/token/MS4wLjABAAAAZDRlKEN4BUaD1xRiZCOLqL0y-ftQ2IxR8x7yHSxFOihSI48d98Y5oaYVG5JZs3oe/,52
注意防范！鲁中、鲁南和鲁西北暴雨到大暴雨，半岛地区中到大雨,https://www.toutiao.com/group/6990177588643775007/,闪电新闻,https://www.toutiao.com/c/user/token/MS4wLjABAAAA3KU9ifwN12G41E6PJRpZgIfzVrXWQ4WPF66ns54c0uw/,36
地铁5号线的生死营救,https://www.toutiao.com/group/6990178013673849376/,环球人物杂志,https://www.toutiao.com/c/user/token/MS4wLjABAAAAhAKK7LCl_xBflEJTPy1wesrlqc3Kha8jRxiU3-fIR4A/,34
中小学生喜迎好消息，教育部新规发布，家长们感到如释重负,https://www.toutiao.com/group/6990214159535178271/,甜心说教育,https://www.toutiao.com/c/user/token/MS4wLjABAAAA9HprEeMJ9wI77hBNJsSGitc5840pZAmu5tRiQukFu5mF_8JNneMfbC6ugb9u-4Sc/,32
郎平亲自破案，揭开中国女排3连败真实原因，央视名嘴哽咽落泪,https://www.toutiao.com/group/6990324045896122916/,毛罗,https://www.toutiao.com/c/user/token/MS4wLjABAAAANBy7VzfGt03ZbcZdRy_BQzrkLPg5ybHUDpvZn_fQ1jg/,17
田亮被问跳水的会不会游泳，幽默回应：不然呢？难道跳完用网捞吗？,https://www.toutiao.com/group/6990227616611762719/,谈资,https://www.toutiao.com/c/user/token/MS4wLjABAAAAEAuewTzEw6OlPUCCeB7PDQd71QPYPwL8f4cuAOH79_E/,15
南通市新冠肺炎疫情防控指挥部办公室紧急通告,https://www.toutiao.com/group/6990185425163780638/,全国党媒信息公共平台,https://www.toutiao.com/c/user/token/MS4wLjABAAAAabHAGA5rwz80RE3cHMbb8luHFKXQoelOhsFetuR7qaM/,14
孙颖莎淘汰伊藤美诚 中国队包揽冠亚军,https://www.toutiao.com/group/6990306654713692684/,体育最先声,https://www.toutiao.com/c/user/token/MS4wLjABAAAAiDXxQmGK9kWGQRPkxJos1lzgE018gt7niVcYkWMlYuY/,13
朱婷接下来不打了？女排憾负俄奥队遭3连败 郎平赛后透露连败真因,https://www.toutiao.com/group/6990169450687414795/,胖丁篮球,https://www.toutiao.com/c/user/token/MS4wLjABAAAANGA3rsYBbQg4Kz1Vz9oxkNI6p_KpOTfRJIUwKvjUPb0/,12
伊藤美诚痛哭向日本观众道歉：不耍手段，中国人太难赢了,https://www.toutiao.com/group/6990178769294066207/,先锋读书会,https://www.toutiao.com/c/user/token/MS4wLjABAAAAOdZ9egVFFOEicvCWcGxLNqVRSzb_Jn1mItryR6GyRqc/,12
孙颖莎4比0横扫伊藤美诚 中国队提前锁定乒乓球女单冠亚军,https://www.toutiao.com/group/6990178769294066207/,国际在线,https://www.toutiao.com/c/user/token/MS4wLjABAAAAHEIfF3AjOEKxo1e5xB2DmCRWDIClSanDQUCol7ZWWG4/,10
积压3年，文章大片终于要播！搭档喜剧女王，看到上映日期我想哭,https://www.toutiao.com/group/6990249763912401445/,八卦南枫,https://www.toutiao.com/c/user/token/MS4wLjABAAAADYzrxGccSLf9zWxakUA0K6eIoLESSqBUkFLIUTI-BPsc47gwJbM29nGMKc2IGnoY/,8
16岁跳水奥运冠军 陈芋汐背后的成长经历：《走出荣耀》为您见证,https://www.toutiao.com/group/6990184480505856525/,溪行天下,https://www.toutiao.com/c/user/token/MS4wLjABAAAA0pQymLFTEJznvieJI1cNQl-hfeY0eXEJ2bTm5uXkUbuBoj3QW3YMxjNjrG5M0E18/,7
英国军舰抵达南海，南海舰队严阵以待，面对挑衅中国还可以怎么做,https://www.toutiao.com/group/6990214159535178271/,沐风谈兵论道,https://www.toutiao.com/c/user/token/MS4wLjABAAAAvoSGMw_q3e0FyRkxN_wasXhC2qHx-YIs_7lDQef5ftA/,6
“十分钟”，她们创造中国篮球历史,https://www.toutiao.com/group/6990267676161589771/,中国新闻网,https://www.toutiao.com/c/user/token/MS4wLjABAAAAvOdgu_VhRab2uUfrYPedveCA9KSEdd4AfYLyl9vkh2s/,4
骄傲！第一波奥运金牌“九宫格”齐了！,https://www.toutiao.com/group/6990169450687414795/,网信红桥,https://www.toutiao.com/c/user/token/MS4wLjABAAAA-NXpM5Be05ehebj5Bmyq82HrVH2M1Aoi6E6dkTlRFOY/,4
锐评｜朱婷带伤救球令人心疼，她也许真的应该歇一歇了,https://www.toutiao.com/group/6990185425163780638/,上游新闻,https://www.toutiao.com/c/user/token/MS4wLjABAAAAZJX6PBdhClCDhGa1uMbNzoRbmuKOBGwI6Eo-tVmZpyA/,2
暖心！当救援队离开郑州：居民“野性投喂”，有队员匿名留下1000元,https://www.toutiao.com/group/6990324045896122916/,河南商报,https://www.toutiao.com/c/user/token/MS4wLjABAAAA5OOU8SqIiUYQGySWidV1WjpBTJb7z2UXwLy_G5RdExA/,2
唐山大地震45年，我国地震预警现在如何？,https://www.toutiao.com/group/6990269163658871335/,光明日报,https://www.toutiao.com/c/user/token/MS4wLjABAAAAoU4gUiwhMXddK0UI1XEgPRYH_N1Ce-LdU9wXPmCf3oU/,2
《我是真的爱你》：刘涛又一次证明了自己的演技，还带火一句话,https://www.toutiao.com/group/6989977444652581390/,晓角心语,https://www.toutiao.com/c/user/token/MS4wLjABAAAAPztT5BWrSVBop4xfRh0IAC3i955AitdJpb8PGX55hQHd4tbB6OP9pNCySFCPt8Uz/,2
城市复苏“郑”在重启，公交免费坐，乘客增多了吗？,https://www.toutiao.com/group/6990169450687414795/,河南商报,https://www.toutiao.com/c/user/token/MS4wLjABAAAA5OOU8SqIiUYQGySWidV1WjpBTJb7z2UXwLy_G5RdExA/,1
河北保定：首批援助越南老街市防疫物资完成交接,https://www.toutiao.com/group/6990279522385986087/,保定电视台公共频道,https://www.toutiao.com/c/user/token/MS4wLjABAAAAg-cGo_AwXwayHY_eHe1eklfOOqH_5WwuHj0SHVELPaI/,1
制衣女工逆袭成豪门阔太，骂王祖贤护前儿媳，她比赌王四太运气好,https://www.toutiao.com/group/6990261500799713829/,盖饭人物ThePeople,https://www.toutiao.com/c/user/token/MS4wLjABAAAAkhsrroV99JNDoAbxTbYCbHwA0h8gvCcrG9FIMqjZrPw/,1
跳水冠军张家齐，卸下光环也只是个芭比娃娃不离手的小奶娃,https://www.toutiao.com/group/6989940497737351687/,水冰依666,https://www.toutiao.com/c/user/token/MS4wLjABAAAAQ6ZIo-hrRivtogsrtRmco9GxN8EMx3fOgdw6g4Ar_1M/,1
“吊环王”陈一冰：参加奥运会是运动员一生的追求,https://www.toutiao.com/group/6990303041345831454/,央视网新闻,https://www.toutiao.com/c/user/token/MS4wLjABAAAAaezOXkHVr0_i2JvWXprb4zLGpRInnKStptFm5WsXHKU/,1
狂揽10金，女运动健儿在东京大放异彩，人民日报：中国骄傲,https://www.toutiao.com/group/6990172994395963907/,聪古说球,https://www.toutiao.com/c/user/token/MS4wLjABAAAAvVBx9ycqqO-DHFl0dhGK9cfxhYyolpxsa2CZJIr9xBc/,1
太解气了！“抗日神曲”响彻东京奥运赛场，中国运动员比赛直接放,https://www.toutiao.com/group/6990172994395963907/,玲珑笑癫狂,https://www.toutiao.com/c/user/token/MS4wLjABAAAATlbkGviOwEdMLoLmqNLoXDxaZDR6cLiJl5GCfvJq1bW0TiZl_U0PxeN_-YyzaCza/,1
物业管理：阿克塞县完善基础设施推动物业管理,https://www.toutiao.com/group/6990197128702198303/,阿克塞县融媒体中心,https://www.toutiao.com/c/user/token/MS4wLjABAAAAwjJyi6JDZeTstR7Mg3_zbR_DcnhucViLoOyfJwcllnU/,0
助力灾后复产，河南省计量院免费为企业核查设备性能,https://www.toutiao.com/group/6990261500799713829/,河南商报,https://www.toutiao.com/c/user/token/MS4wLjABAAAA5OOU8SqIiUYQGySWidV1WjpBTJb7z2UXwLy_G5RdExA/,0
人民日报：愿你努力向上，光芒万丈！借此送给考编路上的你,https://www.toutiao.com/group/6989977444652581390/,一起考教师,https://www.toutiao.com/c/user/token/MS4wLjABAAAAf8oVwdiJvlTNj9jx4oUgh3y4oxGFCuGc8YhMAxiFsgo/,0
农村留守儿童心理问题检出率高达57%！如何破题，这家公益组织给出一种答案,https://www.toutiao.com/group/6990290649061065224/,纵相新闻,https://www.toutiao.com/c/user/token/MS4wLjABAAAAHFRrvxdpgb37zZBJ447qNh05FM6tFOjSxWKls4SDn8M/,0
懂车帝在郑州发起车辆免费检测活动，为受灾车主提供理赔维修建议,https://www.toutiao.com/group/6990318699630559758/,河南商报,https://www.toutiao.com/c/user/token/MS4wLjABAAAA5OOU8SqIiUYQGySWidV1WjpBTJb7z2UXwLy_G5RdExA/,0
井研法院马踏法庭：巧变“两案”为“一案”，案结事了促和谐,https://www.toutiao.com/group/6990267676161589771/,四川法治在线,https://www.toutiao.com/c/user/token/MS4wLjABAAAAtoEZARNuMGXUauhOGlcgVOzsy_tiOEGg7MgXBQQKL30/,0
提气！孙颖莎横扫伊藤美诚！中国提前包揽乒乓球女单冠亚军,https://www.toutiao.com/group/6990261500799713829/,浙江在线,https://www.toutiao.com/c/user/token/MS4wLjABAAAA4mel6y6wYnhKgOQOPkJASLH7UqForNYV935WNJuLEe8/,0
甘肃靖远“织女”探索手工草帘产业化 稻草变成“金疙瘩”,https://www.toutiao.com/group/6990220867439428107/,中国新闻网,https://www.toutiao.com/c/user/token/MS4wLjABAAAAvOdgu_VhRab2uUfrYPedveCA9KSEdd4AfYLyl9vkh2s/,0
今年在宁夏购买各种型号拖拉机都补贴多少钱？,https://www.toutiao.com/group/6990246795137843751/,清闲老农刘振营,https://www.toutiao.com/c/user/token/MS4wLjABAAAAxI9tXbvfXwc5OODlyAxkRIlzqpCnACXHrb5IQ8u_v-w/,0
双料冠军杨倩同款发卡爆红，3天卖7万件，网友：买来沾喜气,https://www.toutiao.com/group/6990178013673849376/,中国网,https://www.toutiao.com/c/user/token/MS4wLjABAAAA8QdhBwD7b7Afs1sdZjsw9TkKaqNU1xopqIM_GZzhRSA/,0
“豫”你一起 | 价值约1453万元！12家磷复肥企业捐肥驰援灾区,https://www.toutiao.com/group/6990185425163780638/,中国农资传媒,https://www.toutiao.com/c/user/token/MS4wLjABAAAAs-VbPO0maGFaF65UeyFEN1sIsKQ3LFeJ10g6KMaT3JU/,0
深圳机场国内通航城市超130个，暑运多条航线将加密,https://www.toutiao.com/group/6990290649061065224/,全国党媒信息公共平台,https://www.toutiao.com/c/user/token/MS4wLjABAAAAabHAGA5rwz80RE3cHMbb8luHFKXQoelOhsFetuR7qaM/,0
英国人权律师：美国将病毒溯源政治化意在遏制中国发展,https://www.toutiao.com/group/6990285261942833699/,中国网,https://www.toutiao.com/c/user/token/MS4wLjABAAAA8QdhBwD7b7Afs1sdZjsw9TkKaqNU1xopqIM_GZzhRSA/,0
河北昌黎15万亩马铃薯喜获丰收,https://www.toutiao.com/group/6990249763912401445/,中国新闻网,https://www.toutiao.com/c/user/token/MS4wLjABAAAAvOdgu_VhRab2uUfrYPedveCA9KSEdd4AfYLyl9vkh2s/,0
中国共产党永宁县李俊镇第十四次代表大会召开,https://www.toutiao.com/group/6990178769294066207/,永宁县融媒体中心,https://www.toutiao.com/c/user/token/MS4wLjABAAAA7kS1m3H7QweMXM3TNdyyUtXgHY2ZxjyED9rt_4H3R5M/,0
复工复产进行时！郑州“万人助万企”16个工作组发挥作用：帮企业把损失降到最低,https://www.toutiao.com/group/6990238671802892837/,河南商报,https://www.toutiao.com/c/user/token/MS4wLjABAAAA5OOU8SqIiUYQGySWidV1WjpBTJb7z2UXwLy_G5RdExA/,0
国乒女单力争金牌 中国女排迎关键一战,https://www.toutiao.com/group/6990288257569489440/,武山融媒,https://www.toutiao.com/c/user/token/MS4wLjABAAAA8V45Poc6aK5B2yD6zAyw5GD29bMeilGhuC0k62pCbSo/,0
福利丨“烟花”过后畅享运动快乐，20张免费泳票等你领,https://www.toutiao.com/group/6990261500799713829/,上观新闻,https://www.toutiao.com/c/user/token/MS4wLjABAAAAeHqVsTegZ0A1OdSMWlhicOHkMPB3sucVywH_wxPA4Pw/,0
"郑州谢谢你！全国3000多名网友线上支援""郑州救援""，一女孩儿4天只睡14个小时",https://www.toutiao.com/group/6990318699630559758/,河南商报,https://www.toutiao.com/c/user/token/MS4wLjABAAAA5OOU8SqIiUYQGySWidV1WjpBTJb7z2UXwLy_G5RdExA/,0
学日本男星阴阳怪气？这一条微博太打脸了,https://www.toutiao.com/group/6990246795137843751/,野兽派娱乐,https://www.toutiao.com/c/user/token/MS4wLjABAAAA4kB_vohMygrOBOKlkKDxrctTXAgftFeO_2qyKK8duMo/,0
投身军营，淬炼最刚毅的青春,https://www.toutiao.com/group/6990303041345831454/,光明日报,https://www.toutiao.com/c/user/token/MS4wLjABAAAAoU4gUiwhMXddK0UI1XEgPRYH_N1Ce-LdU9wXPmCf3oU/,0
“巴铁”导游：在卡拉奇开车半小时 只为给中国游客买杯当地新鲜椰汁,https://www.toutiao.com/group/6990315143649624612/,中国经济网,https://www.toutiao.com/c/user/token/MS4wLjABAAAAX48WhqFh4ZlMkKgEZnGBoXUx0zeI5BcDWJ4OzPJGSPc/,0
感兴趣的小伙伴可以试一试，这算是中等难度的爬虫了。理解了会很有帮助。
