影刀抖音评论爬取
回答
收藏

影刀抖音评论爬取

坚持123
2025-07-02 11:19·浏览量:343
坚持123
影刀专家
发布于 2025-07-02 11:19343浏览

1、采用http请求访问

2、已寻找到对应的URL,请求体

3、评论的URL 中的cursor、count可设置爬取的页数以及条数,但是想通过定义cursor为变量去循环遍历时,发现URL自a_bogus后面的变量也不一样,但是只保留a_bogus之前的是无法访问网页的,请教一下如何解决

URL举例:

第一条: https://www.douyin.com/aweme/v1/web/comment/list/?device_platform=webapp&aid=6383&channel=channel_pc_web&aweme_id=7514258313094270243&cursor=0&count=5&item_type=0&whale_cut_token=&cut_version=1&rcFT=&update_version_code=170400&pc_client_type=1&pc_libra_divert=Windows&support_h265=1&support_dash=1&cpu_core_num=16&version_code=170400&version_name=17.4.0&cookie_enabled=true&screen_width=1440&screen_height=900&browser_language=zh-CN&browser_platform=Win32&browser_name=Chrome&browser_version=138.0.0.0&browser_online=true&engine_name=Blink&engine_version=138.0.0.0&os_name=Windows&os_version=10&device_memory=8&platform=PC&downlink=1.35&effective_type=3g&round_trip_time=350&webid=7522015867228587520&uifid=1b474bc7e0db9591e645dd8feb8c65aae4845018effd0c2743039a380ee647408f2173f2dae2d5ce8bdf813ff349e484b5a415befc3cfcd0e44632fc795b8fd649b3f1f634d2386766e169dca8ad14d612a194c414f481dde4e042de628d9efd0ce883811a7da9b9e852920a51f88a97fef68f5e27a62d85710ac97d60976a063dd2a6db65b5810be0d7554aaa603bfa4adb3b46867b156ebaead04c5d54430a&verifyFp=verify_mck813np_HSg7UlPT_s5Lw_4425_9wp1_QWJ3ns2UkDIJ&fp=verify_mck813np_HSg7UlPT_s5Lw_4425_9wp1_QWJ3ns2UkDIJ&msToken=qEN9U-xnL8xin7AJVaom7QNB-4d2T_5hMrmkoburdxERtClNuka5gwNXbGmTiXTpZrtHJQbC-AS_WmLhnn68CJU_0wVLqjXylK1wHGf8onTCPKU_-8VfxxVq-rvbzZPuEcG6pOv1KMIy46hfFFkByYecVB6EjAXRIKgoVXFSx-9O&a_bogus=Dys5hzyEDx5VPdKbuKJ09jOl88xMNTSysrToSyNTHNYBGHtcFbPjknc3axuQszu8YSpzhC1HPjlMYDncKGXkZorpFmpfuOJ6%2FG%2F590mL8qq6YMisgqgNCLmzFw0CWcsLeACSEl45IsMxZdclVr5mlQVGy5zH-YbpWrZSdMYyGDSUpB6TIxdtC3jAr1j%3D&x-secsdk-web-expire=1751423348186&x-secsdk-web-signature=b4a589ed96071d1bf35909affb81706a

第二条:https://www.douyin.com/aweme/v1/web/comment/list/?device_platform=webapp&aid=6383&channel=channel_pc_web&aweme_id=7514258313094270243&cursor=5&count=10&item_type=0&whale_cut_token=&cut_version=1&rcFT=&update_version_code=170400&pc_client_type=1&pc_libra_divert=Windows&support_h265=1&support_dash=1&cpu_core_num=16&version_code=170400&version_name=17.4.0&cookie_enabled=true&screen_width=1440&screen_height=900&browser_language=zh-CN&browser_platform=Win32&browser_name=Chrome&browser_version=138.0.0.0&browser_online=true&engine_name=Blink&engine_version=138.0.0.0&os_name=Windows&os_version=10&device_memory=8&platform=PC&downlink=1.35&effective_type=3g&round_trip_time=350&webid=7522015867228587520&uifid=1b474bc7e0db9591e645dd8feb8c65aae4845018effd0c2743039a380ee647408f2173f2dae2d5ce8bdf813ff349e484b5a415befc3cfcd0e44632fc795b8fd649b3f1f634d2386766e169dca8ad14d612a194c414f481dde4e042de628d9efd0ce883811a7da9b9e852920a51f88a97fef68f5e27a62d85710ac97d60976a063dd2a6db65b5810be0d7554aaa603bfa4adb3b46867b156ebaead04c5d54430a&verifyFp=verify_mck813np_HSg7UlPT_s5Lw_4425_9wp1_QWJ3ns2UkDIJ&fp=verify_mck813np_HSg7UlPT_s5Lw_4425_9wp1_QWJ3ns2UkDIJ&msToken=qEN9U-xnL8xin7AJVaom7QNB-4d2T_5hMrmkoburdxERtClNuka5gwNXbGmTiXTpZrtHJQbC-AS_WmLhnn68CJU_0wVLqjXylK1wHGf8onTCPKU_-8VfxxVq-rvbzZPuEcG6pOv1KMIy46hfFFkByYecVB6EjAXRIKgoVXFSx-9O&a_bogus=m60VhzULYx%2Fccd%2Fb8cae9-CUplfMrTuyzpi%2FSK%2FP7POOTHUOdbPfhaa3jxFPBMK8YuBwhe3H4neAYdxcOGUwZKnkKmpvSsUbOz2c98mL0qwXb0vsEqgPCumzowsCWRGLe%2F9yEIW5Xs0n1EQl9H5uld1GH5z9BmYpWHZWd%2FT9bDC0psyTV9QSe5LW51L%3D&x-secsdk-web-expire=1751423353263&x-secsdk-web-signature=9df5eba4f068d51f7262f8f86c0d0445


收藏
全部回答1
最新
发布回答
回答