老师 我调试lagou itemloder的时候,console上显示Invalid cookie found in request

来源:7-7 职位数据入库-1

我的可乐说

2020-10-15

老师 我调试lagou itemloder的时候,console上显示
020-10-15 09:26:59 [selenium.webdriver.remote.remote_connection] DEBUG: Finished Request
2020-10-15 09:27:02 [scrapy.downloadermiddlewares.cookies] WARNING: Invalid cookie found in request <GET https://www.lagou.com/>: {‘name’: ‘PRE_UTM’, ‘value’: ‘’} (‘value’ is missing)
2020-10-15 09:27:02 [scrapy.downloadermiddlewares.cookies] WARNING: Invalid cookie found in request <GET https://www.lagou.com/>: {‘name’: ‘PRE_SITE’, ‘value’: ‘’} (‘value’ is missing)
2020-10-15 09:27:02 [scrapy.downloadermiddlewares.cookies] WARNING: Invalid cookie found in request <GET https://www.lagou.com/>: {‘name’: ‘PRE_HOST’, ‘value’: ‘’} (‘value’ is missing)
2020-10-15 09:27:02 [scrapy.downloadermiddlewares.cookies] DEBUG: Sending cookies to: <GET https://www.lagou.com/>
然后后面就显示
2020-10-15 09:28:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://www.lagou.com/utrack/trackMid.html?f=https%3A%2F%2Fwww.lagou.com%2Fgongsi%2Fj505463.html&t=1602725287&_ti=1>
也没有进入我的parse_job里面就运行结束了
老师这是怎么回事

图片描述
图片描述

写回答

1回答

我的可乐说

提问者

2020-10-15

老师 我换了新的IP,设置了DOWNLOAD_DELAY = 10, RANDOMIZE_DOWNLOAD_DELAY = True还是这样,不能进入parse_job,显示302 到utrack

0
3
bobby
回复
我的可乐说
加你了
2020-10-19
共3条回复

Scrapy打造搜索引擎 畅销4年的Python分布式爬虫课

带你彻底掌握Scrapy,用Django+Elasticsearch搭建搜索引擎

5796 学习 · 6290 问题

查看课程