老师 我调试lagou itemloder的时候,console上显示Invalid cookie found in request
来源:7-7 职位数据入库-1
我的可乐说
2020-10-15
老师 我调试lagou itemloder的时候,console上显示
020-10-15 09:26:59 [selenium.webdriver.remote.remote_connection] DEBUG: Finished Request
2020-10-15 09:27:02 [scrapy.downloadermiddlewares.cookies] WARNING: Invalid cookie found in request <GET https://www.lagou.com/>: {‘name’: ‘PRE_UTM’, ‘value’: ‘’} (‘value’ is missing)
2020-10-15 09:27:02 [scrapy.downloadermiddlewares.cookies] WARNING: Invalid cookie found in request <GET https://www.lagou.com/>: {‘name’: ‘PRE_SITE’, ‘value’: ‘’} (‘value’ is missing)
2020-10-15 09:27:02 [scrapy.downloadermiddlewares.cookies] WARNING: Invalid cookie found in request <GET https://www.lagou.com/>: {‘name’: ‘PRE_HOST’, ‘value’: ‘’} (‘value’ is missing)
2020-10-15 09:27:02 [scrapy.downloadermiddlewares.cookies] DEBUG: Sending cookies to: <GET https://www.lagou.com/>
然后后面就显示
2020-10-15 09:28:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://www.lagou.com/utrack/trackMid.html?f=https%3A%2F%2Fwww.lagou.com%2Fgongsi%2Fj505463.html&t=1602725287&_ti=1>
也没有进入我的parse_job里面就运行结束了
老师这是怎么回事
1回答
-
我的可乐说
提问者
2020-10-15
老师 我换了新的IP,设置了DOWNLOAD_DELAY = 10, RANDOMIZE_DOWNLOAD_DELAY = True还是这样,不能进入parse_job,显示302 到utrack
032020-10-19
相似问题