Home > other >  Scrapy splash crawler problems
Scrapy splash crawler problems

Time:02-04

When I climbed in ctrip's problem is that page, get to the next page, referer to the previous page, there is no data, setting ROBOTSTXT have comments, I think that using random request header can solve, but did not, ask your bosses to look at!!!!!!!!!!!!!!!!!!! Link: https://vacations.ctrip.com/list/whole/sc1.html? St=% E5 E8 A8 % % % 91% BE % B9 & amp; Startcity=1 & amp; Sv=% E5 E8 A8 % % % 91% BE % B9

  • Related