Home > other >  Scrapy crawler for flip operation occurs when the url change???????
Scrapy crawler for flip operation occurs when the url change???????

Time:02-25

I think I can crawl a ak47 in csgo market price program, crawl content is quite well, but when paging up operating out of the question, regardless of the page which the final url will become:
https://steamcommunity.com/market/search? Q=& amp; Category_730_ItemSet % 5 b % 5 d=any& Category_730_ProPlayer % 5 b % 5 d=any& Category_730_StickerCapsule % 5 b % 5 d=any& Category_730_TournamentTeam % 5 b % 5 d=any& Category_730_Weapon % 5 b % 5 d=tag_weapon_ak47 & amp; Category_730_Exterior % 5 b % 5 d=tag_WearCategory0 & amp; Category_730_Quality % 5 b % 5 d=tag_normal & amp; Appid=730


Even start_urls changed



The complete code:





  • Related