Problem is that I have modified the robot agreement setting to False, then the user-agent changed, can be regarded as normal server access, then I open the CMD running, climbing after data with scrapy shell scraping I want data operation, actually see is an empty list, (in py climbed over the entire web page data, found that the data is not what I want) estimation is being recognized, or what's the problem? Busy see thank you hope to have a big package,
