There is demand will scrapy requests and parse separate, request the entire page in mysql, responsible from mysql will parse section.
Question:
Analytical part is rewriting a spiders, web pages from the MySQL mentioned local, requests for local spiders after parsing, or write a py file parsing.
(1) : rewrite the spiders can use previous item pipeline for storage more convenient
(2) : write py files, you can return to the item into the item pipeline for storage? No spiders, whether the item pipeline may not be able to use