My code is shown in figure 1, when phone_url repeat, other data have to be repeated, figure 2 is the content of the crawl

CodePudding user response:

Repetition is buggy repetitive or normal, normal repeat use redis to heavy

CodePudding user response:

reference 1/f, ice all over the sky the wind response:

repetition is buggy repetitive or normal, normal repeat use redis to heavy

Is that if the two pages phone_text is the same, will lead to a page to access the page instead of behind the data, resulting in repeated data