Home > Back-end >  Help me to write the crawler was found to lead to the browser can on how to break
Help me to write the crawler was found to lead to the browser can on how to break

Time:11-02

Forgot to set the time delay, and the results been closed, really want to use the agent yet ~

CodePudding user response:

Which website? Count word count

CodePudding user response:

I climb is doyouhike net, good malicious the IP directly to sealing the ~

CodePudding user response:

Somebody else worth data, don't let up casually,

CodePudding user response:

Single IP access frequently, blocking access will be set a period of time,
If your site added this restriction, so you may want to buy a proxy IP, assign each IP access frequency,

CodePudding user response:

I was climbing the somebody else's site directly DOMN machine, then the other set up the crawler technology, it may not be able to climb
  • Related