I am using HttpClient
Not logged in, no setting cookies, no set Referer
Set the UA, and proxy IP, UA and high unseen proxy IP (west stab agents) are random, random wait time is 0 to 3 s
Program has five threads at the same time crawl
But the program is running after a period of time, probably after he climbed more than 3000 data
We won't be able to access a page that HttpClient are empty return
Have a five or six hours IP unlock
Someone climbed douban, or is there any project climb in douban can recommend me, I went to see