The function of a module like spiders, my approach is to create the five threads, are stored in each thread a CInternetSession object, in the thread calls the function sends an HTTP request, pass into the CInternetSession object (note that this object is passed in, I found this crawling like high efficiency, because to avoid the repeated to create CInternetSession object, but now there's a very tricky problem, is sometimes after sending HTTP requests have been suspended animation, finished is not an error, I want to ask you encountered such a problem, and realize the crawler with what technologies,

CodePudding user response:

And I have set up 2 seconds of overtime time, I read online the brethren, and said, this timeout feature of this class looks a little BUG,

CodePudding user response:

Refer to
WebCHM (original WebSeizer beta)

CodePudding user response:

refer to the second floor zhao4zhong1 response:

referenceWebCHM (original WebSeizer beta)

Miss zhao