Home > other >  Python crawler, please switch proxy IP redirection or after 10060100 61 error is how to return a res
Python crawler, please switch proxy IP redirection or after 10060100 61 error is how to return a res

Time:02-08

When I was in crawl site is using a proxy IP, tend to be the first agent can very well the request of the web and get the data, but once in a proxy IP, redirect or 10060100, 61 and other mistakes, but I set an IP to a browser proxy to open the web site without any problems, I try to find whether there are IP authentication mechanisms, but I find that with cookies and headers or without cookies and headers can be smoothly ask web pages, and are free to link to a page that open the browser, but in the entire website, only a post request and an encryption parameter, the other is the get Ming is transmitted and, above all, I ruled out network and proxy IP, the issues that led to the attempt failed also ruled out the cookies and headers to check the problem, now I can't find where the problem is completely, is there who can help me to solve, grateful!