Home > other >  How pyspider crawl using CAS certification web site
How pyspider crawl using CAS certification web site

Time:10-02

Company internal project with a service within the monitoring page want to use the crawler to obtain state, but the service management page using the CAS certification (general principle is to intercept access request, determine whether a user token, if not or have but token has expired is redirected to the login screen, when login login interface is completed, will return within the corresponding with a certification by the cookie token, and then redirected to the originally trying to access the address, rejudge)

The main problem is that if the token cookie death to write because the CAS periodically invalidate certification principle, death is invalid, look to whether can have a good method to write every time in pyspider implementation crawl the page automatically get a new token cookie?

CodePudding user response:

If the cas certification without the climb, it also the login interface to do the login
  • Related