Home > other >  For help, remote close links to do
For help, remote close links to do

Time:10-09

Recently study method of a novel materials crawl sites on the Internet search the solution of what all have no, is there to save

 the req=urllib. Request. The request (url=novel_url, headers=headers) 
Request=urllib. Request. Urlopen (the req)
HTML=LXML. HTML. Parse (request)
Hrefs=HTML. Xpath ('//dd/a/@ href)
For href in hrefs [16:] :
Chapter_url_list. Append (urllib. Parse. Urljoin (novel_base_url href))
Print (chapter_url_list)
  • Related