CodePudding user response:
Basic grammar to learn Python first, then go to learn about web crawler, recommend learning Python library of requests, you have to do this is by the crawler simulation the network request you rob buildingCodePudding user response:
I don't know, ask your teacherCodePudding user response:
ddddddCodePudding user response:
Background: rob building software really belongs to the crawler technology,1. Understand the crawler technology basic logic: internal page loading logic analysis first, and then we will go to code is used to implement
2. The code to implement, and the core points three steps: download, extract, preservation,
You here corresponds to a: download and submit a POST request implementation class POST replies of floor,
Suggest you:
Look at my first:
Crawl data: you want the crawler technology
Understand basic logic after
Go with the Chrome developer tools, to analyze the internal logic of B stand post
Go to reference:
How to written in Python crawler
To use Python implementation specific logic
Specific network library, recommend mentioned (others) requests
After finish, if still don't understand, you can reference I give specific examples (detailed explanation to each step in detail screenshots)
Grab baidu how hot list, written in Python crawler
As well as concrete implementation (including requests) :
Use a third-party library, grab baidu hot list, how to written in Python crawler
After watching, you will understand about logic and how to implement the
The remaining mainly by yourself: logic analysis, with a python implementation logic,
CodePudding user response: