Home > other >  Scrapy crawler path
Scrapy crawler path

Time:01-01

Excuse me, I want to use scrapy crawl weibo commenters net xpath how to write?


Weibo news website: https://weibo.com/1642591402/JAPmR7TNO? The filter=hot& Root_comment_id=0 & amp; Type=comment

The net of the full xpath:
/HTML/body/div [1]/div/div [4]/div/div [2]/div [1]/div/div/div/div/div [4]/div/div [2]/div [2]/div/div/div [1]/div [2]/div [1], a [1]

The net of xpath:
//* [@ id="pl_unlogin_home_leftnav"]/div/ul/div [2]/li/a

This is the project code, tried a lot before, out empty


CodePudding user response:

Comments are generally asynchronous loading,
Here reviews interface is the following:

https://weibo.com/aj/v6/comment/big? Ajwvr=6 & amp; Id=4587772691882804 & amp; The from=singleWeiBo& __rnd=1609377161102

CodePudding user response:

Could you tell me how to get the interface address is?
  • Related