Sitemapx production site map, catch up links after less than real links, site has 300 + can be normal access links, but sitemapx catch up to 50 or so, only by fetching links I look at the page is basically a section of the first page, such as information page was grabbed the first page of the article, but the second page, third page articles are not grab, do not know why, at a great god help to look at, solve direct messages after a red envelope,

CodePudding user response:

Grabbing a Sitemap with this online | Merkle until after home page loaded in the input domain name grab