Home › Guides › Sitemap URL inventory for a docs blog

Sitemap URL inventory for a docs blog: part 2 of 2

The second half (alphabetical) of the same run. Compare pathDepth and changefreq across posts to spot inconsistent sitemap settings.

The data (6 real rows)

urlpathGrouppathDepthchangefreqpriorityisDuplicate
https://crawlee.dev/blog/crawlee-for-python-v05/blog2weekly0.5False
https://crawlee.dev/blog/crawlee-for-python-v06/blog2weekly0.5False
https://crawlee.dev/blog/crawlee-for-python-v1/blog2weekly0.5False
https://crawlee.dev/blog/crawlee-python-price-tracker/blog2weekly0.5False
https://crawlee.dev/blog/crawlee-v3-16/blog2weekly0.5False
https://crawlee.dev/blog/crawlee-v3-18/blog2weekly0.5False

Rows come from the free sample file for this actor, not a full run. Long values are shortened and personal contact fields are left out. Source: apify-actor-samples/sitemap-link-inventory.

How to get this yourself

  1. Open the Every URL in a sitemap, with an optional broken-link check actor on Apify.
  2. Give a site; get URLs from sitemaps with lastmod, depth and flags, and optionally status checks.
  3. Run it, then export the dataset as CSV, JSON or Excel from the results tab.

Limits, stated plainly

Sites without a sitemap return little. This page shows a small sample, so counts here say nothing about the whole dataset.

Run it on Apify   About this actor

Disclosure: we build and maintain this actor.

Related

This actor

Data and schema

Comparison

Guides with real sample rows from this actor

More in websites, seo and tech

Some links are affiliate links.