Home › Websites, SEO and tech › Every URL in a sitemap, with an optional broken-link check
Who it is for: SEO and migration teams.
Before a migration you need the full URL inventory.
Give a site; get URLs from sitemaps with lastmod, depth and flags, and optionally status checks.
| site | url | pathGroup | pathDepth |
|---|---|---|---|
| crawlee.dev | https://crawlee.dev/blog | /blog | 1 |
| crawlee.dev | https://crawlee.dev/blog/archive | /blog | 2 |
| crawlee.dev | https://crawlee.dev/blog/authors | /blog | 2 |
Sites without a sitemap return little.
Pay per result on Apify, no subscription. The live price is on the actor page.
Disclosure: we build and maintain this actor.
Data and schema
Comparison
Guides with real sample rows from this actor
More in websites, seo and tech
Some links are affiliate links.