Launching today
Sitemap Sniffer
Find sitemap files and URL lists from any public site
6 followers
Find sitemap files and URL lists from any public site
6 followers
Sitemap Sniffer finds public sitemap files from website roots, domains, robots.txt files, direct sitemap URLs, and sitemap indexes. It exports sitemap metadata, URL counts, nested index depth, and optional URL inventory rows for SEO audits and crawler planning.
Would love to see a way to schedule recurring crawls and diff the results over time so I can spot newly added or dropped URLs between audits without running it manually each week.
Tried it on a few sites and it picked up nested sitemap indexes I didn't even know existed, which is honestly pretty handy for audits. The URL inventory export saves me from crawling manually.
Tried it on a couple of sites and the depth map was honestly more useful than I expected. Liked that it pulled from robots.txt without me having to dig around.
Ran it on a few sites I audit and the robots.txt discovery actually picked up sitemaps I didn't know existed, which is the whole point of a tool like this. Clean export, no fluff.
Love how it surfaces nested index depth alongside URL counts, makes crawler planning way less guesswork. Clean execution on something that's usually a mess of manual checks.