Skip to content

Crawl

XML sitemap

An XML file listing the URLs you want crawlers to discover and prioritize.

Definition

Defined by sitemaps.org. Lives at any URL referenced from robots.txt, conventionally /sitemap.xml. Each entry lists a URL and optional metadata (lastmod, changefreq, priority). On large sites, a sitemap index references multiple sub-sitemaps. Sitemaps are a hint, not a guarantee — Google may still skip URLs.

See also

Need this concept applied to your stack?

Glossary entries are intentionally short. Real engineering tradeoffs need a scoping call — bring the domain, the stack, and the question.