Your XML sitemap should list only the URLs you want indexed: canonical pages that return a 200 status and are not blocked or marked noindex. Leave out redirects, error pages, duplicates and anything you do not want in search. A clean sitemap helps search engines trust it as a guide to your best pages.
Include these
- Canonical, indexable pages that return a 200 status.
- Important pages you want found, even if they are new.
- Pages that are linked from your site, since a sitemap supports good internal linking rather than replacing it.
Leave these out
- URLs that redirect elsewhere.
- Pages returning 404 or other errors.
- Pages with a noindex tag.
- Non-canonical duplicates, such as parameter versions.
- Thin or utility pages, such as internal search results.
Not sure if this is hurting your site?
Get the fixes that matter most, in priority order.
Why mixed signals hurt
If you list a page in the sitemap but tell search engines not to index it, you send contradictory instructions. Over time this can make the file less useful as a signal and creates noise in Search Console reports. For the difference between these controls, read noindex vs canonical vs robots.txt.
How to audit your sitemap
- Download the sitemap and list every URL.
- Check status codes in bulk, or sample them with the redirect and status code checker.
- Remove or fix anything that is not a clean 200.
- Validate the file with the sitemap validator.
Let the CMS keep it current
Most platforms generate sitemaps automatically. Review the settings so noindex pages and utility sections are excluded. If you need to build one by hand, use the XML sitemap generator.
Frequently asked questions
Should orphan pages go in the sitemap?
Include valuable ones, but also link to them. See how to find and fix orphan pages.
Will a page missing from the sitemap be ignored?
No. Search engines also find pages through links.
Next steps
If your sitemap lists problem URLs, contact me here for an indexing review.
More in this series (XML sitemap questions): start with Free XML Sitemap Generator, then explore:
- XML Sitemap Size Limits and When to Use a Sitemap Index
- Sitemap Lastmod, Priority and Changefreq: Which Tags Matter?
- Image, Video and News Sitemaps: When Do You Need Them?
- Sitemap Could Not Be Fetched in Search Console: Causes and Fixes
Request received
Thank you! Saad will contact you within the next 24 hours.
Keep an eye on your phone and inbox.
