Robots.txt + Sitemap Analyzer
Check crawler instructions and XML sitemaps.
How to use this tool
- Enter the URL of a public webpage or website.
- Run the check and review critical, warning and passed findings.
- Verify important changes in your own site and search-console property.
Important limitation
Check crawler instructions and XML sitemaps.
Read our methodology →