Robots.txt Checker
Paste or upload your robots.txt and check it for syntax errors and common mistakes.
Advertisement space
Frequently asked questions
- Yes, completely free with no signup or usage limit.
- No — browsers can't fetch arbitrary cross-origin URLs for this kind of check. Paste the file's contents, or upload it, instead.
- Directive syntax, User-agent ordering, valid Sitemap URLs, and Crawl-delay formatting, plus a few common mistakes like paths not starting with a slash.