Free Tool
Robots.txt Checker
See exactly what search engines are allowed to crawl - and catch the one stray Disallow rule that can hide your whole site from Google.
Runs from our servers with polite, robots-respecting requests. Part of the full Site Scanner.
Not sure what your robots.txt should say?
We set up clean, correct robots and sitemaps for every site we build - and fix broken ones fast. Free quote.
Get my free quote