Robots.txt Tester
Test robots.txt rules locally against a URL path and user agent.
Why use this tool?
Test robots.txt rules locally against a path to determine Allow or Disallow.
Test robots.txt rules locally against a URL path and user agent.
Test robots.txt rules locally against a path to determine Allow or Disallow.