Your files stay on your device

# robots.txt Tester

Paste-in rules with RFC 9309 longest-match verdicts per path.
Clearrobots.txt contentUser agent

Exact match first, then * groups (RFC 9309).
Paths (one per line)

Longest matching rule wins; allow wins ties.

Paste a robots.txt and a path list: the tester implements longest-match with wildcards and $ anchors.
Nothing in yet

Paste, drop, or type to begin. Everything stays on this device.

## Next door in Web

- [Open Graph Preview](/web/og-preview)
- [HTTP Header Parser](/web/headers)
[All web tools](/web)

---

Canonical HTML: https://nutter.tools/web/robots
Markdown version: https://nutter.tools/web/robots/index.md
Plain-text version: https://nutter.tools/web/robots/index.txt
Agent index: https://nutter.tools/llms.txt