Your files stay on your device robots.txt Tester Paste-in rules with RFC 9309 longest-match verdicts per path. Clearrobots.txt contentUser agent Exact match first, then * groups (RFC 9309). Paths (one per line) Longest matching rule wins; allow wins ties. Paste a robots.txt and a path list: the tester implements longest-match with wildcards and $ anchors. Nothing in yet Paste, drop, or type to begin. Everything stays on this device. Next door in Web - Open Graph Preview (/web/og-preview) - HTTP Header Parser (/web/headers) All web tools (/web) Canonical HTML: https://nutter.tools/web/robots Markdown version: https://nutter.tools/web/robots/index.md Plain-text version: https://nutter.tools/web/robots/index.txt Agent index: https://nutter.tools/llms.txt