Nutter Tools
Nutter Tools

A free toolbox that runs in your browser. A tool for every job.

Your files never leave your device

Images

  • Convert images
  • Compress images
  • Resize images
  • Crop
  • Watermark

PDF & files

  • Merge PDFs
  • Split a PDF
  • Images to PDF
  • PDF to images
  • Remove photo location

Video & audio

  • Compress video
  • Convert video
  • Video to GIF
  • Convert audio
  • Trim audio

Everyday

  • QR codes
  • Passwords
  • Time zones
  • Unit converter
  • Word count
  • Webcam test

Developer

  • JSON formatter
  • Base64
  • Regex tester
  • Hashes
  • JWT decoder

Site

  • About
  • Contact
  • Settings
  • Privacy
  • Terms
  • Site map
  • llms.txt

Everyday

  • Images
  • Video
  • Audio
  • PDF & files
  • Text
  • QR codes
  • Units & math
  • Time & dates
  • Color
  • Passwords & IDs
  • Device tests
  • Sun & moon

For developers

  • JSON
  • Encoding
  • Regex & cron
  • Web & auth
  • Hashing & encryption
  • Config files
  • Network
  • Browser
  • AI
  • Fake data
© Nutter Toolsnutter.tools
  1. Home
  2. Web & auth
  3. AI crawler access checker
Your files stay on your device

AI crawler access checker

Paste a robots.txt and see per-crawler access verdicts for search indexers, AI training crawlers and assistant fetchers.

This tool is in beta

Still being tested. If a result looks wrong, tell us.

Report a problem

Paste a robots.txt file to see each crawler's verdict.

Verdicts come from matching your pasted rules against a catalogue of crawler tokens each operator documents, grouped by purpose: search indexers, AI training crawlers, and assistant fetchers. Matching follows RFC 9309: tokens compare case-insensitively, all groups naming the same token combine, the longest rule wins, and an equal-length Allow beats a Disallow. This is what your file says, not what any crawler does: a bot can ignore robots.txt or send a token you do not expect, and blocking Google-Extended or Applebot-Extended does not stop Googlebot or Applebot from crawling. The catalogue only contains tokens the operators publish, so a crawler you block by an undocumented token will not appear here.

robots.txt

The robots.txt you publish
One per line, up to 50. Blank means the root path.

Nothing is fetched. Up to 256K of robots.txt per run.

More web & auth tools

  • robots.txt tester
  • AI robots policy
  • Open graph preview
All web & auth tools

Was this tool useful?