///// Checks / Readability
robots.txt agent-user policy
Whether robots.txt permits the agents that fetch pages for a user, such as ChatGPT-User and Claude-User.
- Check id
robots-agent-user-policy- Pillar
- Readability
- Runs in
- The free CLI
- Scoring
- Up to 2 points
- Status
- Pre-release, in calibration
Why it matters
It's your declared policy for agents acting on someone's behalf.
How to pass
Leave them allowed, or add explicit Allow rules for them.
Run it
Find robots-agent-user-policy in the report. Add --md for a fix prompt you can paste into Claude Code, Codex or Cursor.