Benchmarking Bot Detection Systems Against Modern AI Agents in 2026
Web page · https://research.poh.org/bot-benchmarking-2026
First seen by Oriel on .
AI summary
The benchmark finds detection rates vary widely across five systems, with Proof of Human identifying 99% of automated sessions while several systems struggled against vision-capable AI agents.
- Researchers ran five adversaries through a five-question survey 20 times each, producing 89 to 100 evaluable sessions per detection system.
- Aggregated detection rates were 69.4% for Google reCAPTCHA v3, 44.3% for hCaptcha, 42.1% for Cloudflare Turnstile, and 9.1% for Cloudflare Bot Management.
- hCaptcha and Cloudflare Turnstile caught nearly all scripted-browser sessions but few AI-agent sessions; reCAPTCHA v3 detected most agents but missed CloakBrowser.
- The AI agents generally solved hCaptcha image challenges, while Cloudflare Turnstile issued no challenges to those agents.
- The study used non-enterprise product tiers, did not measure false positives among humans, and notes results could change with longer-running site reputation data.
#bot detection #browser automation #ai agents #captcha
Generated by gpt-5.6-sol. Check the original for details.
Metric trends
Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained
Points
Score reported by the source.
- Hacker News: 47, latest observation ; +43 over observed period since
Comments
Comment count reported by the source.
- Hacker News: 8, latest observation ; +8 over observed period since
Aliases
| Source | External ID | URL |
|---|---|---|
| Hacker News | 50169506 | https://research.poh.org/bot-benchmarking-2026/ Read discussion |