Oriel — AI & technology worth noticing, every day.

Benchmarking Bot Detection Systems Against Modern AI Agents in 2026

Web page · https://research.poh.org/bot-benchmarking-2026

First seen by Oriel on .

AI summary

The benchmark finds detection rates vary widely across five systems, with Proof of Human identifying 99% of automated sessions while several systems struggled against vision-capable AI agents.

  • Researchers ran five adversaries through a five-question survey 20 times each, producing 89 to 100 evaluable sessions per detection system.
  • Aggregated detection rates were 69.4% for Google reCAPTCHA v3, 44.3% for hCaptcha, 42.1% for Cloudflare Turnstile, and 9.1% for Cloudflare Bot Management.
  • hCaptcha and Cloudflare Turnstile caught nearly all scripted-browser sessions but few AI-agent sessions; reCAPTCHA v3 detected most agents but missed CloakBrowser.
  • The AI agents generally solved hCaptcha image challenges, while Cloudflare Turnstile issued no challenges to those agents.
  • The study used non-enterprise product tiers, did not measure false positives among humans, and notes results could change with longer-running site reputation data.

#bot detection #browser automation #ai agents #captcha

Generated by gpt-5.6-sol. Check the original for details.

Metric trends

Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained

Points

Score reported by the source.

  • Hacker News: 47, latest observation ; +43 over observed period since

Comments

Comment count reported by the source.

  • Hacker News: 8, latest observation ; +8 over observed period since

Aliases

SourceExternal IDURL
Hacker News50169506https://research.poh.org/bot-benchmarking-2026/ Read discussion