Oriel — AI & technology worth noticing, every day.

Cross-request KV cache exposure in the GLM-5.3 Workers AI model (155 responses)

Web page · https://blog.cloudflare.com/kv-cache-exposure-remediation

A configuration mismatch in GLM 5.3 on Workers AI triggered an SGLang bug that exposed KV cache pages across requests. Here is how we addressed the issue.

First seen by Oriel on .

AI summary

Cloudflare reports that an SGLang bug combined with an undersized KV cache pool exposed data across GLM-5.3 Workers AI requests, and describes remediation and broader hardening.

  • From August 27 to September 9, 2026, 155 responses to prompts longer than 681,280 tokens contained data from other customers; Cloudflare found no evidence of deliberate exploitation.
  • The model's context window was 1,048,576 tokens, but its prefill KV pool held 681,280; rejected requests were treated as live in disaggregated prefill/decode mode.
  • Decode reserved pages for the full prompt, while prefill wrote only a one-token placeholder and signaled transfer completion, leaving stale KV pages readable during generation.
  • Cloudflare increased the pool to about 2.04 million tokens, patched rejection handling, and added deployment checks; it also applied broader KV lifetime and transfer hardening.
  • Cloudflare recommends operators using disaggregated SGLang update to v0.5.22 or later, which includes upstream fixes for this incident and related race conditions.

#sglang #kv cache #workers ai #llm inference

Generated by gpt-5.6-sol. Check the original for details.

Metric trends

Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained

Points

Score reported by the source.

  • Hacker News: 178, latest observation ; +173 over observed period since

Comments

Comment count reported by the source.

  • Hacker News: 71, latest observation ; +71 over observed period since

Aliases

SourceExternal IDURL
Cloudflare Blog01M5X2P6CQYMNAESRJ922DG5J3https://blog.cloudflare.com/kv-cache-exposure-remediation/ Read discussion
Hacker News50252159https://blog.cloudflare.com/kv-cache-exposure-remediation/ Read discussion