Oriel — AI & technology worth noticing, every day.

ranxianglei/billion-context

Repository · https://github.com/ranxianglei/billion-context

A context-compression plugin for month-long single sessions (billions of tokens) ,small context windows (a 100K context is enough) and token savings (5x fewer tokens) .上下文压缩插件,月级长会话会话, 兼顾小窗口(100k上下文足矣)省token(省5倍token) . billion-context is all you need

First seen by Oriel on .

AI summary

billion-context is a training-free proxy plugin that incrementally compresses agent conversations, enabling month-long sessions and billions of cumulative tokens within approximately 100K-token context windows.

  • The proxy supports Anthropic and OpenAI request formats, injects context-management tools, compresses conversations, forwards requests, and rewrites streaming responses.
  • Models autonomously use compress, decompress, search_context, and acp_status to manage layered summaries while preserving access to exact historical details.
  • A 4.5-month study recorded 174,327 model calls and 18.76B cumulative input tokens, with zero window violations on 204,800-token models.
  • Third-party benchmarks report leading ContextBench results, 79.20% on LongMemEval-S, and 100% survival on a 1.48M-token MemoryAgentBench test.
  • Native plugins, launchers, and URL-prefix routing support numerous coding agents, but native and standalone extensions must not run together because they cause double compression.

#context compression #coding agents #llm proxies #long context

Generated by gpt-5.6-sol. Check the original for details.

Metric trends

Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained

Stars

Total repository stars at each observation.

  • GitHub Trending: 6,657, latest observation ; +2,274 over observed period since

Stars gained (1d)

Daily star gain reported by GitHub Trending. A change compares two daily values; it is not additional stars between observations.

  • GitHub Trending: 375, latest observation ; +190 over observed period since

Forks

Total repository forks at each observation.

  • GitHub Trending: 543, latest observation ; +185 over observed period since

Aliases

SourceExternal IDURL
GitHub Trendingranxianglei/billion-contexthttps://github.com/ranxianglei/billion-context Read discussion