ranxianglei/billion-context
Repository · https://github.com/ranxianglei/billion-context
A context-compression plugin for month-long single sessions (billions of tokens) ,small context windows (a 100K context is enough) and token savings (5x fewer tokens) .上下文压缩插件,月级长会话会话, 兼顾小窗口(100k上下文足矣)省token(省5倍token) . billion-context is all you need
First seen by Oriel on .
AI summary
billion-context is a training-free proxy plugin that incrementally compresses agent conversations, enabling month-long sessions and billions of cumulative tokens within approximately 100K-token context windows.
- The proxy supports Anthropic and OpenAI request formats, injects context-management tools, compresses conversations, forwards requests, and rewrites streaming responses.
- Models autonomously use compress, decompress, search_context, and acp_status to manage layered summaries while preserving access to exact historical details.
- A 4.5-month study recorded 174,327 model calls and 18.76B cumulative input tokens, with zero window violations on 204,800-token models.
- Third-party benchmarks report leading ContextBench results, 79.20% on LongMemEval-S, and 100% survival on a 1.48M-token MemoryAgentBench test.
- Native plugins, launchers, and URL-prefix routing support numerous coding agents, but native and standalone extensions must not run together because they cause double compression.
#context compression #coding agents #llm proxies #long context
Generated by gpt-5.6-sol. Check the original for details.
Metric trends
Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained
Stars
Total repository stars at each observation.
- GitHub Trending: 6,657, latest observation ; +2,274 over observed period since
Stars gained (1d)
Daily star gain reported by GitHub Trending. A change compares two daily values; it is not additional stars between observations.
- GitHub Trending: 375, latest observation ; +190 over observed period since
Forks
Total repository forks at each observation.
- GitHub Trending: 543, latest observation ; +185 over observed period since
Aliases
| Source | External ID | URL |
|---|---|---|
| GitHub Trending | ranxianglei/billion-context | https://github.com/ranxianglei/billion-context Read discussion |