JustVugg/colibri
Repository · https://github.com/justvugg/colibri
Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
First seen by Oriel on .
AI summary
colibri is a pure-C, zero-dependency engine that runs large mixture-of-experts models on ordinary computers by keeping dense components in RAM and streaming routed experts from disk.
- The project supports thirteen engines covering language, image-generation, and decision models, including GLM-5.2, Kimi K3, Qwen-Image-2.1, Laya, and GLiNER2.5-Decide.
- Models run on CPUs without GPUs, while Vulkan and CUDA can accelerate supported configurations; published GGUF files are read without additional conversion or quantization.
- Setup detects RAM, disk, CPU, and GPUs, recommends a compatible model, resumes interrupted downloads, builds or downloads an engine, and exposes browser, OpenAI, and Anthropic endpoints.
- Requirements start at 8 GB RAM and 22 GB free disk, but supported models range from 14 GB OLMoE to 1.56 TB Kimi K3 downloads.
- Performance depends heavily on hardware and storage: GLM-5.2 ranges from 0.05 tok/s on a 25 GB laptop to 9.0–9.2 tok/s on six RTX 5090s.
#mixture of experts #model inference #pure c #gpu acceleration
Generated by gpt-5.6-sol. Check the original for details.
Metric trends
Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained
Stars
Total repository stars at each observation.
- GitHub Trending: 47,526, latest observation ; +1,403 over observed period since
Stars gained (1d)
Daily star gain reported by GitHub Trending. A change compares two daily values; it is not additional stars between observations.
- GitHub Trending: 802, latest observation ; +147 over observed period since
Forks
Total repository forks at each observation.
- GitHub Trending: 5,487, latest observation ; +169 over observed period since
Aliases
| Source | External ID | URL |
|---|---|---|
| GitHub Trending | justvugg/colibri | https://github.com/JustVugg/colibri Read discussion |