Oriel — AI & technology worth noticing, every day.

JustVugg/colibri

Repository · https://github.com/justvugg/colibri

Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

First seen by Oriel on .

AI summary

colibri is a pure-C, zero-dependency engine that runs large mixture-of-experts models on ordinary computers by keeping dense components in RAM and streaming routed experts from disk.

  • The project supports thirteen engines covering language, image-generation, and decision models, including GLM-5.2, Kimi K3, Qwen-Image-2.1, Laya, and GLiNER2.5-Decide.
  • Models run on CPUs without GPUs, while Vulkan and CUDA can accelerate supported configurations; published GGUF files are read without additional conversion or quantization.
  • Setup detects RAM, disk, CPU, and GPUs, recommends a compatible model, resumes interrupted downloads, builds or downloads an engine, and exposes browser, OpenAI, and Anthropic endpoints.
  • Requirements start at 8 GB RAM and 22 GB free disk, but supported models range from 14 GB OLMoE to 1.56 TB Kimi K3 downloads.
  • Performance depends heavily on hardware and storage: GLM-5.2 ranges from 0.05 tok/s on a 25 GB laptop to 9.0–9.2 tok/s on six RTX 5090s.

#mixture of experts #model inference #pure c #gpu acceleration

Generated by gpt-5.6-sol. Check the original for details.

Metric trends

Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained

Stars

Total repository stars at each observation.

  • GitHub Trending: 47,526, latest observation ; +1,403 over observed period since

Stars gained (1d)

Daily star gain reported by GitHub Trending. A change compares two daily values; it is not additional stars between observations.

  • GitHub Trending: 802, latest observation ; +147 over observed period since

Forks

Total repository forks at each observation.

  • GitHub Trending: 5,487, latest observation ; +169 over observed period since

Aliases

SourceExternal IDURL
GitHub Trendingjustvugg/colibrihttps://github.com/JustVugg/colibri Read discussion