Small Apache-2.0 Models Against Gemma 4 E2B on One TPU v5e: Which Ones Keep Up?
Post · https://dev.to/gde/small-apache-20-models-against-gemma-4-e2b-on-one-tpu-v5e-which-ones-keep-up-mm4
Fourteen Apache-2.0 and MIT open-weight models that fit one TPU v5e chip, served one after another through vLLM on the same pinned image and scored on GSM8K and BFCL against Gemma 4 E2B. Qwen3-4B matches Gemma's accuracy at 0.57x its output, SmolLM3-3B and Granite 3.3 2B match it on tool calls, and Gemma keeps the lead on long prompts.
First seen by Oriel on .
Metric trends
Last 30 days · Up to 120 recorded samples per source and metric · First and latest retained
Reactions
Total public reactions reported by the source; distinct from points and likes.
- DEV Community: 21, latest observation ; +15 over observed period since
Comments
Comment count reported by the source.
- DEV Community: 3, latest observation ; 0 over observed period since
Aliases
| Source | External ID | URL |
|---|---|---|
| DEV Community | 4839822 | https://dev.to/gde/small-apache-20-models-against-gemma-4-e2b-on-one-tpu-v5e-which-ones-keep-up-mm4 |