Can a 26B MoE Run on an 8 GB GPU? Gemma 4 26B A4B on an RTX 3050
Post · https://dev.to/gde/can-a-26b-moe-run-on-an-8-gb-gpu-gemma-4-26b-a4b-on-an-rtx-3050-2efn
Gemma 4 26B A4B, a 14.4 GB mixture-of-experts model, serves from an 8 GB RTX 3050 with most of its experts in system RAM: 131,072 tokens of context, 28 to 34 tok/s empty, and GSM8K and BFCL scores level with the 12B.
First seen by Oriel on .
No saved summary available.
Metric trends
Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained
Reactions
Total public reactions reported by the source; distinct from points and likes.
- DEV Community: 12, latest observation ; +2 over observed period since
Comments
Comment count reported by the source.
- DEV Community: 10, latest observation ; +9 over observed period since
Aliases
| Source | External ID | URL |
|---|---|---|
| DEV Community | 4879157 | https://dev.to/gde/can-a-26b-moe-run-on-an-8-gb-gpu-gemma-4-26b-a4b-on-an-rtx-3050-2efn Read discussion |