Oriel — AI & technology worth noticing, every day.

Can a 26B MoE Run on an 8 GB GPU? Gemma 4 26B A4B on an RTX 3050

Post · https://dev.to/gde/can-a-26b-moe-run-on-an-8-gb-gpu-gemma-4-26b-a4b-on-an-rtx-3050-2efn

Gemma 4 26B A4B, a 14.4 GB mixture-of-experts model, serves from an 8 GB RTX 3050 with most of its experts in system RAM: 131,072 tokens of context, 28 to 34 tok/s empty, and GSM8K and BFCL scores level with the 12B.

First seen by Oriel on .

No saved summary available.

Metric trends

Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained

Reactions

Total public reactions reported by the source; distinct from points and likes.

  • DEV Community: 12, latest observation ; +2 over observed period since

Comments

Comment count reported by the source.

  • DEV Community: 10, latest observation ; +9 over observed period since

Aliases

SourceExternal IDURL
DEV Community4879157https://dev.to/gde/can-a-26b-moe-run-on-an-8-gb-gpu-gemma-4-26b-a4b-on-an-rtx-3050-2efn Read discussion