I ran 120B MoE models on my 32GB M1 Max using under 16 GB
Web page · https://mitln.github.io/moe-inference-engine
First seen by Oriel on .
No saved summary available.
Metric trends
Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained
Points
Score reported by the source.
- Hacker News: 34, latest observation ; +30 over observed period since
Comments
Comment count reported by the source.
- Hacker News: 8, latest observation ; +8 over observed period since
Aliases
| Source | External ID | URL |
|---|---|---|
| Hacker News | 50430323 | https://mitln.github.io/moe-inference-engine/ Read discussion |