Topics
Results for “gpu inference”
8 results
- speridlabs/idol — Hugging Face Models · Seen
- Flide: Accelerating Decision Inference with Exact State Forking — Hugging Face Papers · Seen · 37 points
- Cost-optimizing AssemblyAI speech-to-text inference on AWS with Amazon EC2 Spot — AWS Machine Learning Blog · Seen
- Compress any LLM 3x in one click, near-lossless, in under 50 MB RAM — Hacker News · Seen · 21 points
- SageMaker Inference now supports Multi-Instance GPU to maximize GPU utilization for model endpoints — AWS Machine Learning Blog · Seen
- BreezeBlue/Breeze-TTS-2 — Hugging Face Models · Seen
- Gemma 4 on a Used 8 GB RTX 3050: 116 Tokens/s for One User, 618 for 64 — DEV Community · Seen
- Show HN: Llmspeed – feel how fast a local LLM runs before you buy the hardware — Hacker News · Seen · 319 points