Topics
Results for “vllm”
17 results
- nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB — Hugging Face Models · Seen
- tencent/Hy-Memory-30B-A3B — Hugging Face Models · Seen
- nvidia/Qwen3.8-Flash-Next-FP4-Local — Hugging Face Models · Seen
- vllm-sr/d3 — Hugging Face Models · Seen
- baidu/Unlimited-OCR — Hugging Face Models · Seen
- Efficient Memory Management for Large Language Model Serving with PagedAttention — Hugging Face Papers · Seen · 77 points
- Improve TTFT for multi-turn agentic workloads with bi-directional KV transfer in vLLM — AWS Machine Learning Blog · Seen
- Push-based KV transfer to improve TTFT and TPOT for disaggregated inference in vLLM — AWS Machine Learning Blog · Seen
- Don't Assume Your Cloud T4 Runs at Spec: Gemma 4 Decode Falls 7% as the Card Warms — DEV Community · Seen
- Small Apache-2.0 Models Against Gemma 4 E2B on One TPU v5e: Which Ones Keep Up? — DEV Community · Seen
- Hyper Optimizing Kimi K3 in vLLM — Hacker News · Seen · 30 points
- autotrust/JEV-35B — Hugging Face Models · Seen
- Mixture-of-Experts kernel engineering on Amazon SageMaker AI — AWS Machine Learning Blog · Seen
- JetBrains/Mellum2.1-12B-A2.5B-Thinking — Hugging Face Models · Seen
- tencent/Youtu-Parsing-Omni — Hugging Face Models · Seen
- autotrust/JEV-35B-NVFP4 — Hugging Face Models · Seen
- PRIME: Frequency-Aware Unified Pruning and Merging for MoE Compression — arXiv AI Papers · Seen