Topics
Results for “model serving”
12 results
- FreeToken: Efficient Edge-Native MoE Serving with Bandwidth-Adaptive Execution — Hugging Face Papers · Seen · 111 points
- Efficient Memory Management for Large Language Model Serving with PagedAttention — Hugging Face Papers · Seen · 77 points
- baidu/ERNIE-5.5-Flash-Base — Hugging Face Models · Seen
- zai-org/GLM-5.3-Flash — Hugging Face Models · Seen
- SageMaker Inference now supports Multi-Instance GPU to maximize GPU utilization for model endpoints — AWS Machine Learning Blog · Seen
- FlashML-org/FreeToken — GitHub Trending · Seen
- Cache Engineering for Agents — Hugging Face Papers · Seen · 161 points
- Beyond the KV cache: Training and serving i14’s Laplace 3B linear attention model on AWS Trainium2 with native PyTorch — AWS Machine Learning Blog · Seen
- vllm-project/vllm — GitHub Trending · Seen
- Cloudflare/clef — Hugging Face Models · Seen
- Welcome Beam: a 501B open model you can own, customize, and scale — Hugging Face Blog · Seen
- Unlocking Structured Pruning for Reasoning Language Models via Attention-Preserving MLP Trimming — arXiv AI Papers · Seen