Topics
Results for “llm inference”
23 results
- Putting Linux on my RTX spark laptop because I don't have a Microsoft account — Hacker News · Seen · 233 points
- nvidia/NVIDIA-Nemotron-Labs-Dory1.0-4B-BF16 — Hugging Face Models · Seen
- LiquidAI/LFM2.5-24B-A2B — Hugging Face Models · Seen
- Qwen/Qwen3.8-27B — Hugging Face Models · Seen
- DLite: History-free Speculative Decoding for Agentic AI — Hugging Face Papers · Seen · 20 points
- The Other Half of the Memory Wall: Serving 35B MoEs from SSD with Trained Routing Prediction — Hugging Face Papers · Seen · 28 points
- Cutting our inference bill by 68% by being obsessive about optimization — Cloudflare Blog · Seen
- harvardMadsys/freeinference_agentic_trace — Hugging Face Datasets · Seen
- Push-based KV transfer to improve TTFT and TPOT for disaggregated inference in vLLM — AWS Machine Learning Blog · Seen
- Organizing LLM Inference for Aggregate Predictions from Behavioral Data — arXiv AI Papers · Seen
- Small Apache-2.0 Models Against Gemma 4 E2B on One TPU v5e: Which Ones Keep Up? — DEV Community · Seen
- Bitnet.cpp: Efficient Edge Inference for Ternary LLMs — Hugging Face Papers · Seen · 18 points
- autotrust/GLM5.3-Flash-E192-DGX-Spark — Hugging Face Models · Seen
- lightseekorg/tokenspeed — GitHub Trending · Seen
- Run multi-node inference workloads using Ray LLM Deep Learning Containers — AWS Machine Learning Blog · Seen
- DoSA: Dots Sparse Attention — 2 sources · Seen · 69 points
- lyogavin/airllm — GitHub Trending · Seen
- AIR-LLM: Broadcasting AI Weights over Radio for Memory-Free Edge LLM Inference via RF Computing — Lobsters · Seen · 1 points
- Venastine-Research/Xing4.0-29B-A4B-GGUF — Hugging Face Models · Seen
- Janas: Run LLMs larger than RAM by streaming experts from SSD — Hacker News · Seen · 214 points
- Running the unmodified Linux amdgpu driver on an iPad — Hacker News · Seen · 99 points
- Alishahryar1/free-claude-code — GitHub Trending · Seen
- microsoft/BitNet — GitHub Trending · Seen