Topics
Results for “ai inference”
19 results
- Cost-optimizing AssemblyAI speech-to-text inference on AWS with Amazon EC2 Spot — AWS Machine Learning Blog · Seen
- Apple has new Mac app coming to make running local AI models easy — Hacker News · Seen · 568 points
- UniPipe: Unified Inference Serving and Fine-Tuning for Deadline-Constrained DNN Surrogate Workflows — arXiv AI Papers · Seen
- Together Compiler: Continual Compilation for AI Inference — arXiv AI Papers · Seen
- Talking Zen 6 with Mike Clark at AMD In-Depth — Hacker News · Seen · 239 points
- From Chips to Skills, NVIDIA and Korea Expand Sovereign AI Collaboration — NVIDIA Blog · Seen
- From Relevant Posts to Attributable Spans: Explicit Symptom Evidence for Depression Questionnaire Inference — arXiv AI Papers · Seen
- LLM inference, visually explained: why a 13B model reads 26 GB per token — Hacker News · Seen · 3 points
- DeepX claims inference up to 100B parameters at less than 5 W — 2 sources · Seen · 154 points
- More Performance From Every Byte: How Full-Stack Codesign Solves AI’s Memory Challenge — NVIDIA Blog · Seen
- On the Origin and Evolution of Training-Inference Mismatch in LLM Reinforcement Learning — arXiv AI Papers · Seen
- Access OpenAI GPT models on Amazon Bedrock from Canada with cross-Region inference — AWS Machine Learning Blog · Seen
- Alibaba hikes DeepSeek V4 Flash 0731 output prices by 230% — Hacker News · Seen · 14 points
- Factorization-Guided Training and Inference for Diffusion-Drafted Speculative Decoding — arXiv AI Papers · Seen
- TurboMamba: Faster Inference, Faster Training, and Better Prediction with Lexical Memory — arXiv AI Papers · Seen
- Accessing OpenAI GPT models on Amazon Bedrock with global cross-Region inference in Thailand, Malaysia, Singapore, Indonesia, and Taiwan — AWS Machine Learning Blog · Seen
- Run multi-node inference workloads using Ray LLM Deep Learning Containers — AWS Machine Learning Blog · Seen
- Intel D270 GPU AI Accelerator–Up to 480 GB LPDDR5X — Hacker News · Seen · 304 points
- AIR-LLM: Broadcasting AI Weights over Radio for Memory-Free Edge LLM Inference via RF Computing — Lobsters · Seen · 1 points