Topics
Results for “inference”
167 results
- n4ze3m/tiny-voca — Hugging Face Models · Seen
- Edge0/Edge0-145B-NVFP4 — Hugging Face Models · Seen
- taobao-mnn/MNN-Pocket-0.3B — Hugging Face Models · Seen
- unsloth/Qwen3.8-Flash-Next-GGUF — Hugging Face Models · Seen
- speridlabs/idol — Hugging Face Models · Seen
- deepseek-ai/DeepSeek-V4.1-Flash-1017 — 2 sources · Seen
- Qwen/Qwen3.8-27B — Hugging Face Models · Seen
- MACaQ: Fast, Model Agnostic Calibrated Quantization for Low-Precision Weights and Activations — Hugging Face Papers · Seen · 32 points
- Flide: Accelerating Decision Inference with Exact State Forking — Hugging Face Papers · Seen · 37 points
- FreeToken: Efficient Edge-Native MoE Serving with Bandwidth-Adaptive Execution — Hugging Face Papers · Seen · 111 points
- The Other Half of the Memory Wall: Serving 35B MoEs from SSD with Trained Routing Prediction — Hugging Face Papers · Seen · 33 points
- Six Serving Engines on Four Accelerators: Gemma 4 E2B on an RTX 3050, a T4, an L4 and a TPU v5e — DEV Community · Seen
- NVIDIA Sweeps MLPerf Training and Endpoints as Vera Rubin Debuts With Leading Performance — NVIDIA Blog · Seen
- Hugging Face and OpenRouter join forces to make open-weight models easy to run — Hugging Face Blog · Seen
- NVIDIA Vera Rubin NVL72 Leads Agentic Inference Performance on MLPerf Endpoints v1.0 — NVIDIA Developer Blog · Seen
- Edge0/Edge0-145B-q3k — Hugging Face Models · Seen
- KRAFTON/Raon-1-nano — Hugging Face Models · Seen
- LiquidAI/Liquid-Codec — Hugging Face Models · Seen
- Neural Simulation-Based Inference for Computational Cognitive Models: A Tutorial — arXiv AI Papers · Seen
- Diffusion Tree Sampling for Inference Time Adaptation of Crystal Generative Models — arXiv AI Papers · Seen
- Production MLOps at GS Caltex with Amazon SageMaker Canvas, part 1 — AWS Machine Learning Blog · Seen
- OpenFold3 on Amazon SageMaker JumpStart: Predict biomolecular structures — AWS Machine Learning Blog · Seen
- Cost-optimizing AssemblyAI speech-to-text inference on AWS with Amazon EC2 Spot — AWS Machine Learning Blog · Seen
- Run Native DLA Inference in Python on NVIDIA Jetson AGX Orin Using cuDLA — NVIDIA Developer Blog · Seen
- The efficient frontier of LLM inference — Hacker News · Seen · 11 points
- Serving GLM-5.3 at 607.8 tok/s across two Nvidia DGX stations with vLLM — 2 sources · Seen
- Llama.cpp hits v1.0 with a native app for macOS — 2 sources · Seen
- Four Amazon Bedrock inference choices that affect cost — AWS Machine Learning Blog · Seen
- Six Serving Engines, One 8 GB GPU: Gemma 4 E2B on an RTX 3050 — DEV Community · Seen
- ashhart/TensorFold — GitHub Trending · Seen
- Scantist/GLM-5.3-SLIM-GGUF — Hugging Face Models · Seen
- Apple has new Mac app coming to make running local AI models easy — Hacker News · Seen · 568 points
- I'm making LLMs work on small and old devices — Hacker News · Seen · 477 points
- Edge0-145B: Frontier AI Capabilities on Your Own Computer — Hacker News · Seen · 345 points
- SPIRE: Task-agnostic embodied continual learning through autonomous situation inference and causal motor-primitive reuse — arXiv AI Papers · Seen
- UniPipe: Unified Inference Serving and Fine-Tuning for Deadline-Constrained DNN Surrogate Workflows — arXiv AI Papers · Seen
- Together Compiler: Continual Compilation for AI Inference — arXiv AI Papers · Seen
- Talking Zen 6 with Mike Clark at AMD In-Depth — Hacker News · Seen · 239 points
- Huawei releases MACaQ, its internal quantizer for local inference — Hacker News · Seen · 134 points
- NVIDIA Expands Open Source Commitment With OpenShell Donation and New AI Infrastructure — NVIDIA Blog · Seen
- Start and Restore GPU Workloads in Seconds with NVIDIA Snapshot — NVIDIA Developer Blog · Seen
- ggml-org/llama.cpp — GitHub Trending · Seen
- Alishahryar1/free-claude-code — GitHub Trending · Seen
- Decision Models in Hugging Face — Hugging Face Blog · Seen
- ExecuTorch WebGPU: PyTorch Models on the GPU, in the Browser — Hacker News · Seen · 9 points
- Your Experts Have Partners. There's HOPE for Keeping Them Together — Hugging Face Blog · Seen
- NVIDIA Dynamo Recipes Bring Korea’s Leading Open Models to Production — NVIDIA Blog · Seen
- From Chips to Skills, NVIDIA and Korea Expand Sovereign AI Collaboration — NVIDIA Blog · Seen
- Tracing Psychometric Inference in Large Language Models — arXiv AI Papers · Seen
- From Relevant Posts to Attributable Spans: Explicit Symptom Evidence for Depression Questionnaire Inference — arXiv AI Papers · Seen
- NVIDIA Nemotron 3.5 Super VL is now available in Amazon SageMaker JumpStart — AWS Machine Learning Blog · Seen
- Compress any LLM 3x in one click, near-lossless, in under 50 MB RAM — Hacker News · Seen · 21 points
- An Open Field Guide to Inference Engineering — Hacker News · Seen · 91 points
- LLM inference, visually explained: why a 13B model reads 26 GB per token — Hacker News · Seen · 3 points
- How Many Examples, and Which Ones? A Study of In-Context Learning for Natural Language Inference — arXiv AI Papers · Seen
- mistralai/Mistral-Large-4-1T-A52B — Hugging Face Models · Seen
- DeepX claims inference up to 100B parameters at less than 5 W — 2 sources · Seen · 154 points
- SpecPilot: Autonomous Algorithm Discovery and Systems Optimization for Speculative Decoding — Hugging Face Papers · Seen · 20 points
- deep-principle/Hydrogen-1.0 — Hugging Face Models · Seen
- What can I realistically do with local AI on a Mac mini M5 Pro (48GB)? — Lobsters · Seen · 24 points