Oriel — AI & technology worth noticing, every day.

Build World Models for Interactive Simulation with Nvidia Cosmos

Web page · https://developer.nvidia.com/blog/build-world-models-for-interactive-simulation-with-nvidia-cosmos

Physical AI developers working with world models face two distinct challenges: adapting models to their sensors, tasks, and data, and getting those models into...

First seen by Oriel on .

AI summary

NVIDIA Cosmos combines modular world-model training and inference tools with optimized NIM deployment for interactive simulation across autonomous vehicles, robots, and surgical systems.

  • Cosmos Framework supports training, reinforcement learning, distillation, quantization, evaluation, and inference across models including Cosmos 3, NVIDIA Alpamayo, GR00T, Qwen, and pi0.5.
  • Cosmos3-Nano-Transfer-Auto generates synchronized multi-camera video and LiDAR from World Scenario Map controls, supporting 30 fps and sequences up to 400 frames at 480p or 720p.
  • Cosmos3-Nano-Sim-Auto enables autoregressive, closed-loop AV simulation, while robotics recipes generate visual observations from simulator state, depth, prompts, and robot actions.
  • Cosmos3-H-Embodied-Nano and Cosmos3-H-Dreams generate surgical observations and actions, enabling offline policy evaluation and real-time interactive simulation without explicitly modeling surgical physics.
  • Cosmos NIM provides GPU-accelerated serving with quantization, speculative decoding, caching, and routing; speculative decoding delivers roughly 2–3× measured mean speedups on H200.

#nvidia cosmos #world models #physical ai #interactive simulation

Generated by gpt-5.6-sol. Check the original for details.

Metric trends

Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained

Points

Score reported by the source.

  • Hacker News: 6, latest observation ; +3 over observed period since

Comments

Comment count reported by the source.

  • Hacker News: 0, latest observation ; 0 over observed period since

Aliases

SourceExternal IDURL
Hacker News50393225https://developer.nvidia.com/blog/build-world-models-for-interactive-simulation-with-nvidia-cosmos/ Read discussion
NVIDIA Developer Bloghttps://developer.nvidia.com/blog/?p=124402https://developer.nvidia.com/blog/build-world-models-for-interactive-simulation-with-nvidia-cosmos/ Read discussion