Oriel — AI & technology worth noticing, every day.

New Nvidia Cosmos 3 Open Models for Interactive World Simulation

Web page · https://huggingface.co/blog/nvidia/cosmos-interactive-world-simulation

First seen by Oriel on .

AI summary

NVIDIA adds four open-weight Cosmos 3 Nano checkpoints for interactive driving and robotics simulation, covering offline multi-view data generation, streaming sensor observations, simulator rendering, and action-conditioned video prediction.

  • All four checkpoints have 16B trainable parameters and use OpenMDW1.1, which permits commercial and non-commercial use under its terms.
  • Transfer-Auto generates synchronized video across up to 11 camera views and can jointly generate LiDAR; Sim-Auto distills it into fast streaming chunks driven by updated controls.
  • Sim-Transfer renders RGB from simulator spatial controls while the simulator retains physics and ground-truth state; Sim-Bimanual predicts observations from robot and camera actions.
  • Streaming generation uses causal attention, generated history, and a key/value cache; training progresses through bidirectional adaptation, teacher forcing, consistency distillation, and self-forcing.
  • The published Sim-Bimanual vLLM-Omni setup was tested on one GB200, and the article cautions that successful short training runs do not establish convergence.

#world models #autonomous driving #robotics #video generation

Generated by gpt-5.6-sol. Check the original for details.

Metric trends

Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained

Points

Score reported by the source.

  • Hacker News: 5, latest observation ; +2 over observed period since

Comments

Comment count reported by the source.

  • Hacker News: 0, latest observation ; 0 over observed period since

Aliases

SourceExternal IDURL
Hugging Face Bloghttps://huggingface.co/blog/nvidia/cosmos-interactive-world-simulationhttps://huggingface.co/blog/nvidia/cosmos-interactive-world-simulation Read discussion
Hacker News50393127https://huggingface.co/blog/nvidia/cosmos-interactive-world-simulation Read discussion