New Nvidia Cosmos 3 Open Models for Interactive World Simulation
Web page · https://huggingface.co/blog/nvidia/cosmos-interactive-world-simulation
First seen by Oriel on .
AI summary
NVIDIA adds four open-weight Cosmos 3 Nano checkpoints for interactive driving and robotics simulation, covering offline multi-view data generation, streaming sensor observations, simulator rendering, and action-conditioned video prediction.
- All four checkpoints have 16B trainable parameters and use OpenMDW1.1, which permits commercial and non-commercial use under its terms.
- Transfer-Auto generates synchronized video across up to 11 camera views and can jointly generate LiDAR; Sim-Auto distills it into fast streaming chunks driven by updated controls.
- Sim-Transfer renders RGB from simulator spatial controls while the simulator retains physics and ground-truth state; Sim-Bimanual predicts observations from robot and camera actions.
- Streaming generation uses causal attention, generated history, and a key/value cache; training progresses through bidirectional adaptation, teacher forcing, consistency distillation, and self-forcing.
- The published Sim-Bimanual vLLM-Omni setup was tested on one GB200, and the article cautions that successful short training runs do not establish convergence.
#world models #autonomous driving #robotics #video generation
Generated by gpt-5.6-sol. Check the original for details.
Metric trends
Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained
Points
Score reported by the source.
- Hacker News: 5, latest observation ; +2 over observed period since
Comments
Comment count reported by the source.
- Hacker News: 0, latest observation ; 0 over observed period since
Aliases
| Source | External ID | URL |
|---|---|---|
| Hugging Face Blog | https://huggingface.co/blog/nvidia/cosmos-interactive-world-simulation | https://huggingface.co/blog/nvidia/cosmos-interactive-world-simulation Read discussion |
| Hacker News | 50393127 | https://huggingface.co/blog/nvidia/cosmos-interactive-world-simulation Read discussion |