NVIDIA launches Cosmos 3: Open-world foundation model for physical AI
NVIDIA Officially Releases Cosmos 3: An Open World Foundation Model Designed for Physical AI
On June 1st, 2026, NVIDIA officially released Cosmos 3—an open world foundation model designed specifically for Physical AI. Unlike traditional multimodal models that primarily stay within visual content understanding, Cosmos 3 integrates visual reasoning, world generation, and action prediction into the same engineering pipeline: the model not only needs to comprehend images but also judge physical relationships between objects, predict future states after actions, and assume the role of a world model in real interaction scenarios such as robotics, autonomous driving, and industrial intelligence.
Core Challenge of Physical AI: From Recognition to Closed-Loop Control
Essential Difference Between Traditional AI and Physical AI
Traditional AI systems process unidirectional data flows: input data is processed by the model to output results. For example, image classification models receive pictures and output object categories and locations. While this paradigm is effective, it has fundamental limitations for systems requiring interaction with the physical world.
Physical AI systems must handle bidirectional interaction loops: the system not only needs to understand the current environmental state but also predict the impact of its own actions on the environment, and dynamically adjust subsequent behavior based on environmental feedback.
Technical Breakthroughs
The core breakthrough of Cosmos 3 lies in migrating the traditional Next Token Prediction paradigm to Next State Prediction (predicting the next state of the world), enabling AI systems to understand physical laws such as gravity, collisions, and fluid dynamics.
The release of this model marks the transition of "Physical AI" from an academic concept to formal engineering implementation, providing key infrastructure for embodied intelligence and simulation training.
Physix Frontier