Yes, several current AI systems and architectures are built around world models—systems designed to predict the next state of the physical or virtual world based on actions and observations, rather than just predicting the next word like standard Large Language Models (LLMs). [1, 2]
- Google DeepMind Genie 3: A general-purpose, real-time interactive world model that generates playable 720p environments at 24 frames per second from text or image prompts. It is also adapted by Waymo as the Waymo World Model for autonomous vehicle simulation. [1, 2]
- World Labs Atlas: A multimodal autoregressive diffusion transformer created by World Labs (co-founded by Fei-Fei Li) that operates natively across text, images, video, and 3D Gaussian splats/point clouds for spatial intelligence and real-to-sim robotics. [1]
- Nvidia Cosmos (Cosmos 3): An open-weight family of models combining physical reasoning, world simulation, and action generation using a Mixture-of-Transformers architecture for robotics and physical AI. [1]
- Meta V-JEPA / LeWorldModel: Yann LeCun's Joint Embedding Predictive Architecture (JEPA) family, designed to learn representations and physical reasoning from raw pixels to support zero-shot robot control. [1]
- Alibaba Happy Oyster: A world model capable of generating multi-minute interactive video clips with a directing and wandering mode for 3D world-building. [1]
- Logistics and Warehousing: Companies like Amazon are piloting Agility Robotics' Digit robot, while DHL uses autonomous mobile robots to guide workers. Humanoid systems are achieving near-perfect reliability in moving payloads and handling tools in real warehouse environments. [1, 2, 3]
- Automotive & High-Mix Manufacturing: Figure AI has partnered with BMW to place humanoid robots directly onto production lines, and Ford has run pilots utilizing advanced bipedal platforms for kitting and handling large metal parts. [1, 2]
- The "Scale" Era: In China, companies like UBTECH and AgiBot have opened massive smart factories specifically built to manufacture tens of thousands of humanoid robots annually, with robots working alongside humans to assemble other robots. [1, 2]
- The Cost-Competitiveness Gap: According to research from Anthropic, while current robots are technically capable of performing about 34% of US working hours in physical tasks, they are still too expensive to deploy at scale for most companies. They are only cost-competitive for a tiny fraction of jobs today, though hardware commoditization is rapidly pushing costs down toward a target price of $20,000 per unit. [1, 2, 3]
- The "Data Desert": Unlike language models that can scrape the internet for text, physical AI requires vast amounts of "action-labeled video data" (videos showing exactly how things move and react when touched). Startups are currently hiring gig workers to wear motion-capture gear just to feed real-world movement data into these world models. [1, 2]
No comments:
Post a Comment