Google DeepMind Unveils SIMA 2 AI Agent That Learns to Navigate 3D Video Game Worlds
Summary
Google DeepMind releases SIMA 2, a Gemini-powered AI agent that learns to navigate 3D video games like No Man's Sky through trial and error, potentially paving the way for real-world robotics applications despite current limitations with complex tasks and memory.
Key Points
- Google DeepMind launches SIMA 2, an AI agent built on Gemini that navigates and solves problems across multiple 3D virtual worlds including Goat Simulator 3 and No Man's Sky
- The agent learns through trial and error, takes instructions via text or voice, and aims to develop skills like navigation and tool use that could transfer to real-world robotics
- SIMA 2 still struggles with complex multi-step tasks and has limited memory, with researchers skeptical about how well gaming skills will translate to physical robots