Google DeepMind Unveils AGI Progress Framework With 10 Cognitive Benchmarks, Launches $200K Hackathon
Summary
Google DeepMind unveils a groundbreaking AGI progress framework identifying 10 key cognitive benchmarks — including reasoning, memory, and social cognition — while launching a $200K Kaggle hackathon challenging researchers to build evaluations for under-measured AI abilities.
Key Points
- Google DeepMind releases a new paper titled 'Measuring Progress Toward AGI: A Cognitive Taxonomy,' introducing a scientific framework that identifies 10 key cognitive abilities — including perception, reasoning, memory, and social cognition — to evaluate and track progress toward Artificial General Intelligence.
- A three-stage evaluation protocol is proposed to benchmark AI systems against human cognitive performance, using held-out test sets to prevent data contamination and mapping AI results relative to a demographically representative sample of human adults.
- A Kaggle hackathon is now live, running March 17 through April 16, challenging the research community to build evaluations for five under-measured cognitive abilities, with a total prize pool of $200,000 up for grabs and results announced June 1.