DeepMind Kaggle Winners: New Benchmarks Reveal True AI Reasoning Beyond Recall

Blatant AI slop just won a 25k USD DeepMind Kaggle Grand Prize

I am thrilled to announce the winners of the DeepMind Kaggle hackathon, where over 1,000 teams created benchmarks to measure genuine AI reasoning. The grand prize winners developed tools like MEDLEY-BENCH and LearningBench to test how models handle social pressure, learn new rules instantly, and recognize their own uncertainty. These innovations move us beyond simple data recall toward evaluating true cognitive abilities in frontier models.

"A model that reports 95% confidence and never abstains is more dangerous than one that gets questions wrong, because it gives the human operator no signal that something might be off."