A world model small enough to run games on a Raspberry Pi Pico 2 W
A tiny world model running games on a Raspberry Pi Pico 2 W
SheepSeb built tinyworldformer, a looped transformer world model of just 26k–131k parameters that generates games frame by frame on a Raspberry Pi Pico 2 W. A separate tiny MLP actor plays inside the dream, never seeing the real game. The model hits up to 100% exact frames on Breakout and Flappy Bird and 83.6% on Doom-lite, and a Stream AC(λ) agent can even learn from scratch on the board.
Agents trained only in the dream scored 210 there (the real maximum is 56) and 28 in the real game, as World Models (Ha & Schmidhuber) predicts.