Mini-AGI trains a continual learning model from scratch on an 8GB laptop GPU
Mini-AGI – dynamic continual learning model trained from scratch on 8GB VRAM

Mini-AGI is a byte-level language model that assembles its own architecture, trains on a single 8GB VRAM GPU, and keeps learning without catastrophic forgetting. It pages expert weights from disk, grows and prunes capacity dynamically, and uses a 0.1x trunk learning rate to retain 99.84% of progress against chance. It's a toy-level experiment showing personal continual learning is possible on modest hardware.
The trunk learning rate is the mechanism. Running it at 0.1x the experts' rate takes forgetting from +2.2300 to +0.0067 nats, which is 99.84% of progress retained against chance.