DOOMFORMER - Neural networks computed by DOOM's game mechanics
Show HN: I Turned DOOM into a Transformer
DOOMFORMER is a wild experiment that runs real neural networks entirely inside DOOM using voodoo dolls, conveyor belts, lava lines, and doors. Numbers become crowds of dolls, matrix multiplies become dolls crossing lava, and attention becomes dolls squeezing under ceiling gates. It reads handwritten MNIST digits, generates DOOM level names with a transformer, answers questions about cheat codes, and even compiles a marine's brain into the level he fights in. Every value is checked bit-exact against a NumPy integer reference, with tolerance zero. Try it via pip or the Colab notebook, and pick your difficulty from "I'm too young to die" to "Nightmare!"
The marine's brain is compiled into the level he is fighting in: 1,345 voodoo dolls of himself run his transformer and choose his next move, while the level senses the demons and pulls the trigger.
- mg794613
Was there even a human involved at all, or was this a "no mistakes" prompt outcome?
Nothing on this page looks made by a human, its _all_ generated, not a tiny bit of it, _all_ of it.
Guess having the word "doom" and "transformer"in your publication is enough today.
- whycombilater
Just how clever can an infinite recursion of someone disappearing up their own backside be?
- andai
Awesome
>a handwritten digit takes 163 seconds of real-time DOOM in one map at the default schedule and 8 seconds at --opt 3.
What does this refer to? What does schedule mean here, and what are these opt levels?
Edit: oh sweet Jesus
https://github.com/mottopanikeiku/doomformer/blob/main/docs/...
- bjconlan
Came for the "doomformer" based snow lyric puns... Left with a feeling my people are on slashdot.
- slowin
This is absolutely incredible. I feel like this could help visualize a neural network, but you have to know a lot about DOOM to really understand it.