Testing DeepWiki: When AI Documentation Fails on Legacy Code
Roko's Dancing Basilisk
I tested DeepWiki on my two personal repositories, mod_blog and a09, to see if AI could generate accurate documentation. While it performed decently on the simpler blog engine, it produced numerous factual errors and hallucinations on the more complex assembler. The tool struggles with code complexity, making it unreliable for maintaining documentation on unfamiliar or gnarly legacy systems without extensive manual verification.
"I suspect this generated documentation will end up worse than bad comments in the code itself."