Pete Warden: Local AI Is Closer Than You Think

Why AI Wants to Be Local – With Pete Warden (Creator of Moonshine Voice)

Pete Warden: Local AI Is Closer Than You Think

Moonshine Voice creator Pete Warden argues local AI is no longer a compromise: quantized 9B models fit in a 4GB GPU, and Apple's 256GB M5 Studio can run hundreds of billions of parameters at usable speed. The real barrier isn't model quality—it's usability and marketing, since cloud subscriptions are far more profitable to promote. He also makes the case for low-latency on-device speech as a more natural interface.

I think the biggest barriers are usability. If you look at the benchmarks, it really is no longer a question of model quality.

More from this day

2026-11-19