Apple Silicon Exec Reveals Mac Mini AI Demand and On-Device Future

Apple could probably sell a machine starting at $10,000 if they architected it as the sole place one’s Private Cloud Compute [1] ran.

It would need a path to a $2,500 machine, I think. But this is a niche I don’t think another consumer-facing brand could do like Apple.

[1] https://security.apple.com/blog/private-cloud-compute/

If I had the capital I’d make an household inference appliance.

No peripherals except Ethernet, integrated compute (cpu+gpu+mem) and secondary storage (+mobo, psu). No accoutrements, just the minimum amount of hardware to run a model as a utility.

Even the appliance faceplate would be a display showing stats like an old HiFi stereo.

Edit: something like a series of modules consisting of a RISC-V CPU + Vortex GPGPU + memory

What I’m not sure to understand is that if you want to just run Claude code or openclaw type software with llm apis or subscriptions (and not run local models) to benefit from a local file system and always-on capability for ‘second brain’ type of workflows, I guess you don’t need a Mac mini but can run it on a raspberry pi or an old laptop ? Does anyone have experience with that ?

Running models on-device on a Mac is immensely annoying though. Figuring out what will work out of BF16, FP8, BF16+FP8, NVFP4, INT8, GGUF ... the list goes on ... is 'non-obvious' at best. Apple do little to support with tooling. There's MLX, but unless you're happy to transform a model to that format yourself you'll be lagging a long way behind.

Apps like LMStudio, Ollama, Draw Things, etc do a great job of simplifying it but it's still a pain.

It’s not for the AI inference, it’s for the tool calls and desktop GUI app workloads and browser. There aren’t any on-device models capable enough of real work that can run on lower end Mac Minis. But for running a few browsers and GUI apps, you’re much better off buying a Mac Mini than paying for a more expensive and worse-performing container in the cloud. Browsers were not designed to run in Linux containers but they run optimally on baremetal desktop OSes. An M4 Mac Mini beats the single core performance of any VM you might rent in the cloud, in terms of raw compute per dollar (Geekbench scores).

> "The speed of AI development right now is just crazy," Brooks said. "I can't imagine where we're going to be a year from now, three months from now, or even a month from now," he added.

I don't think I'm taking this out of context when I say this is unintentionally correct. Apple still doesn't know what to do about AI.

Luckily, it doesn't matter because it's a solution in search of a problem. Most consumers aren't using AI apart from google search.

Everyone else is using it as a content scraper and praying nobody will step in to end the piracy/fraud.

Apple could dominate this niche if they decided, for a while until prices fall, to eat some margin and bump up RAM in high end models. Couple that with a new M series chip with even faster AI performance.

It’s not a huge niche but it’s an influential one. They’d get the engineers and CXOs of AI ventures and a lot of academics and hobbyists.

For the platform it would keep them cemented as the high end vendor. In the long term it would position them to take advantage of any software or training breakthroughs that deliver frontier model performance at that scale.

> Apple's Mac mini and Mac Studio have become the machines of choice for running AI agents, according to Doug Brooks, Apple's senior product manager of Apple silicon.

This is mostly an US phenomenon, no Mac mini nor Mac Studio around here.

Only Thinkpads and Macbooks laptops talking to hyperscalers.

People bought diesel cars as miles per gallon was higher than petrol.

People are buying apple unified as electricity costs in many countries are very high, so cheaper to run than Nvidia setup.

As non-apple unified memory options increase, many people will have more choose those