Redis creator launches ds4 to run frontier LLMs locally
From the creator of Redis; run LLM locally with ds4
Salvatore Sanfilippo, creator of Redis, has released DwarfStar 4 (ds4), a C inference engine for high-memory Mac, CUDA, and ROCm machines. It runs DeepSeek V4/V4.1, GLM 5.x, and Qwen3.8 Flash Next with asymmetric 2-bit quantization, KV cache disk streaming, and a CLI, HTTP server, and native agent. On an M5 Max with 128 GB, it achieves up to 790 tokens/s prefill and 39 tokens/s generation.
Asymmetric quantization targets the routed experts while preserving critical paths. The model becomes practical on high-memory machines.