DFlash 2: 20% More Tokens from Every Verification Pass

DFlash 2: Keep Drafting Parallel

Inco AI's DFlash 2 upgrades speculative decoding by adding a lightweight path selector and a convolutional fix for suffix decay, boosting output by 16–25% with only ~1% added latency. The selector scores adjacent candidate pairs to pick a coherent path, while convolutions target within-block dependencies that attention neglects. Already integrated into SGLang, vLLM, llama.cpp, and oMLX, DFlash 2 serves Qwen3.8-27B at 2.7–3.4× the throughput of autoregressive decoding.