German Consortium Unveils Soofi S: Open 30B Model Tops Benchmarks

German AI consortium releases Soofi S, an open 30B model that tops benchmarks

I am excited to share that the German AI consortium has released Soofi S, an open 30B model trained on Deutsche Telekom's Industrial AI Cloud. This hybrid Mamba-Transformer architecture outperforms competitors like OLMo 3 and Apertus 70B in both English and German benchmarks. Despite criticism regarding its training data volume, the team argues that Mixture-of-Experts models defy traditional Chinchilla scaling laws, delivering superior efficiency and long-context performance.

"There's new research showing that the old scaling laws from dense models no longer apply to MoE architectures."