Respan built a Rust AI gateway where every provider and feature is a plugin

Launch HN: Respan (YC W24) – Open-source Rust AI gateway built around plugins

After years of wrapping LiteLLM, Respan's codebase ballooned past 100,000 lines, and a routine upgrade broke connections with no clear cause. So the team rebuilt its gateway from scratch in Rust, inspired by Nginx: a tiny core that only dispatches events, with providers, protocols like MCP and realtime voice, modalities, and features such as fallbacks and PII redaction all living as plugins. It's open source and pre-alpha.