Why Manifest Deprecated Their LLM Router After Four Months of Testing

Everyone is building LLM routers, we deprecated ours

After four months of testing our LLM router with thousands of users, we decided to deprecate it. We found that routing models based on prompt complexity often fails because true difficulty emerges later through tool use. Furthermore, caching proved far more effective for cost reduction, while switching models introduced unpredictability and broke workflow consistency. For most use cases, sticking to a single, well-chosen model delivers better results than dynamic routing.