Episode #43
LLMRouter: Unified Infrastructure for Developing, Evaluating, and Deploying LLM Routers
<p>🤗 Upvotes: 90 | cs.CL</p> <p>作者:<br> Tao Feng, Fangxu Yu, Haozhen Zhang, Zhongjie Dai, Liangqi Yuan, Zijie Lei, Weizhi Zhang, Kunlun Zhu, Haodong Yue, Keyang Xuan, Ge Liu, Jiaxuan You</p> <p>标题:<br> LLMRouter: Unified Infrastructure for Developing, Evaluating, and Deploying LLM Routers</p> <p>Arxiv:<br> http://arxiv.org/abs/2608.06867v1</p> <p>摘要:<br> No single large language model (LLM) is optimal across all queries and budget constraints, making model routing essential for cost-effective deployment. Existing routers adopt diverse formulations and implementations, making fair comparison and extension difficult. We present a unified formulation of LLM routing as a sequential deci...

