mlsanityData to 14 Oct 2026

SWRouter: Similarity-Contractive Window Routing for Multi-Turn Large Language Model Conversations

arXiv 2609.11414 ↗First posted 10 Sep 2026cs.CL cs.AI cs.IRcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models exhibit complementary strengths, motivating routing methods that dispatch each query to the most suitable model. Although existing routers are effective in single-turn settings, they do not directly transfer to multi-turn dialogue, where routing performance critically depends on how historical context is segmented, retained, and incorporated into the current prompt. This introduces two fundamental challenges: preventing information loss and information confusion during context construction, and evaluating routing quality without conflating model selection with prompt construction quality. In this paper, we propose SWRouter, a Similarity-Contractive Window Router for multi-turn large language model routing. SWRouter combines a similarity-based context segmentation mechanism for prompt construction with a dual-metric evaluation framework that decouples construction accuracy from router performance. Experiments on multi-turn dialogue benchmarks demonstrate that SWRouter consistently surpasses strong baselines, achieving a 16.26% improvement in evaluation accuracy over the best individual large language model and an additional 8.22% gain over the Conv-ID Context baseline. Our results highlight that multi-turn large language model routing requires a joint design of context construction and evaluation, rather than a direct extension of single-turn routing methods.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 41 references that are in the map. First posted on arXiv 10 Sep 2026.

Builds on

20 of 41 references.

References · 20

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  3. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  5. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  6. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  7. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
  8. 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 853
  9. 2023LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusioncited by 564
  10. 2023CMMLU: Measuring massive multitask language understanding in Chinesecited by 449
  11. 2024MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialoguescited by 250
  12. 2023Large Language Model Routing with Benchmark Datasetscited by 172
8 more
  1. 2023Large Language Model Cascades with Mixture of Thoughts Representations for Cost-efficient Reasoningcited by 143
  2. 2024Language Model Cascades: Token-level uncertainty and beyondcited by 121
  3. 2015Yara Parser: A Fast and Accurate Dependency Parsercited by 111
  4. 2024LoraRetriever: Input-Aware LoRA Retrieval and Composition for Mixed Tasks in the Wildcited by 68
  5. 2024Harnessing the Power of Multiple Minds: Lessons Learned from LLM Routingcited by 46
  6. 2024Cost-Effective Online Multi-LLM Selection with Versatile Reward Modelscited by 39
  7. 2024Online Cascade Learning for Efficient Inference over Streamscited by 20
  8. 2026FlexSpec: Frozen Drafts Meet Evolving Targets in Edge-Cloud Collaborative LLM Speculative Decodingcited by 3

Built on by

Not cited yet.