Rethinking Quality in Large Language Model Routing: Security-Conditioned Model-and-Budget Selection
On the map: LLM reasoning → Reasoning for agents, planning and code also fits: Test-time compute and efficient thinking
Abstract (arXiv)
Large language model (LLM) routers reduce serving cost by choosing which model to call and how many output tokens to grant it for each query. Existing routers rank model-budget actions using a single quality metric. This does not work for mixed workloads. For ordinary queries, a good answer is correct and useful (utility); for security-sensitive queries, a good answer refuses harmful requests or resists malicious instructions (security). These two objectives prefer different models and budgets. We propose SCRouter, a router that learns when to prioritize security and how to allocate the token budget. For each model-budget pair, it estimates the probability that the response finishes within budget. It uses this probability to predict utility and security separately. A small probe determines how to weight these two predictions for each query. SCRouter then selects the model and budget by balancing the weighted utility and security against cost. We also build SCRouterBench, a benchmark of 38,869 utility and security queries spanning nine security dimensions, each answered under all 144 combinations of 12 models and 12 budgets, plus 2,753 out-of-domain queries. SCRouter improves the baselines by 13-29 points in-domain and 19-23 points out-of-domain.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 25 of its 39 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
25 of 39 references.
References · 25
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
- 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
- 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 853
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
- 2020Aligning AI With Shared Human Valuescited by 723
13 more
- 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 521
- 2023DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Modelscited by 518
- 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 375
- 2024Hybrid LLM: Cost-Efficient and Quality-Aware Query Routingcited by 372
- 2024GraphRouter: A Graph-based Router for LLM Selectionscited by 165
- 2023Tensor Trust: Interpretable Prompt Injection Attacks from an Online Gamecited by 145
- 2025Universal Model Routing for Efficient LLM Inferencecited by 86
- 2025CARROT: A Cost Aware Rate Optimal Routercited by 39
- 2025Llama-3.1-FoundationAI-SecurityLLM-8B-Instruct Technical Reportcited by 23
- 2025RouterArena: An Open Platform for Comprehensive Comparison of LLM Routerscited by 22
- 2026R2-Router: A New Paradigm for LLM Routing with Reasoningcited by 14
- 2025RADAR: Reasoning-Ability and Difficulty-Aware Routing for Reasoning LLMscited by 6
- 2026RerouteGuard: Understanding and Mitigating Adversarial Risks for LLM Routingcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025How Robust Are Router-LLMs? Analysis of the Fragility of LLM Routing Capabilities
- 2026Towards Fair and Comprehensive Evaluation of Routers in Collaborative LLM Systems
- 2025SATER: A Self-Aware and Token-Efficient Approach to Routing and Cascading
- 2025RouterEval: A Comprehensive Benchmark for Routing LLMs to Explore Model-level Scaling Up in LLMs
- 2026Whose turn is it? Context-guided model routing for stateful agents
- 2026Signed Rescue Routing: Harm-Aware Cascades for Efficient LLM Inference
- 2026TokenRouter: Efficient Serving System for Token-Level LLM Routing
- 2025Life-Cycle Routing Vulnerabilities of LLM Router