Register Bias in Complexity-Based Large Language Model Routing
Not on the map. Why?
Abstract (arXiv)
Large language model services increasingly route each query to one of several models of differing capability, using a cheap estimate of query complexity to send easy queries to small models and hard queries to large ones. I show that this routing step is not register neutral: text written in a non-standard English register, African American English or the English of second-language writers, is systematically assigned a lower-capacity tier than a meaning-equivalent standard-English version of the same query. The effect is driven by a specific, common routing signal, input length, because non-standard registers omit function words and thus look shorter and therefore simpler; other complexity signals do not carry it. I demonstrate the disparity on 37,704 authentic learner sentence pairs and on a controlled parallel corpus. I then measure the quality consequence on a device, edge, and cloud model ladder and find that the harm is driven by pervasive model bias, every tier, including a frontier cloud model, answers non-standard-register queries significantly less accurately, while the marginal quality cost of the routing decision itself is not significant on this benchmark. Complexity-based routing thus compounds the exposure of the users that the models already serve worst.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 6 of its 16 references that are in the map. First posted on arXiv 14 Jul 2026.
Builds on
6 of 16 references.
References · 6
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 791
- 2019Latent Retrieval for Weakly Supervised Open Domain Question Answeringcited by 691
- 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 633
- 2022Multi-VALUE: A Framework for Cross-Dialectal English NLPcited by 51
- 2022VALUE: Understanding Dialect Disparity in NLUcited by 45
Built on by
Citing papers per year: 2026: 1.
1 paper.