mlsanityData to 13 Oct 2026

Who Gets a Token, and What Does It Carry? Unequal Name Support and Concept Access in Large Language Models

arXiv 2609.34065 ↗First posted 28 Sep 2026cs.CL cs.AI cs.CYcited by 0

Not on the map. Why?

Abstract (arXiv)

Names are personal identifiers, but they also carry social meaning and are widely used to evaluate how language models treat different people. Such evaluations typically assume that matched names are comparable model inputs. We show that this assumption often fails at the lexical interface: matched names are not necessarily matched inputs. Some names receive direct single-token access, while others are assembled from multiple subwords, creating unequal name-surface support. Across nearly half a million first names and 12 LLM-associated tokenizers, direct lexical access is highly selective, model dependent, and uneven across race- and gender-associated name metadata. We introduce NameTrace, a model-native, fine-grained, pre-behavioral framework for measuring whether unequal name-surface support remains a vocabulary property or becomes visible in task-relevant internal representations. NameTrace measures concept accessibility from the model's own probabilities over task-specific adjective axes with continuous task-aligned weights. On matched atomic and short-fragmented names within the same race/ethnicity--gender-associated strata, support predicts systematic differences in concept accessibility across fellowship, hiring, clinical assessment, and lending. These differences persist across all eight matched strata, extend across model families, and transfer to unseen names. Hidden-state interventions further show that the measured task directions have downstream leverage, shifting later constrained choices. Unequal lexical support is therefore demographically structured at the input and remains visible in task-relevant model computation. NameTrace makes lexical comparability measurable, supporting a broader principle: behavioral comparability begins with lexical comparability.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 21 of its 29 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

21 of 29 references.

References · 21

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,492
  2. 2019Similarity of Neural Network Representations Revisitedcited by 1,719
  3. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,309
  4. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,280
  5. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,042
  6. 2016Semantics derived automatically from language corpora contain human-like biasescited by 895
  7. 2024Humans or LLMs as the Judge? A Study on Judgement Biasescited by 317
  8. 2023"Kelly is a Warm Person, Joseph is a Role Model": Gender Biases in LLM-Generated Reference Letterscited by 198
  9. 2023Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Modelscited by 190
  10. 2020"You are grounded!": Latent Name Artifacts in Pre-trained Language Modelscited by 39
  11. 2021Low Frequency Names Exhibit Bias and Overfitting in Contextualizing Language Modelscited by 39
  12. 2024"You Gotta be a Doctor, Lin": An Investigation of Name-Based Bias of Large Language Models in Employment Recommendationscited by 33
9 more
  1. 2024Do Large Language Models Discriminate in Hiring Decisions on the Basis of Race, Ethnicity, and Gender?cited by 25
  2. 2025Presumed Cultural Identity: How Names Shape LLM Responsescited by 21
  3. 2024First-Person Fairness in Chatbotscited by 19
  4. 2024Language Models are Surprisingly Fragile to Drug Names in Biomedical Benchmarkscited by 17
  5. 2024Gender Bias in Decision-Making with Large Language Models: A Study of Relationship Conflictscited by 15
  6. 2023Nichelle and Nancy: The Influence of Demographic Attributes and Tokenization Length on First Name Biasescited by 12
  7. 2023Examining the Causal Effect of First Names on Language Models: The Case of Social Commonsense Reasoningcited by 8
  8. 2023A Study of Implicit Ranking Unfairness in Large Language Modelscited by 6
  9. 2026Bias in the Tails: How Name-conditioned Evaluative Framing in Resume Summaries Destabilizes LLM-based Hiringcited by 1

Built on by

Not cited yet.