mlsanityData to 7 Oct 2026

Type-Safe Is Not Error-Free: Typed Decision Models Follow the Option Name, Not the Definition Bound to It

arXiv 2609.26758 ↗First posted 22 Sep 2026cs.AIcited by 13

Not on the map. Why?

Abstract (arXiv)

Typed decision models return structured results, but output-type correctness alone does not ensure that decisions follow explicit option definitions. Each option pairs a name with a definition that defines its intended meaning; the name, however, can provide a competing semantic cue. We study this conflict in Jev and two open-weight models by changing only the name-definition mapping, leaving the question, state, and the names and definition texts themselves unchanged. We measure decision flips at the level of the selected definition, rather than the returned name. On 1200 decision tasks with task-specific definitions, decision-flip rates are up to 70.4 pp higher with yes/no names than with the 0/1 control. This gap holds across all 4 binary decision rules. With yes/no names, reassignment also lowers their mean AUC from 93.8% to a below-chance 23.2%. In the binary evaluations, random strings used as option names yield mean flip rates close to those of neutral controls across all three models, with comparable balanced accuracy before reassignment. Together, these results support option-name polarity as a contributor to decision instability beyond reassignment alone. The type-error rate remains 0% throughout, showing that type-correct outputs can still fail to follow explicit option definitions.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 11 of its 20 references that are in the map. First posted on arXiv 22 Sep 2026.

Builds on

11 of 20 references.

References · 11

  1. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
  2. 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 527
  3. 2023Large Language Models Are Not Robust Multiple Choice Selectorscited by 454
  4. 2023Larger language models do in-context learning differentlycited by 386
  5. 2023Mitigating Word Bias in Zero-shot Prompt-based Classifierscited by 9
  6. 2026The Structured Output Benchmark: A Multi-Source Benchmark for Evaluating Structured Output Quality in Large Language Modelscited by 3
  7. 2026Schema-Key Wording as an Instruction Channel in Structured Generation under Constrained Decodingcited by 2
  8. 2026Your Prompt Is Not the Only Prompt: How Much Do LLMs Weight Structured-Output Schema Descriptions?cited by 2
  9. 2025Semantic Anchors in In-Context Learning: Why Small LLMs Cannot Flip Their Labelscited by 1
  10. 2026When JSON Is Not Enough: Semantic Reliability of Schema-Constrained LLM Ordering Agentscited by 1
  11. 2026PhantomFill: When the Form Demands an Answer, Language Models Invent Onecited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 13.

13 papers.

Sort:

By area: