The Imperfective Paradox in Large Language Models
Not on the map. Why?
Abstract (arXiv)
Do Large Language Models (LLMs) genuinely grasp the compositional semantics of events, or do they rely on surface-level probabilistic heuristics? We investigate the Imperfective Paradox, a logical phenomenon where the past progressive aspect entails event realization for activities (e.g., running → ran) but not for accomplishments (e.g., building nrightarrow built). We introduce ImperfectiveNLI, a diagnostic dataset designed to probe this distinction across diverse semantic classes. Evaluating state-of-the-art open-weight models, we uncover a pervasive Teleological Bias: models systematically hallucinate completion for goal-oriented events, even overriding explicit textual cancellation. Prompting interventions partially reduce this bias but trigger a calibration crisis, causing models to incorrectly reject valid entailments for atelic verbs. Representational analyses further show that while internal embeddings often distinguish progressive from simple past forms, inference decisions are dominated by strong priors about goal attainment. Taken together, our findings indicate that these current open-weight LLMs operate as predictive narrative engines rather than faithful logical reasoners, and that resolving aspectual inference requires moving beyond prompting toward structurally grounded alignment.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 15 of its 60 references that are in the map. First posted on arXiv 14 Jan 2026.
Builds on
15 of 60 references.
References · 15
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
- 2015A large annotated corpus for learning natural language inferencecited by 1,837
- 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,103
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
- 2019Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inferencecited by 864
- 2023Faith and Fate: Limits of Transformers on Compositionalitycited by 496
- 2019What BERT is not: Lessons from a new suite of psycholinguistic diagnostics for language modelscited by 317
- 2019Negated and Misprimed Probes for Pretrained Language Models: Birds Can Talk, But Cannot Flycited by 240
- 2021Goal-Oriented Script Constructioncited by 30
3 more
Built on by
Citing papers per year: 2026: 1.
1 paper.