mlsanityData to 7 Oct 2026

The Imperfective Paradox in Large Language Models

arXiv 2601.09373 ↗First posted 14 Jan 2026cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Do Large Language Models (LLMs) genuinely grasp the compositional semantics of events, or do they rely on surface-level probabilistic heuristics? We investigate the Imperfective Paradox, a logical phenomenon where the past progressive aspect entails event realization for activities (e.g., running → ran) but not for accomplishments (e.g., building nrightarrow built). We introduce ImperfectiveNLI, a diagnostic dataset designed to probe this distinction across diverse semantic classes. Evaluating state-of-the-art open-weight models, we uncover a pervasive Teleological Bias: models systematically hallucinate completion for goal-oriented events, even overriding explicit textual cancellation. Prompting interventions partially reduce this bias but trigger a calibration crisis, causing models to incorrectly reject valid entailments for atelic verbs. Representational analyses further show that while internal embeddings often distinguish progressive from simple past forms, inference decisions are dominated by strong priors about goal attainment. Taken together, our findings indicate that these current open-weight LLMs operate as predictive narrative engines rather than faithful logical reasoners, and that resolving aspectual inference requires moving beyond prompting toward structurally grounded alignment.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 15 of its 60 references that are in the map. First posted on arXiv 14 Jan 2026.

Builds on

15 of 60 references.

References · 15

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  4. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
  5. 2015A large annotated corpus for learning natural language inferencecited by 1,837
  6. 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,103
  7. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
  8. 2019Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inferencecited by 864
  9. 2023Faith and Fate: Limits of Transformers on Compositionalitycited by 496
  10. 2019What BERT is not: Lessons from a new suite of psycholinguistic diagnostics for language modelscited by 317
  11. 2019Negated and Misprimed Probes for Pretrained Language Models: Birds Can Talk, But Cannot Flycited by 240
  12. 2021Goal-Oriented Script Constructioncited by 30
3 more
  1. 2021MTG: A Benchmark Suite for Multilingual Text Generationcited by 22
  2. 2025M-ABSA: A Multilingual Dataset for Aspect-Based Sentiment Analysiscited by 9
  3. 2020Aspectuality Across Genre: A Distributional Semantics Approachcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.