mlsanityData to 14 Oct 2026

Not all Negation Cues are Equal: Affixal Negations Yield Better Negation Understanding

arXiv 2609.13685 ↗First posted 12 Sep 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Negation remains a longstanding challenge for both language models (LMs) and large language models (LLMs). Prior work mainly focuses on a small set of high-frequency single-word negation cues, such as not and never, with limited exploration of broader negation types and modern LLMs. To address this gap, we construct NegCue, a large-scale dataset containing over 1.8M samples spanning single-word, multi-word, and affixal negation with more than 200 unique cues. We further pre-train both encoder-only LMs and LLMs on NegCue to investigate how different negation types affect negation understanding. Experiments on five downstream benchmarks show that negation types contribute unevenly to performance gains under the same training scale. In particular, affixal negation yields the largest improvements, while the gains from the commonly studied single-word negation remain modest. Moreover, our results demonstrate that further pre-training improves negation understanding for both LMs and LLMs.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 46 references that are in the map. First posted on arXiv 12 Sep 2026.

Builds on

27 of 46 references.

References · 27

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2024The Llama 3 Herd of Modelscited by 14,715
  5. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  6. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  7. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  8. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
  9. 2015A large annotated corpus for learning natural language inferencecited by 1,847
  10. 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
  11. 2019What BERT is not: Lessons from a new suite of psycholinguistic diagnostics for language modelscited by 320
  12. 2023Inverse Scaling: When Bigger Isn't Bettercited by 207
15 more
  1. 2022Inverse scaling can become U-shapedcited by 76
  2. 2021Understanding by Understanding Not: Modeling Negation in Language Modelscited by 73
  3. 2022CONDAQA: A Contrastive Reading Comprehension Dataset for Reasoning about Negationcited by 39
  4. 2023NevIR: Negation in Neural Information Retrievalcited by 29
  5. 2022Not another Negation Benchmark: The NaN-NLI Test Suite for Sub-clausal Negationcited by 25
  6. 2020It's not a Non-Issue: Negation as a Source of Error in Machine Translationcited by 19
  7. 2023ScoNe: Benchmarking Negation Reasoning in Language Models With Fine-Tuning and In-Context Learningcited by 18
  8. 2024Investigating and Addressing Hallucinations of LLMs in Tasks Involving Negationcited by 15
  9. 2022Improving negation detection with negation-focused pre-trainingcited by 14
  10. 2023Beyond Positive Scaling: How Negation Impacts Scaling Trends of Language Modelscited by 12
  11. 2024Paraphrasing in Affirmative Terms Improves Negation Understandingcited by 8
  12. 2022Leveraging Affirmative Interpretations from Negation Improves Natural Language Understandingcited by 7
  13. 2023Assessing Step-by-Step Reasoning against Lexical Negation: A Case Study on Syllogismcited by 6
  14. 2025Making Language Models Robust Against Negationcited by 3
  15. 2024Revisiting subword tokenization: A case study on affixal negation in large language modelscited by 2

Built on by

Not cited yet.