mlsanityData to 7 Oct 2026

Logical Fallacy Detection

arXiv 2202.13758 ↗First posted 28 Feb 2022cs.CL cs.AI cs.CYcited by 25

Not on the map. Why?

Abstract (arXiv)

Reasoning is central to human intelligence. However, fallacious arguments are common, and some exacerbate problems such as spreading misinformation about climate change. In this paper, we propose the task of logical fallacy detection, and provide a new dataset (Logic) of logical fallacies generally found in text, together with an additional challenge set for detecting logical fallacies in climate change claims (LogicClimate). Detecting logical fallacies is a hard problem as the model must understand the underlying logical structure of the argument. We find that existing pretrained large language models perform poorly on this task. In contrast, we show that a simple structure-aware classifier outperforms the best language model by 5.46% on Logic and 4.51% on LogicClimate. We encourage future work to explore this task as (a) it can serve as a new reasoning challenge for language models, and (b) it can have potential applications in tackling the spread of misinformation. Our dataset and code are available at https://github.com/causalNLP/logical-fallacy

Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Builds on 26 of its 63 references that are in the map. First posted on arXiv 28 Feb 2022.

Builds on

26 of 63 references.

References · 26

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  6. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  7. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  8. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,665
  9. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
  10. 2020Big Bird: Transformers for Longer Sequencescited by 1,673
  11. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
  12. 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 719
14 more
  1. 2020MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devicescited by 476
  2. 2019Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approachcited by 299
  3. 2017Automatic Detection of Fake Newscited by 145
  4. 2021Automated Fact-Checking for Assisting Human Fact-Checkerscited by 144
  5. 2019Fine-Grained Analysis of Propaganda in News Articlescited by 130
  6. 2020SemEval-2020 Task 11: Detection of Propaganda Techniques in News Articlescited by 79
  7. 2017The Argument Reasoning Comprehension Task: Identification and Reconstruction of Implicit Warrantscited by 55
  8. 2018Towards Automated Factchecking: Developing an Annotation Schema and Benchmark for Consistent Automated Claim Detectioncited by 55
  9. 2018Before Name-calling: Dynamics and Triggers of Ad Hominem Fallacies in Web Argumentationcited by 32
  10. 2017A simple but tough-to-beat baseline for the Fake News Challenge stance detection taskcited by 26
  11. 2019Findings of the NLP4IF-2019 Shared Task on Fine-Grained Propaganda Detectioncited by 24
  12. 2020Prta: A System to Support the Analysis of Propaganda Techniques in the Newscited by 23
  13. 2021How Good Is NLP? A Sober Look at NLP Tasks through the Lens of Social Impactcited by 18
  14. 2021Micromodels for Efficient, Explainable, and Reusable Systems: A Case Study on Mental Healthcited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 8; 2024: 5; 2025: 5; 2026: 5.

25 papers.

Sort:

By area:

  1. 2023Can Large Language Models Infer Causation from Correlation?cited by 142
  2. 2022Missing Counter-Evidence Renders NLP Fact-Checking Unrealistic for Misinformationcited by 45
  3. 2023How susceptible are LLMs to Logical Fallacies?cited by 23
  4. 2023Multitask Instruction-based Prompting for Fallacy Recognitioncited by 22
  5. 2022Robust and Explainable Identification of Logical Fallacies in Natural Language Argumentscited by 12
  6. 2023Case-Based Reasoning with Language Models for Classification of Logical Fallaciescited by 8
  7. 2023Deductive Additivity for Planning of Natural Language Proofscited by 3
  8. 2025SR-LLM: Rethinking the Structured Representation in Large Language Modelcited by 3
  9. 2025Socrates or Smartypants: Testing Logic Reasoning Capabilities of Large Language Models with Logic Programming-based Test Oraclescited by 2
  10. 2023Modeling Appropriate Language in Argumentationcited by 1
  11. 2023Multi-Task Learning Improves Performance In Deep Argument Mining Modelscited by 1
  12. 2024Detecting Fallacies in Climate Misinformation: A Technocognitive Approach to Identifying Misleading Argumentationcited by 1
13 more
  1. 2024Investigating Persuasion Techniques in Arabic: An Empirical Study Leveraging Large Language Modelscited by 1
  2. 2024Generative Debunking of Climate Misinformationcited by 1
  3. 2024Do Large Language Models Show Biases in Causal Learning?cited by 1
  4. 2025Follow My Lead: Logical Fallacy Classification with Knowledge-Augmented LLMscited by 1
  5. 2025Do Large Language Models Show Biases in Causal Learning? Insights from Contingency Judgmentcited by 1
  6. 2026A dataset of rated conceptual argumentscited by 1
  7. 2023Teach Me How to Improve My Argumentation Skills: A Survey on Feedback in Argumentationcited by 0
  8. 2024Can a Hallucinating Model help in Reducing Human "Hallucination"?cited by 0
  9. 2025MisSynth: Improving MISSCI Logical Fallacies Classification with Synthetic Datacited by 0
  10. 2026VIGIL: An Extensible System for Real-Time Detection and Mitigation of Cognitive Bias Triggerscited by 0
  11. 2026Math Education Digital Shadows for Investigating Learning with GenAI: Mathematics Performance, Anxiety, and Confidence in LLMscited by 0
  12. 2026ForEx: A Formal Verification Framework for Explainable Reasoning in Logical Fallacy Detection and Annotationcited by 0
  13. 2026DeflectBench: A Benchmark for Evaluating Rhetorical Fallacy Generation in LLMscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Large Language Models Are Better Logical Fallacy Reasoners with Counterargument, Explanation, and Goal-Aware Prompt Formulation
  2. 2024Boosting Logical Fallacy Reasoning in LLMs via Logical Structure Tree
  3. 2024A Logical Fallacy-Informed Framework for Argument Generation
  4. 2024Reason from Fallacy: Enhancing Large Language Models' Logical Reasoning through Logical Fallacy Understanding
  5. 2025Addressing Logical Fallacies In Scientific Reasoning From Large Language Models: Towards a Dual-Inference Training Framework
  6. 2026Retrieving Relations, Detecting Fallacies: A RAG Approach to Political Debate Analysis
  7. 2025Theory-Grounded Evaluation of Human-Like Fallacy Patterns in LLM Reasoning
  8. 2025Assessing LLM Reasoning Through Implicit Causal Chain Discovery in Climate Discourse