mlsanityData to 14 Oct 2026

Contextual Causality with Large Language Models: A Survey

arXiv 2609.22409 ↗First posted 18 Sep 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Understanding contextual causality is critical for large language models (LLMs), as it enables them to accurately identify causal relations in specific situations and support more reliable decision-making. Despite its significance, a systematic exploration of contextual causality with LLMs is still lacking. To fill this gap, we present a comprehensive survey on this topic. In this survey, we first propose a taxonomy of contextual causality, consisting of semantic, intervention, and counterfactual causality, and characterize each category by its core causal question, required model capabilities, representative tasks, and practical uses in causality analysis. We then analyze existing studies and discuss their key limitations. Finally, we examine the gaps between current benchmarks and real-world needs and outline promising directions for future research. Our goal is to clarify the research landscape of contextual causality with LLMs, emphasize its importance, and highlight promising future directions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 72 references that are in the map. First posted on arXiv 18 Sep 2026.

Builds on

40 of 72 references.

References · 40

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023Qwen Technical Reportcited by 3,344
  3. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
  4. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
  5. 2025LIMO: Less is More for Reasoningcited by 498
  6. 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 494
  7. 2023Causal Reasoning and Large Language Models: Opening a New Frontier for Causalitycited by 353
  8. 2020XCOPA: A Multilingual Dataset for Causal Commonsense Reasoningcited by 333
  9. 2019Abductive Commonsense Reasoningcited by 301
  10. 2024ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discoverycited by 235
  11. 2022On the Origin of Hallucinations in Conversational Models: Is it the Datasets or the Models?cited by 138
  12. 2025KodCode: A Diverse, Challenging, and Verifiable Synthetic Dataset for Codingcited by 119
28 more
  1. 2025Small Models Struggle to Learn from Strong Reasonerscited by 113
  2. 2019Counterfactual Story Reasoning and Generationcited by 88
  3. 2023Is ChatGPT a Good Causal Reasoner? A Comprehensive Evaluationcited by 69
  4. 2025SWE-EVO: Benchmarking Coding Agents in Long-Horizon Software Evolution Scenarioscited by 59
  5. 2022e-CARE: a New Dataset for Exploring Explainable Causal Reasoningcited by 47
  6. 2023MoCa: Measuring Human-Language Model Alignment on Causal and Moral Judgment Taskscited by 44
  7. 2025Unveiling Causal Reasoning in Large Language Models: Reality or Mirage?cited by 38
  8. 2025A Survey of Process Reward Models: From Outcome Signals to Process Supervisions for Large Language Modelscited by 38
  9. 2024Causal Inference with Large Language Model: A Surveycited by 32
  10. 2020Financial Document Causality Detection Shared Task (FinCausal 2020)cited by 31
  11. 2023CRAB: Assessing the Strength of Causal Relationships Between Real-world Eventscited by 28
  12. 2021TellMeWhy: A Dataset for Answering Why-Questions in Narrativescited by 27
  13. 2023IfQA: A Dataset for Open-domain Question Answering under Counterfactual Presuppositionscited by 26
  14. 2024Large Language Models for Causal Discovery: Current Landscape and Future Directionscited by 25
  15. 2026Rethinking Failure Attribution in Multi-Agent Systems: A Multi-Perspective Benchmark and Evaluationcited by 24
  16. 2024Cause and Effect: Can Large Language Models Truly Understand Causality?cited by 23
  17. 2022WikiWhy: Answering and Explaining Cause-and-Effect Questionscited by 21
  18. 2023The Magic of IF: Investigating Causal Reasoning Abilities in Large Language Models of Codecited by 21
  19. 2024A Survey on Natural Language Counterfactual Generationcited by 21
  20. 2024CausalEval: Towards Better Causal Reasoning in Language Modelscited by 13
  21. 2024Document-level Causal Relation Extraction with Knowledge-guided Binary Question Answeringcited by 12
  22. 2022UniCausal: Unified Benchmark and Repository for Causal Text Miningcited by 10
  23. 2023Emerging Synergies in Causality and Deep Generative Models: A Surveycited by 10
  24. 2025The Quest for Efficient Reasoning: A Data-Centric Benchmark to CoT Distillationcited by 9
  25. 2024A Survey of Event Causality Identification: Taxonomy, Challenges, Assessment, and Prospectscited by 6
  26. 2024The Odyssey of Commonsense Causality: From Foundational Benchmarks to Cutting-Edge Reasoningcited by 5
  27. 2025Causal MAS: A Survey of Large Language Model Architectures for Discovery and Effect Estimationcited by 2
  28. 2025Event Causality Identification with Synthetic Controlcited by 2

Built on by

Not cited yet.