Contextual Causality with Large Language Models: A Survey
Not on the map. Why?
Abstract (arXiv)
Understanding contextual causality is critical for large language models (LLMs), as it enables them to accurately identify causal relations in specific situations and support more reliable decision-making. Despite its significance, a systematic exploration of contextual causality with LLMs is still lacking. To fill this gap, we present a comprehensive survey on this topic. In this survey, we first propose a taxonomy of contextual causality, consisting of semantic, intervention, and counterfactual causality, and characterize each category by its core causal question, required model capabilities, representative tasks, and practical uses in causality analysis. We then analyze existing studies and discuss their key limitations. Finally, we examine the gaps between current benchmarks and real-world needs and outline promising directions for future research. Our goal is to clarify the research landscape of contextual causality with LLMs, emphasize its importance, and highlight promising future directions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 72 references that are in the map. First posted on arXiv 18 Sep 2026.
Builds on
40 of 72 references.
References · 40
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023Qwen Technical Reportcited by 3,344
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
- 2025LIMO: Less is More for Reasoningcited by 498
- 2024From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judgecited by 494
- 2023Causal Reasoning and Large Language Models: Opening a New Frontier for Causalitycited by 353
- 2020XCOPA: A Multilingual Dataset for Causal Commonsense Reasoningcited by 333
- 2019Abductive Commonsense Reasoningcited by 301
- 2024ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discoverycited by 235
- 2022On the Origin of Hallucinations in Conversational Models: Is it the Datasets or the Models?cited by 138
- 2025KodCode: A Diverse, Challenging, and Verifiable Synthetic Dataset for Codingcited by 119
28 more
- 2025Small Models Struggle to Learn from Strong Reasonerscited by 113
- 2019Counterfactual Story Reasoning and Generationcited by 88
- 2023Is ChatGPT a Good Causal Reasoner? A Comprehensive Evaluationcited by 69
- 2025SWE-EVO: Benchmarking Coding Agents in Long-Horizon Software Evolution Scenarioscited by 59
- 2022e-CARE: a New Dataset for Exploring Explainable Causal Reasoningcited by 47
- 2023MoCa: Measuring Human-Language Model Alignment on Causal and Moral Judgment Taskscited by 44
- 2025Unveiling Causal Reasoning in Large Language Models: Reality or Mirage?cited by 38
- 2025A Survey of Process Reward Models: From Outcome Signals to Process Supervisions for Large Language Modelscited by 38
- 2024Causal Inference with Large Language Model: A Surveycited by 32
- 2020Financial Document Causality Detection Shared Task (FinCausal 2020)cited by 31
- 2023CRAB: Assessing the Strength of Causal Relationships Between Real-world Eventscited by 28
- 2021TellMeWhy: A Dataset for Answering Why-Questions in Narrativescited by 27
- 2023IfQA: A Dataset for Open-domain Question Answering under Counterfactual Presuppositionscited by 26
- 2024Large Language Models for Causal Discovery: Current Landscape and Future Directionscited by 25
- 2026Rethinking Failure Attribution in Multi-Agent Systems: A Multi-Perspective Benchmark and Evaluationcited by 24
- 2024Cause and Effect: Can Large Language Models Truly Understand Causality?cited by 23
- 2022WikiWhy: Answering and Explaining Cause-and-Effect Questionscited by 21
- 2023The Magic of IF: Investigating Causal Reasoning Abilities in Large Language Models of Codecited by 21
- 2024A Survey on Natural Language Counterfactual Generationcited by 21
- 2024CausalEval: Towards Better Causal Reasoning in Language Modelscited by 13
- 2024Document-level Causal Relation Extraction with Knowledge-guided Binary Question Answeringcited by 12
- 2022UniCausal: Unified Benchmark and Repository for Causal Text Miningcited by 10
- 2023Emerging Synergies in Causality and Deep Generative Models: A Surveycited by 10
- 2025The Quest for Efficient Reasoning: A Data-Centric Benchmark to CoT Distillationcited by 9
- 2024A Survey of Event Causality Identification: Taxonomy, Challenges, Assessment, and Prospectscited by 6
- 2024The Odyssey of Commonsense Causality: From Foundational Benchmarks to Cutting-Edge Reasoningcited by 5
- 2025Causal MAS: A Survey of Large Language Model Architectures for Discovery and Effect Estimationcited by 2
- 2025Event Causality Identification with Synthetic Controlcited by 2
Built on by
Not cited yet.