mlsanityData to 14 Oct 2026

CRAwDAD: Causal Reasoning Augmentation with Dual-Agent Debate

arXiv 2511.22854 ↗First posted 28 Nov 2025cs.LG cs.MAcited by 1

On the map: LLM reasoning → Causal reasoning in LLMs

also in 1 more
Abstract (arXiv)

When people reason about cause and effect, they often consider many competing "what if" scenarios before deciding which explanation fits best. Analogously, advanced language models capable of causal inference can consider multiple interventions and counterfactuals to judge the validity of causal claims. Crucially, this type of reasoning is less like a single calculation and more like an internal dialogue between alternative hypotheses. In this paper, we make this dialogue explicit through a dual-agent debate framework where one model provides a structured causal inference, and the other critically examines this reasoning for logical flaws. When disagreements arise, the agents attempt to persuade each other, challenging each other's logic and revising their conclusions until they converge on a mutually agreed answer. To take advantage of this deliberative process, we specifically use reasoning language models, whose strengths in both causal inference and adversarial debate remain under-explored relative to standard large language models. We evaluate our approach on the CLadder dataset, a benchmark linking natural language questions to formally defined causal graphs across all three rungs of Pearl's ladder of causation. With Qwen3 and DeepSeek-R1 as debater agents, we demonstrate that multi-agent debate improves DeepSeek-R1's overall accuracy in causal inference from 78.03% to 87.45%, with the counterfactual category specifically improving from 67.94% to 80.04% accuracy. Similarly, Qwen3's overall accuracy improves from 84.16% to 89.41%, and counterfactual questions from 71.53% to 80.35%, showing that even strong models can still benefit greatly from debate with weaker agents. Our results highlight the potential of reasoning models as building blocks for multi-agent systems in causal inference, and demonstrate the importance of diverse perspectives in causal problem-solving.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Causal reasoning in LLMs, one of 17 directions in LLM reasoning. Builds on 44 of its 60 references that are in the map. First posted on arXiv 28 Nov 2025.

Builds on

44 of 60 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025A Survey on Enhancing Causal Reasoning Ability of Large Language Models12 Mar
  2. 2024CausalEval: Towards Better Causal Reasoning in Language Models22 Oct
  3. 2024C2P: Featuring Large Language Models with Causal Reasoning25 Jul
  4. 2023CLadder: Assessing Causal Reasoning in Language Models7 Dec
  5. 2023Towards CausalGPT: A Multi-Agent Approach for Faithful Knowledge Reasoning via Promoting Causal Consistency in LLMs23 Aug
  6. 2023Causal Reasoning and Large Language Models: Opening a New Frontier for Causality28 Apr

Other references · 38

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  5. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
  6. 2024OpenAI o1 System Cardcited by 1,244
  7. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
  8. 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debatecited by 742
  9. 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 642
  10. 2024Mixture-of-Agents Enhances Large Language Model Capabilitiescited by 438
  11. 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 431
  12. 2023ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMscited by 309
26 more
  1. 2024Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judgecited by 269
  2. 2024Scaling Large Language Model-based Multi-Agent Collaborationcited by 241
  3. 2024When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Methodcited by 204
  4. 2024Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key?cited by 159
  5. 2023Causal Parrots: Large Language Models May Talk Causality But Are Not Causalcited by 150
  6. 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Modelscited by 135
  7. 2024Let Me Speak Freely? A Study on the Impact of Format Restrictions on Performance of Large Language Modelscited by 96
  8. 2023Understanding Causality with Large Language Models: Feasibility and Opportunitiescited by 53
  9. 2024Efficient Causal Graph Discovery Using Large Language Modelscited by 53
  10. 2025When Thinking Fails: The Pitfalls of Reasoning for Instruction-Following in LLMscited by 53
  11. 2025SWE-Debate: Competitive Multi-Agent Debate for Software Issue Resolutioncited by 53
  12. 2025Debate Only When Necessary: Adaptive Multiagent Collaboration for Efficient LLM Reasoningcited by 27
  13. 2024Large Language Models and Causal Inference in Collaboration: A Surveycited by 26
  14. 2024Multi-Agent Causal Discovery Using Large Language Modelscited by 26
  15. 2024Causality for Large Language Modelscited by 25
  16. 2024CausalBN-Bench: A Comprehensive Benchmark for Causal Learning Capability of LLMscited by 20
  17. 2024An Empirical Analysis on Large Language Models in Debate Evaluationcited by 20
  18. 2025Enhancing Multi-Agent Debate System Performance via Confidence Expressioncited by 19
  19. 2025Literature Review Of Multi-Agent Debate For Problem-Solvingcited by 15
  20. 2024M-MAD: Multidimensional Multi-Agent Debate for Advanced Machine Translation Evaluationcited by 13
  21. 2025Enhancing LLM Performance Through Debate: An Empirical Study on Multi-Agent Debate for Coding Taskscited by 11
  22. 2025When Two LLMs Debate, Both Think They'll Wincited by 10
  23. 2023LLM4Causal: Democratized Causal Tools for Everyone via Large Language Modelcited by 9
  24. 2025LLM Cannot Discover Causality, and Should Be Restricted to Non-Decisional Support in Causal Discoverycited by 8
  25. 2024The Odyssey of Commonsense Causality: From Foundational Benchmarks to Cutting-Edge Reasoningcited by 5
  26. 2025Quantitative Analysis of Performance Drop in DeepSeek Model Quantizationcited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026CausalAgent: A Conversational Multi-Agent System for End-to-End Causal Inference
  2. 2025Causal MAS: A Survey of Large Language Model Architectures for Discovery and Effect Estimation
  3. 2025Causal Reasoning in Pieces: Modular In-Context Learning for Causal Discovery
  4. 2026The Reasoning Trap: An Information-Theoretic Bound on Closed-System Multi-Step LLM Reasoning
  5. 2025BiasCause: Evaluate Socially Biased Causal Reasoning of Large Language Models
  6. 2026Leveraging Large Language Models for Causal Discovery: a Constraint-based, Argumentation-driven Approach
  7. 2025Assessing LLM Reasoning Through Implicit Causal Chain Discovery in Climate Discourse
  8. 2026NoisyCausal: A Benchmark for Evaluating Causal Reasoning Under Structured Noise