Towards a Universal Causal Reasoner
On the map: LLM reasoning → Causal reasoning in LLMs
Abstract (arXiv)
Despite the importance of causal reasoning, training LLMs to reason causally remains underexplored. Existing data efforts mostly focus on benchmarking LLMs on specific aspects of causality, making them less suitable for training generalizable causal reasoners. To address this, we propose UniCo, a data generation framework that both (1) addresses 18 causal query types across Pearl's Causal Ladder and (2) translates natively symbolic examples into code and natural language forms to simulate real-world use cases where causal terms are not explicitly specified. To ensure data quality, UniCo grounds answers with exact causal inference and filters cases with reasoning shortcuts. Upon supervised finetuning with 66.6K UniCo-generated instances, Qwen3-4B, Qwen3-8B and Olmo-3-7B-Instruct achieve an average of 22.9% improvements across all 18 in-distribution query types, and 8.1% over state-of-the-art causal data generation frameworks on 7 established causal benchmarks outside the training distribution. More importantly, in real-world medical understanding, legal decision, and tabular reasoning, UniCo-trained models consistently display more faithful reasoning traces, outperforming the base models by an average of 20.2% in faithfulness metrics. These suggest that causality-centered training not only strengthens causal reasoning, but also equips LLMs with a causal mindset in general reasoning tasks.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Causal reasoning in LLMs, one of 17 directions in LLM reasoning. Builds on 13 of its 46 references that are in the map. First posted on arXiv 24 May 2026.
Builds on
13 of 46 references.
Closest ancestors · 5
Same direction, newest first
- 2026Can Post-Training Transform LLMs into Causal Reasoners?6 Feb
- 2025CARE: Turning LLMs Into Causal Reasoning Expert20 Nov
- 2025Executable Counterfactuals: Improving LLMs' Causal Reasoning Through Code2 Oct
- 2025CounterBench: Evaluating and Improving Counterfactual Reasoning in Large Language Models16 Feb
- 2024Causal Evaluation of Language Models1 May
Other references · 8
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2025Reasoning Models Don't Always Say What They Thinkcited by 388
- 2026Reinforcement Learning via Self-Distillationcited by 285
- 2025Chain-of-Thought Reasoning In The Wild Is Not Always Faithfulcited by 166
- 2025Olmo 3cited by 95
- 2025Ice Cream Doesn't Cause Drowning: Benchmarking LLMs Against Statistical Pitfalls in Causal Inferencecited by 5
- 2025C2PO: Diagnosing and Disentangling Bias Shortcuts in LLMscited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Causal Reasoning and Large Language Models: Opening a New Frontier for Causality
- 2026Uncovering Hidden Correctness in LLM Causal Reasoning via Symbolic Verification
- 2023CLadder: Assessing Causal Reasoning in Language Models
- 2024A Critical Review of Causal Reasoning Benchmarks for Large Language Models
- 2026CausalFlip: A Benchmark for LLM Causal Judgment Beyond Semantic Matching
- 2024CausalGraph2LLM: Evaluating LLMs for Causal Queries
- 2025Causal Reasoning in Pieces: Modular In-Context Learning for Causal Discovery
- 2025Unveiling Causal Reasoning in Large Language Models: Reality or Mirage?