mlsanityData to 14 Oct 2026

Compressed Causal Reasoning: Quantization and GraphRAG Effects on Interventional and Counterfactual Accuracy

arXiv 2512.13725 ↗First posted 13 Dec 2025cs.AIcited by 0

On the map: LLM reasoning → Causal reasoning in LLMs

Abstract (arXiv)

Causal reasoning in Large Language Models spanning association, intervention, and counterfactual inference is essential for reliable decision making in high stakes settings. As deployment shifts toward edge and resource constrained environments, quantized models such as INT8 and NF4 are becoming standard. Yet the impact of precision reduction on formal causal reasoning is poorly understood. To our knowledge, this is the first study to systematically evaluate quantization effects across all three levels of Pearls Causal Ladder. Using a 3000 sample stratified CLadder benchmark, we find that rung level accuracy in Llama 3 8B remains broadly stable under quantization, with NF4 showing less than one percent overall degradation. Interventional queries at rung 2 are the most sensitive to precision loss, whereas counterfactual reasoning at rung 3 is comparatively stable but exhibits heterogeneous weaknesses across query types such as collider bias and backdoor adjustment. Experiments on the CRASS benchmark show near identical performance across precisions, indicating that existing commonsense counterfactual datasets lack the structural sensitivity needed to reveal quantization induced reasoning drift. We further evaluate Graph Retrieval Augmented Generation using ground truth causal graphs and observe a consistent improvement in NF4 interventional accuracy of plus 1.7 percent, partially offsetting compression related degradation. These results suggest that causal reasoning is unexpectedly robust to four bit quantization, graph structured augmentation can selectively reinforce interventional reasoning, and current counterfactual benchmarks fail to capture deeper causal brittleness. This work provides an initial empirical map of compressed causal reasoning and practical guidance for deploying efficient and structurally supported causal AI systems.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Causal reasoning in LLMs, one of 17 directions in LLM reasoning. Builds on 8 of its 22 references that are in the map. First posted on arXiv 13 Dec 2025.

Builds on

8 of 22 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024CARL-GT: Evaluating Causal Reasoning Capabilities of Large Language Models23 Dec
  2. 2024Failure Modes of LLMs for Causal Reasoning on Narratives31 Oct

Other references · 6

  1. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  2. 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 172
  3. 2024How Does Quantization Affect Multilingual LLMs?cited by 43
  4. 2025Quantization Meets Reasoning: Exploring LLM Low-Bit Quantization Degradation for Mathematical Reasoningcited by 37
  5. 2024Counterfactual Causal Inference in Natural Language with Large Language Modelscited by 7
  6. 2025Interpreting the Effects of Quantization on LLMscited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024A Critical Review of Causal Reasoning Benchmarks for Large Language Models
  2. 2026Better Think Thrice: Learning to Reason Causally with Double Counterfactual Consistency
  3. 2024CausalGraph2LLM: Evaluating LLMs for Causal Queries
  4. 2025CounterBench: Evaluating and Improving Counterfactual Reasoning in Large Language Models
  5. 2025Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models
  6. 2026RATIO: Reasoning Analysis and Token-level Inference Optimization for Quantized Reasoning Models
  7. 2023Causal Reasoning and Large Language Models: Opening a New Frontier for Causality
  8. 2026CausalFlip: A Benchmark for LLM Causal Judgment Beyond Semantic Matching