mlsanityData to 7 Oct 2026

Probabilistic Neuro-Symbolic Reasoning for Sparse Historical Data: A Framework Integrating Bayesian Inference, Causal Models, and Game-Theoretic Allocation

arXiv 2512.01723 ↗First posted 1 Dec 2025cs.AI cs.GT math.PRcited by 0

On the map: LLM reasoning → Causal reasoning in LLMs

Abstract (arXiv)

Modeling historical events poses fundamental challenges for machine learning: extreme data scarcity (N << 100), heterogeneous and noisy measurements, missing counterfactuals, and the requirement for human interpretable explanations. We present HistoricalML, a probabilistic neuro-symbolic framework that addresses these challenges through principled integration of (1) Bayesian uncertainty quantification to separate epistemic from aleatoric uncertainty, (2) structural causal models for counterfactual reasoning under confounding, (3) cooperative game theory (Shapley values) for fair allocation modeling, and (4) attention based neural architectures for context dependent factor weighting. We provide theoretical analysis showing that our approach achieves consistent estimation in the sparse data regime when strong priors from domain knowledge are available, and that Shapley based allocation satisfies axiomatic fairness guarantees that pure regression approaches cannot provide. We instantiate the framework on two historical case studies: the 19th century partition of Africa (N = 7 colonial powers) and the Second Punic War (N = 2 factions). Our model identifies Germany's +107.9 percent discrepancy as a quantifiable structural tension preceding World War I, with tension factor 36.43 and 0.79 naval arms race correlation. For the Punic Wars, Monte Carlo battle simulations achieve a 57.3 percent win probability for Carthage at Cannae and 57.8 percent for Rome at Zama, aligning with historical outcomes. Counterfactual analysis reveals that Carthaginian political support (support score 6.4 vs Napoleon's 7.1), rather than military capability, was the decisive factor.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Causal reasoning in LLMs, one of 17 directions in LLM reasoning. Builds on 6 of its 22 references that are in the map. First posted on arXiv 1 Dec 2025.

Builds on

6 of 22 references.

References · 6

  1. 2017Attention Is All You Needcited by 59,932
  2. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  3. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  4. 2015Weight Uncertainty in Neural Networkscited by 554
  5. 2020The Next Decade in AI: Four Steps Towards Robust Artificial Intelligencecited by 194
  6. 2019Neural-Symbolic Computing: An Effective Methodology for Principled Integration of Machine Learning and Reasoningcited by 149

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Causal Reasoning in the Presence of Latent Confounders via Neural ADMG Learning
  2. 2026Orca: Neural Operators for Causal Reasoning in Continuous Time
  3. 2024Large Language Models for Constrained-Based Causal Discovery
  4. 2024QUITE: Quantifying Uncertainty in Natural Language Text in Bayesian Reasoning Scenarios
  5. 2026The Weight of Silence: A Causal Case for Weights Over the Scratchpad in Latent Chess Reasoning
  6. 2025Causality for Natural Language Processing
  7. 2024A Critical Review of Causal Reasoning Benchmarks for Large Language Models
  8. 2025Causal Reasoning in Pieces: Modular In-Context Learning for Causal Discovery