mlsanityData to 7 Oct 2026

I Know What I Don't Know: Latent Posterior Factor Models for Multi-Evidence Probabilistic Reasoning

arXiv 2603.15670 ↗First posted 13 Mar 2026cs.AI cs.LGcited by 0

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Real-world decision-making, from tax compliance assessment to medical diagnosis, requires aggregating multiple noisy and potentially contradictory evidence sources. Existing approaches either lack explicit uncertainty quantification (neural aggregation methods) or rely on manually engineered discrete predicates (probabilistic logic frameworks), limiting scalability to unstructured data. We introduce Latent Posterior Factors (LPF), a framework that transforms Variational Autoencoder (VAE) latent posteriors into soft likelihood factors for Sum-Product Network (SPN) inference, enabling tractable probabilistic reasoning over unstructured evidence while preserving calibrated uncertainty estimates. We instantiate LPF as LPF-SPN (structured factor-based inference) and LPF-Learned (end-to-end learned aggregation), enabling a principled comparison between explicit probabilistic reasoning and learned aggregation under a shared uncertainty representation. Across eight domains (seven synthetic and the FEVER benchmark), LPF-SPN achieves high accuracy (up to 97.8%), low calibration error (ECE 1.4%), and strong probabilistic fit, substantially outperforming evidential deep learning, LLMs and graph-based baselines over 15 random seeds. Contributions: (1) A framework bridging latent uncertainty representations with structured probabilistic reasoning. (2) Dual architectures enabling controlled comparison of reasoning paradigms. (3) Reproducible training methodology with seed selection. (4) Evaluation against EDL, BERT, R-GCN, and large language model baselines. (5) Cross-domain validation. (6) Formal guarantees in a companion paper.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 9 of its 88 references that are in the map. First posted on arXiv 13 Mar 2026.

Builds on

9 of 88 references.

References · 9

  1. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  2. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  3. 2020Longformer: The Long-Document Transformercited by 3,362
  4. 2023Qwen Technical Reportcited by 3,273
  5. 2018Model Cards for Model Reportingcited by 1,068
  6. 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 777
  7. 2022Conformal Risk Controlcited by 290
  8. 2017SafetyNets: Verifiable Execution of Deep Neural Networks on an Untrusted Cloudcited by 50
  9. 2018Trustless Machine Learning Contracts; Evaluating and Exchanging Machine Learning Models on the Ethereum Blockchaincited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond Dense States: Sparse Transcoders as Causally Testable Operators for LLM Latent Reasoning
  2. 2026Amortized Factor Inference Networks for Posterior Inference
  3. 2026Diagnosing and Improving Probabilistic Reasoning in Large Language Models
  4. 2025Deliberative Reasoning Network: An Uncertainty-Driven Paradigm for Belief-Tracked Inference with Pretrained Language Models
  5. 2025Latent Factor Models Meets Instructions: Goal-conditioned Latent Factor Discovery without Task Supervision
  6. 2026ReGuLaR: Variational Latent Reasoning Guided by Rendered Chain-of-Thought
  7. 2026RuPLaR : Efficient Latent Compression of LLM Reasoning Chains with Rule-Based Priors From Multi-Step to One-Step
  8. 2026Neural Bayesian Sequential Routing