mlsanityData to 7 Oct 2026

Lifted Relational Probabilistic Inference via Implicit Learning

arXiv 2602.14890 ↗First posted 16 Feb 2026cs.AIcited by 0

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Reconciling the tension between inductive learning and deductive reasoning in first-order relational domains is a longstanding challenge in AI. We study the problem of answering queries in a first-order relational probabilistic logic through a joint effort of learning and reasoning, without ever constructing an explicit model. Traditional lifted inference assumes access to a complete model and exploits symmetry to evaluate probabilistic queries; however, learning such models from partial, noisy observations is intractable in general. We reconcile these two challenges through implicit learning to reason and first-order relational probabilistic inference techniques. More specifically, we merge incomplete first-order axioms with independently sampled, partially observed examples into a bounded-degree fragment of the sum-of-squares (SOS) hierarchy in polynomial time. Our algorithm performs two lifts simultaneously: (i) grounding-lift, where renaming-equivalent ground moments share one variable, collapsing the domain of individuals; and (ii) world-lift, where all pseudo-models (partial world assignments) are enforced in parallel, producing a global bound that holds across all worlds consistent with the learned constraints. These innovations yield the first polynomial-time framework that implicitly learns a first-order probabilistic logic and performs lifted inference over both individuals and worlds.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 16 of its 37 references that are in the map. First posted on arXiv 16 Feb 2026.

Builds on

16 of 37 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024When a language model is optimized for reasoning, does it still show embers of autoregression? An analysis of OpenAI o12 Oct
  2. 2023Large Language Models Are Not Strong Abstract Reasoners31 May

Other references · 14

  1. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  2. 2023Faith and Fate: Limits of Transformers on Compositionalitycited by 496
  3. 2019Neural Probabilistic Logic Programming in DeepProbLogcited by 389
  4. 2023Embers of Autoregression: Understanding Large Language Models Through the Problem They are Trained to Solvecited by 175
  5. 2017End-to-End Differentiable Provingcited by 159
  6. 2017Logic Tensor Networks for Semantic Image Interpretationcited by 92
  7. 2020Inductive logic programming at 30: a new introductioncited by 83
  8. 2021Solving SDP Faster: A Robust IPM Framework and Efficient Implementationcited by 33
  9. 2019Neural Markov Logic Networkscited by 27
  10. 2022A Faster Interior-Point Method for Sum-of-Squares Optimizationcited by 7
  11. 2019Implicitly Learning to Reason in First-Order Logiccited by 3
  12. 2018Polynomial-time probabilistic reasoning with partial observations via implicit learning in probability logicscited by 2
2 more
  1. 2020Learning Implicitly with Noisy Data in Linear Arithmeticcited by 2
  2. 2025Polynomial-Time Relational Probabilistic Inference in Open Universescited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Inference of Abstraction for Grounded Predicate Logic
  2. 2016Structured Factored Inference: A Framework for Automated Reasoning in Probabilistic Programming Languages
  3. 2020Symbolic Learning and Reasoning with Noisy Data for Probabilistic Anchoring
  4. 2026Project Auto-World: Towards Automated Benchmarking of Neural Relational Reasoners
  5. 2022ThinkSum: Probabilistic reasoning over sets using large language models
  6. 2024The Quantified Boolean Bayesian Network: Theory and Experiments with a Logical Graphical Model
  7. 2026Structured Abductive-Deductive-Inductive Reasoning for LLMs via Algebraic Invariants
  8. 2025Toward Honest Language Models for Deductive Reasoning