# Loopy Belief Propagation for Approximate Inference: An Empirical Study

arXiv: https://arxiv.org/abs/1301.6725 · HTML: https://mlsanity.com/paper/1301.6725/

## Key facts

- Cited by 76 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 23 Jan 2013.

## Built on by (most cited first, 30 of 76)

- [Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges](https://mlsanity.com/paper/2104.13478/) (2021)
- [Training and Inference on Any-Order Autoregressive Models the Right Way](https://mlsanity.com/paper/2205.13554/) (2022)
- [Federated Edge Learning with Misaligned Over-The-Air Computation](https://mlsanity.com/paper/2102.13604/) (2021)
- [Zero-Shot Scene Graph Relation Prediction through Commonsense Knowledge Integration](https://mlsanity.com/paper/2107.05080/) (2021)
- [Amortized Variational Inference: A Systematic Review](https://mlsanity.com/paper/2209.10888/) (2022)
- [Factor Graph Neural Networks](https://mlsanity.com/paper/2308.00887/) (2023)
- [A visual introduction to Gaussian Belief Propagation](https://mlsanity.com/paper/2107.02308/) (2021)
- [Neural Structured Prediction for Inductive Node Classification](https://mlsanity.com/paper/2204.07524/) (2022)
- [CARE: Certifiably Robust Learning with Reasoning via Variational Inference](https://mlsanity.com/paper/2209.05055/) (2022)
- [A Robot Web for Distributed Many-Device Localisation](https://mlsanity.com/paper/2202.03314/) (2022)
- [Bayesian Social Deduction with Graph-Informed Language Models](https://mlsanity.com/paper/2506.17788/) (2025)
- [Model Generalization on Text Attribute Graphs: Principles with Large Language Models](https://mlsanity.com/paper/2502.11836/) (2025)
- [Non-backtracking Graph Neural Networks](https://mlsanity.com/paper/2310.07430/) (2023)
- [Constraining Linear-chain CRFs to Regular Languages](https://mlsanity.com/paper/2106.07306/) (2021)
- [Neural Belief Propagation for Scene Graph Generation](https://mlsanity.com/paper/2112.05727/) (2021)
- [PGMax: Factor Graphs for Discrete Probabilistic Graphical Models and Loopy Belief Propagation in JAX](https://mlsanity.com/paper/2202.04110/) (2022)
- [Graph Neural Networks Intersect Probabilistic Graphical Models: A Survey](https://mlsanity.com/paper/2206.06089/) (2022)
- [A Graph Is More Than Its Nodes: Towards Structured Uncertainty-Aware Learning on Graphs](https://mlsanity.com/paper/2210.15575/) (2022)
- [Scalable Anytime Planning for Multi-Agent MDPs](https://mlsanity.com/paper/2101.04788/) (2021)
- [Yes We Care! -- Certification for Machine Learning Methods through the Care Label Framework](https://mlsanity.com/paper/2105.10197/) (2021)
- [Review of Video Predictive Understanding: Early Action Recognition and Future Action Prediction](https://mlsanity.com/paper/2107.05140/) (2021)
- [Joint Open Knowledge Base Canonicalization and Linking](https://mlsanity.com/paper/2212.01207/) (2022)
- [Total Variation Distance Meets Probabilistic Inference](https://mlsanity.com/paper/2309.09134/) (2023)
- [Blind Channel Estimation and Joint Symbol Detection with Data-Driven Factor Graphs](https://mlsanity.com/paper/2401.12627/) (2024)
- [Possible Principles for Aligned Structure Learning Agents](https://mlsanity.com/paper/2410.00258/) (2024)
- [Graph Belief Propagation Networks](https://mlsanity.com/paper/2106.03033/) (2021)
- [Learning Dynamics and Structure of Complex Systems Using Graph Neural Networks](https://mlsanity.com/paper/2202.10996/) (2022)
- [Structured Bayesian Compression for Deep Neural Networks Based on The Turbo-VBI Approach](https://mlsanity.com/paper/2302.10483/) (2023)
- [The Quantified Boolean Bayesian Network: Theory and Experiments with a Logical Graphical Model](https://mlsanity.com/paper/2402.06557/) (2024)
- [Gaussian Ensemble Belief Propagation for Efficient Inference in High-Dimensional Systems](https://mlsanity.com/paper/2402.08193/) (2024)

## Abstract (arXiv)

Recently, researchers have demonstrated that loopy belief propagation - the use of Pearls polytree algorithm IN a Bayesian network WITH loops OF error- correcting codes.The most dramatic instance OF this IS the near Shannon - limit performance OF Turbo Codes codes whose decoding algorithm IS equivalent TO loopy belief propagation IN a chain - structured Bayesian network. IN this paper we ask : IS there something special about the error - correcting code context, OR does loopy propagation WORK AS an approximate inference schemeIN a more general setting? We compare the marginals computed using loopy propagation TO the exact ones IN four Bayesian network architectures, including two real - world networks : ALARM AND QMR.We find that the loopy beliefs often converge AND WHEN they do, they give a good approximation TO the correct marginals.However,ON the QMR network, the loopy beliefs oscillated AND had no obvious relationship TO the correct posteriors. We present SOME initial investigations INTO the cause OF these oscillations, AND show that SOME simple methods OF preventing them lead TO the wrong results.