Belief Propagation Neural Networks
Not on the map. Why?
Abstract (arXiv)
Learned neural solvers have successfully been used to solve combinatorial optimization and decision problems. More general counting variants of these problems, however, are still largely solved with hand-crafted solvers. To bridge this gap, we introduce belief propagation neural networks (BPNNs), a class of parameterized operators that operate on factor graphs and generalize Belief Propagation (BP). In its strictest form, a BPNN layer (BPNN-D) is a learned iterative operator that provably maintains many of the desirable properties of BP for any choice of the parameters. Empirically, we show that by training BPNN-D learns to perform the task better than the original BP: it converges 1.7x faster on Ising models while providing tighter bounds. On challenging model counting problems, BPNNs compute estimates 100's of times faster than state-of-the-art handcrafted methods, while returning an estimate of comparable quality.
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 6; 2023: 3; 2024: 5; 2025: 5; 2026: 2.
31 papers.
Sort:
By area:
- 2022Understanding Non-linearity in Graph Neural Networks from the Bayesian-Inference Perspectivecited by 19
- 2022NSNet: A General Neural Probabilistic Framework for Satisfiability Problemscited by 18
- 2021A visual introduction to Gaussian Belief Propagationcited by 12
- 2021Deep learning via message passing algorithms based on belief propagationcited by 12
- 2023Joint Entity and Relation Extraction with Span Pruning and Hypergraph Neural Networkscited by 11
- 2021Partition Function Estimation: A Quantitative Studycited by 8
- 2021Neural Belief Propagation for Scene Graph Generationcited by 6
- 2021Relational Reasoning Networkscited by 4
- 2024Learning to Solve the Constrained Most Probable Explanation Task in Probabilistic Graphical Modelscited by 3
- 2024Understanding GNNs for Boolean Satisfiability through Approximation Algorithmscited by 3
- 2021Graph Belief Propagation Networkscited by 2
- 2025Mitigating Attention Localization in Small Scale: Self-Attention Refinement via One-step Belief Propagationcited by 2
19 more
- 2025Vejde: A Framework for Inductive Deep Reinforcement Learning Based on Factor Graph Color Refinementcited by 2
- 2021Equivariant Neural Network for Factor Graphscited by 1
- 2021Robust Deep Learning from Crowds with Belief Propagationcited by 1
- 2021Adversarial Neural Networks for Error Correcting Codescited by 1
- 2022IBIA: Bayesian Inference via Incremental Build-Infer-Approximate operations on Clique Treescited by 1
- 2022Graph Neural Networks for Propositional Model Countingcited by 1
- 2022Deep Attentive Belief Propagation: Integrating Reasoning and Learning for Solving Constraint Optimization Problemscited by 1
- 2025Physics Informed Constrained Learning of Dynamics from Static Datacited by 1
- 2025Transformer-Based Decoding in Concatenated Coding Schemes Under Synchronization Errorscited by 1
- 2021Unifying AI Algorithms with Probabilistic Programming using Implicitly Defined Representationscited by 0
- 2022Neural Bayesian Network Understudycited by 0
- 2023Local Message Passing on Frustrated Systemscited by 0
- 2023Classification-Aided Robust Multiple Target Tracking Using Neural Enhanced Message Passingcited by 0
- 2024Circular Belief Propagation for Approximate Probabilistic Inferencecited by 0
- 2024ReMAP: Neural Reparameterization for Scalable MAP Inference in Arbitrary-Order Markov Random Fieldscited by 0
- 2024The Role of Recurrency in Image Segmentation for Noisy and Limited Sample Settingscited by 0
- 2025Attn-JGNN: Attention Enhanced Join-Graph Neural Networkscited by 0
- 2026In-Context Graphical Inferencecited by 0
- 2026Graph neural networks and the energetic cavity method for combinatorial optimizationcited by 0
- 2026Graph neural networks and the energetic cavity method for combinatorial optimization7 Sep 2026
- 2026In-Context Graphical Inference3 Jun 2026
- 2025Transformer-Based Decoding in Concatenated Coding Schemes Under Synchronization Errors2 Nov 2025
- 2025Attn-JGNN: Attention Enhanced Join-Graph Neural Networks17 Oct 2025
- 2025Vejde: A Framework for Inductive Deep Reinforcement Learning Based on Factor Graph Color Refinement11 Sep 2025
- 2025Mitigating Attention Localization in Small Scale: Self-Attention Refinement via One-step Belief Propagation9 Sep 2025
- 2025Physics Informed Constrained Learning of Dynamics from Static Data17 Apr 2025
- 2024The Role of Recurrency in Image Segmentation for Noisy and Limited Sample Settings20 Dec 2024
- 2024ReMAP: Neural Reparameterization for Scalable MAP Inference in Arbitrary-Order Markov Random Fields28 Nov 2024
- 2024Understanding GNNs for Boolean Satisfiability through Approximation Algorithms27 Aug 2024
- 2024Learning to Solve the Constrained Most Probable Explanation Task in Probabilistic Graphical Models17 Apr 2024
- 2024Circular Belief Propagation for Approximate Probabilistic Inference17 Mar 2024
19 more
- 2023Joint Entity and Relation Extraction with Span Pruning and Hypergraph Neural Networks26 Oct 2023
- 2023Classification-Aided Robust Multiple Target Tracking Using Neural Enhanced Message Passing19 Oct 2023
- 2023Local Message Passing on Frustrated Systems2 Jun 2023
- 2022Neural Bayesian Network Understudy15 Nov 2022
- 2022NSNet: A General Neural Probabilistic Framework for Satisfiability Problems7 Nov 2022
- 2022Deep Attentive Belief Propagation: Integrating Reasoning and Learning for Solving Constraint Optimization Problems24 Sep 2022
- 2022Understanding Non-linearity in Graph Neural Networks from the Bayesian-Inference Perspective22 Jul 2022
- 2022Graph Neural Networks for Propositional Model Counting9 May 2022
- 2022IBIA: Bayesian Inference via Incremental Build-Infer-Approximate operations on Clique Trees24 Feb 2022
- 2021Adversarial Neural Networks for Error Correcting Codes21 Dec 2021
- 2021Neural Belief Propagation for Scene Graph Generation10 Dec 2021
- 2021Robust Deep Learning from Crowds with Belief Propagation1 Nov 2021
- 2021Deep learning via message passing algorithms based on belief propagation27 Oct 2021
- 2021Unifying AI Algorithms with Probabilistic Programming using Implicitly Defined Representations5 Oct 2021
- 2021Equivariant Neural Network for Factor Graphs29 Sep 2021
- 2021A visual introduction to Gaussian Belief Propagation5 Jul 2021
- 2021Graph Belief Propagation Networks6 Jun 2021
- 2021Relational Reasoning Networks1 Jun 2021
- 2021Partition Function Estimation: A Quantitative Study24 May 2021
- 2022Graph Neural Networks for Propositional Model Countingcited by 1
- 2022Graph Neural Networks for Propositional Model Counting9 May 2022
- 2022Understanding Non-linearity in Graph Neural Networks from the Bayesian-Inference Perspectivecited by 19
- 2022NSNet: A General Neural Probabilistic Framework for Satisfiability Problemscited by 18
- 2021A visual introduction to Gaussian Belief Propagationcited by 12
- 2021Deep learning via message passing algorithms based on belief propagationcited by 12
- 2023Joint Entity and Relation Extraction with Span Pruning and Hypergraph Neural Networkscited by 11
- 2021Partition Function Estimation: A Quantitative Studycited by 8
- 2021Neural Belief Propagation for Scene Graph Generationcited by 6
- 2021Relational Reasoning Networkscited by 4
- 2024Learning to Solve the Constrained Most Probable Explanation Task in Probabilistic Graphical Modelscited by 3
- 2024Understanding GNNs for Boolean Satisfiability through Approximation Algorithmscited by 3
- 2021Graph Belief Propagation Networkscited by 2
- 2025Mitigating Attention Localization in Small Scale: Self-Attention Refinement via One-step Belief Propagationcited by 2
12 most cited of 30 All 30 (JSON)
- 2026Graph neural networks and the energetic cavity method for combinatorial optimization7 Sep 2026
- 2026In-Context Graphical Inference3 Jun 2026
- 2025Transformer-Based Decoding in Concatenated Coding Schemes Under Synchronization Errors2 Nov 2025
- 2025Attn-JGNN: Attention Enhanced Join-Graph Neural Networks17 Oct 2025
- 2025Vejde: A Framework for Inductive Deep Reinforcement Learning Based on Factor Graph Color Refinement11 Sep 2025
- 2025Mitigating Attention Localization in Small Scale: Self-Attention Refinement via One-step Belief Propagation9 Sep 2025
- 2025Physics Informed Constrained Learning of Dynamics from Static Data17 Apr 2025
- 2024The Role of Recurrency in Image Segmentation for Noisy and Limited Sample Settings20 Dec 2024
- 2024ReMAP: Neural Reparameterization for Scalable MAP Inference in Arbitrary-Order Markov Random Fields28 Nov 2024
- 2024Understanding GNNs for Boolean Satisfiability through Approximation Algorithms27 Aug 2024
- 2024Learning to Solve the Constrained Most Probable Explanation Task in Probabilistic Graphical Models17 Apr 2024
- 2024Circular Belief Propagation for Approximate Probabilistic Inference17 Mar 2024
12 newest of 30 All 30 (JSON)