# A Factor Graph Approach to Automated Design of Bayesian Signal Processing Algorithms

arXiv: https://arxiv.org/abs/1811.03407 · HTML: https://mlsanity.com/paper/1811.03407/

## Key facts

- Cited by 11 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 8 Nov 2018.

## Built on by (most cited first, 11 of 11)

- [pymdp: A Python library for active inference in discrete state spaces](https://mlsanity.com/paper/2201.03904/) (2022)
- [Branching Time Active Inference: the theory and its generality](https://mlsanity.com/paper/2111.11107/) (2021)
- [Branching Time Active Inference: empirical study and complexity class analysis](https://mlsanity.com/paper/2111.11276/) (2021)
- [Realising Synthetic Active Inference Agents, Part II: Variational Message Updates](https://mlsanity.com/paper/2306.02733/) (2023)
- [Active Inference and Epistemic Value in Graphical Models](https://mlsanity.com/paper/2109.00541/) (2021)
- [PGMax: Factor Graphs for Discrete Probabilistic Graphical Models and Loopy Belief Propagation in JAX](https://mlsanity.com/paper/2202.04110/) (2022)
- [Chance-Constrained Active Inference](https://mlsanity.com/paper/2102.08792/) (2021)
- [Toward Design of Synthetic Active Inference Agents by Mere Mortals](https://mlsanity.com/paper/2307.14145/) (2023)
- [Realising Active Inference in Variational Message Passing: the Outcome-blind Certainty Seeker](https://mlsanity.com/paper/2104.11798/) (2021)
- [AIDA: An Active Inference-based Design Agent for Audio Processing Algorithms](https://mlsanity.com/paper/2112.13366/) (2021)
- [Automating Model Comparison in Factor Graphs](https://mlsanity.com/paper/2306.05965/) (2023)

## Abstract (arXiv)

The benefits of automating design cycles for Bayesian inference-based algorithms are becoming increasingly recognized by the machine learning community. As a result, interest in probabilistic programming frameworks has much increased over the past few years. This paper explores a specific probabilistic programming paradigm, namely message passing in Forney-style factor graphs (FFGs), in the context of automated design of efficient Bayesian signal processing algorithms. To this end, we developed "ForneyLab" (https://github.com/biaslab/ForneyLab.jl) as a Julia toolbox for message passing-based inference in FFGs. We show by example how ForneyLab enables automatic derivation of Bayesian signal processing algorithms, including algorithms for parameter estimation and model comparison. Crucially, due to the modular makeup of the FFG framework, both the model specification and inference methods are readily extensible in ForneyLab. In order to test this framework, we compared variational message passing as implemented by ForneyLab with automatic differentiation variational inference (ADVI) and Monte Carlo methods as implemented by state-of-the-art tools "Edward" and "Stan". In terms of performance, extensibility and stability issues, ForneyLab appears to enjoy an edge relative to its competitors for automated inference in state-space models.
