Variational inference for sparse network reconstruction from count data
Not on the map. Why?
Abstract (arXiv)
In multivariate statistics, the question of finding direct interactions can be formulated as a problem of network inference - or network reconstruction - for which the Gaussian graphical model (GGM) provides a canonical framework. Unfortunately, the Gaussian assumption does not apply to count data which are encountered in domains such as genomics, social sciences or ecology. To circumvent this limitation, state-of-the-art approaches use two-step strategies that first transform counts to pseudo Gaussian observations and then apply a (partial) correlation-based approach from the abundant literature of GGM inference. We adopt a different stance by relying on a latent model where we directly model counts by means of Poisson distributions that are conditional to latent (hidden) Gaussian correlated variables. In this multivariate Poisson lognormal-model, the dependency structure is completely captured by the latent layer. This parametric model enables to account for the effects of covariates on the counts. To perform network inference, we add a sparsity inducing constraint on the inverse covariance matrix of the latent Gaussian vector. Unlike the usual Gaussian setting, the penalized likelihood is generally not tractable, and we resort instead to a variational approach for approximate likelihood maximization. The corresponding optimization problem is solved by alternating a gradient ascent on the variational parameters and a graphical-Lasso step on the covariance matrix. We show that our approach is highly competitive with the existing methods on simulation inspired from microbiological data. We then illustrate on three various data sets how accounting for sampling efforts via offsets and integrating external covariates (which is mostly never done in the existing literature) drastically changes the topology of the inferred network.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 2; 2024: 2; 2025: 2; 2026: 3.
12 papers.
- 2024Zero-inflation in the Multivariate Poisson Lognormal Familycited by 4
- 2022Zero-Truncated Poisson Regression for Sparse Multiway Count Data Corrupted by False Zeroscited by 3
- 2022Scalable Bigraphical Lasso: Two-way Sparse Network Inference for Count Datacited by 3
- 2023Graph Laplacian Learning with Exponential Family Noisecited by 3
- 2021Unsupervised Feature Ranking via Attribute Networkscited by 2
- 2024Tree-based variational inference for Poisson log-normal modelscited by 2
- 2023Cross-Validation for Training and Testing Co-occurrence Network Inference Algorithmscited by 1
- 2025Semi-supervised Clustering Through Representation Learning of Large-scale EHR Datacited by 1
- 2025Uncovering symmetric and asymmetric species associations from community and environmental datacited by 0
- 2026Independent Component Discovery in Temporal Count Datacited by 0
- 2026Understanding When Poisson Log-Normal Models Outperform Penalized Poisson Regression for Microbiome Count Datacited by 0
- 2026Causal Path Analysis from Perturbational and Population-Scale Single-Cell Data with Multiscale Confounding and Measurement Errorcited by 0
- 2026Causal Path Analysis from Perturbational and Population-Scale Single-Cell Data with Multiscale Confounding and Measurement Error15 Sep 2026
- 2026Understanding When Poisson Log-Normal Models Outperform Penalized Poisson Regression for Microbiome Count Data4 Apr 2026
- 2026Independent Component Discovery in Temporal Count Data29 Jan 2026
- 2025Uncovering symmetric and asymmetric species associations from community and environmental data12 Jul 2025
- 2025Semi-supervised Clustering Through Representation Learning of Large-scale EHR Data27 May 2025
- 2024Tree-based variational inference for Poisson log-normal models25 Jun 2024
- 2024Zero-inflation in the Multivariate Poisson Lognormal Family23 May 2024
- 2023Cross-Validation for Training and Testing Co-occurrence Network Inference Algorithms26 Sep 2023
- 2023Graph Laplacian Learning with Exponential Family Noise14 Jun 2023
- 2022Scalable Bigraphical Lasso: Two-way Sparse Network Inference for Count Data15 Mar 2022
- 2022Zero-Truncated Poisson Regression for Sparse Multiway Count Data Corrupted by False Zeros25 Jan 2022
- 2021Unsupervised Feature Ranking via Attribute Networks25 Nov 2021