# PASS-GLM: polynomial approximate sufficient statistics for scalable Bayesian GLM inference

arXiv: https://arxiv.org/abs/1709.09216 · HTML: https://mlsanity.com/paper/1709.09216/

## Key facts

- Cited by 12 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 26 Sep 2017.

## Built on by (most cited first, 12 of 12)

- [Incentives in Private Collaborative Machine Learning](https://mlsanity.com/paper/2404.01676/) (2024)
- [JoinBoost: Grow Trees Over Normalized Data Using Only SQL](https://mlsanity.com/paper/2307.00422/) (2023)
- [Private Regression via Data-Dependent Sufficient Statistic Perturbation](https://mlsanity.com/paper/2405.15002/) (2024)
- [Nonnegative spatial factorization](https://mlsanity.com/paper/2110.06122/) (2021)
- [The Gaussian Mixing Mechanism: Renyi Differential Privacy via Gaussian Sketches](https://mlsanity.com/paper/2505.24603/) (2025)
- [Locally Differentially Private Bayesian Inference](https://mlsanity.com/paper/2110.14426/) (2021)
- [Bayes Hilbert Spaces for Posterior Approximation](https://mlsanity.com/paper/2304.09053/) (2023)
- [Orthogonal Polynomials Approximation Algorithm (OPAA):a functional analytic approach to estimating probability densities](https://mlsanity.com/paper/2211.08594/) (2022)
- [Noise-Aware Differentially Private Variational Inference](https://mlsanity.com/paper/2410.19371/) (2024)
- [Scalable inference of functional neural connectivity at submillisecond timescales](https://mlsanity.com/paper/2510.20966/) (2025)
- [A New Family of Poisson Non-negative Matrix Factorization Methods Using the Shifted Log Link](https://mlsanity.com/paper/2601.05845/) (2026)
- [Prediction Is Not a Sufficient Memory State](https://mlsanity.com/paper/2610.13881/) (2026)

## Abstract (arXiv)

Generalized linear models (GLMs) -- such as logistic regression, Poisson regression, and robust regression -- provide interpretable models for diverse data types. Probabilistic approaches, particularly Bayesian ones, allow coherent estimates of uncertainty, incorporation of prior information, and sharing of power across experiments via hierarchical models. In practice, however, the approximate Bayesian methods necessary for inference have either failed to scale to large data sets or failed to provide theoretical guarantees on the quality of inference. We propose a new approach based on constructing polynomial approximate sufficient statistics for GLMs (PASS-GLM). We demonstrate that our method admits a simple algorithm as well as trivial streaming and distributed extensions that do not compound error across computations. We provide theoretical guarantees on the quality of point (MAP) estimates, the approximate posterior, and posterior mean and uncertainty estimates. We validate our approach empirically in the case of logistic regression using a quadratic approximation and show competitive performance with stochastic gradient descent, MCMC, and the Laplace approximation in terms of speed and multiple measures of accuracy -- including on an advertising data set with 40 million data points and 20,000 covariates.