# Gradient flows for empirical Bayes in high-dimensional linear models

arXiv: https://arxiv.org/abs/2312.12708 · HTML: https://mlsanity.com/paper/2312.12708/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 20 Dec 2023.

## Built on by (most cited first, 4 of 4)

- [Error bounds for particle gradient descent, and extensions of the log-Sobolev and Talagrand inequalities](https://mlsanity.com/paper/2403.02004/) (2024)
- [Kinetic Interacting Particle Langevin Monte Carlo](https://mlsanity.com/paper/2407.05790/) (2024)
- [Nonparametric MLE for Gaussian Location Mixtures: Certified Computation and Generic Behavior](https://mlsanity.com/paper/2503.20193/) (2025)
- [Empirical Bayes for correlated Gaussian sequence model](https://mlsanity.com/paper/2607.03596/) (2026)

## Abstract (arXiv)

Empirical Bayes provides a powerful framework for learning and adapting to latent structure in data. In sequence models where an independent observation is associated to each latent parameter, theory and methods around empirical Bayes are well-developed. However, in models where latent parameters and observed data interact through more complex designs, many statistical and algorithmic questions remain unanswered. In this work, we study a canonical setting of empirical Bayes estimation for the distribution of regression coefficients in a high-dimensional Bayesian or random effects linear model. Computationally, we propose a new system of gradient flow equations for computing a nonparametric maximum likelihood estimator (NPMLE), which jointly optimizes over the prior and posterior distributions of the regression coefficients in a Gibbs variational representation of the marginal log-likelihood. A diffusion-based implementation yields an adaptive Langevin dynamics algorithm in which the prior evolves continuously to optimize a sequence model log-likelihood defined by the coordinates of the Langevin sample. Theoretically, we show polynomial-time convergence of the proposed gradient flow to a near-NPMLE from any initialization within a convex sub-level set of the marginal log-likelihood, by developing a high-temperature log-Sobolev inequality for the posterior law. We establish the statistical consistency of any near-NPMLE under deterministic conditions for the regression design as n,prightarrow∞.