# Bayesian Learning via Q-Exponential Process

arXiv: https://arxiv.org/abs/2210.07987 · HTML: https://mlsanity.com/paper/2210.07987/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 9 of its 45 references that are in the map.
- First posted on arXiv 14 Oct 2022.

## Builds on (most cited first, 9 of 9)

- [Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization](https://mlsanity.com/paper/1603.06560/) (2016)
- [BOHB: Robust and Efficient Hyperparameter Optimization at Scale](https://mlsanity.com/paper/1807.01774/) (2018)
- [A Haar Wavelet-Based Perceptual Similarity Index for Image Quality Assessment](https://mlsanity.com/paper/1607.06140/) (2016)
- [Student-t Processes as Alternatives to Gaussian Processes](https://mlsanity.com/paper/1402.4306/) (2014)
- [Large Data and Zero Noise Limits of Graph-Based Semi-Supervised Learning Algorithms](https://mlsanity.com/paper/1805.09450/) (2018)
- [Scaling Up Bayesian Uncertainty Quantification for Inverse Problems using Deep Neural Networks](https://mlsanity.com/paper/2101.03906/) (2021)
- [Dimension-Robust MCMC in Bayesian Inverse Problems](https://mlsanity.com/paper/1803.03344/) (2018)
- [A Stable Manifold MCMC Method for High Dimensions](https://mlsanity.com/paper/1403.7711/) (2014)
- [Learning Temporal Evolution of Spatial Dependence with Generalized Spatiotemporal Gaussian Process Models](https://mlsanity.com/paper/1901.04030/) (2019)

## Built on by (most cited first, 3 of 3)

- [Spatiotemporal Besov Priors for Bayesian Inverse Problems](https://mlsanity.com/paper/2306.16378/) (2023)
- [Deep Q-Exponential Processes](https://mlsanity.com/paper/2410.22119/) (2024)
- [Probabilistic Geodesic Flow Matching on Location-Scale Families](https://mlsanity.com/paper/2609.34613/) (2026)

## Abstract (arXiv)

Regularization is one of the most fundamental topics in optimization, statistics and machine learning. To get sparsity in estimating a parameter u∈ℝd, an ℓq penalty term, Vert uVertq, is usually added to the objective function. What is the probabilistic distribution corresponding to such ℓq penalty? What is the correct stochastic process corresponding to Vert uVertq when we model functions u∈ Lq? This is important for statistically modeling large dimensional objects, e.g. images, with penalty to preserve certainty properties, e.g. edges in the image. In this work, we generalize the q-exponential distribution (with density proportional to) exp(- frac12|u|q) to a stochastic process named Q-exponential (Q-EP) process that corresponds to the Lq regularization of functions. The key step is to specify consistent multivariate q-exponential distributions by choosing from a large family of elliptic contour distributions. The work is closely related to Besov process which is usually defined by the expanded series. Q-EP can be regarded as a definition of Besov process with explicit probabilistic formulation and direct control on the correlation length. From the Bayesian perspective, Q-EP provides a flexible prior on functions with sharper penalty (q<2) than the commonly used Gaussian process (GP). We compare GP, Besov and Q-EP in modeling functional data, reconstructing images, and solving inverse problems and demonstrate the advantage of our proposed methodology.