Hierarchical Nearest-Neighbor Gaussian Process Models for Large Geostatistical Datasets
Not on the map. Why?
Abstract (arXiv)
Spatial process models for analyzing geostatistical data entail computations that become prohibitive as the number of spatial locations become large. This manuscript develops a class of highly scalable Nearest Neighbor Gaussian Process (NNGP) models to provide fully model-based inference for large geostatistical datasets. We establish that the NNGP is a well-defined spatial process providing legitimate finite-dimensional Gaussian densities with sparse precision matrices. We embed the NNGP as a sparsity-inducing prior within a rich hierarchical modeling framework and outline how computationally efficient Markov chain Monte Carlo (MCMC) algorithms can be executed without storing or decomposing large matrices. The floating point operations (flops) per iteration of this algorithm is linear in the number of spatial locations, thereby rendering substantial scalability. We illustrate the computational and inferential benefits of the NNGP over competing methods using simulation studies and also analyze forest biomass from a massive United States Forest Inventory dataset at a scale that precludes alternative dimension-reducing methods.
Key facts. Cited by 71 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Jun 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 11; 2023: 5; 2024: 17; 2025: 15; 2026: 10.
71 papers.
Sort:
- 2021Spatio-Temporal Variational Gaussian Processescited by 32
- 2022Posterior and Computational Uncertainty in Gaussian Processescited by 23
- 2021Positional Encoder Graph Neural Networks for Geographic Datacited by 20
- 2021Local approximate Gaussian process regression for data-driven constitutive laws: Development and comparison with neural networkscited by 17
- 2021Bias-Free Scalable Gaussian Processes via Randomized Truncationscited by 15
- 2023Neural networks for geospatial datacited by 11
- 2021MuyGPs: Scalable Gaussian Process Hyperparameter Estimation Using Local Cross-Validationcited by 8
- 2022Variational Nearest Neighbor Gaussian Processcited by 8
- 2022Scalable Gaussian-process regression and variable selection using Vecchia approximationscited by 8
- 2024Computation-Aware Gaussian Processes: Model Selection And Linear-Time Inferencecited by 8
- 2021Correlated Product of Experts for Sparse Gaussian Process Regressioncited by 7
- 2024Physics-Informed Variational State-Space Gaussian Processescited by 7
38 more
- 2021Scalable Cross Validation Losses for Gaussian Process Modelscited by 6
- 2023Iterative Methods for Vecchia-Laplace Approximations for Latent Gaussian Process Modelscited by 6
- 2023Leveraging Locality and Robustness to Achieve Massively Scalable Gaussian Process Regressioncited by 5
- 2021Lightweight Distributed Gaussian Process Regression for Online Machine Learningcited by 4
- 2022Fully Decentralized, Scalable Gaussian Processes for Multi-Agent Federated Learningcited by 4
- 2023Variational sparse inverse Cholesky approximation for latent Gaussian processes via double Kullback-Leibler minimizationcited by 4
- 2024Iterative Methods for Full-Scale Gaussian Process Approximations for Large Spatial Datacited by 4
- 2021Scalable Spatiotemporally Varying Coefficient Modelling with Bayesian Kernelized Tensor Regressioncited by 3
- 2025Neighbour-Driven Gaussian Process Variational Autoencoders for Scalable Structured Latent Modellingcited by 3
- 2025Transformer with Koopman-Enhanced Graph Convolutional Network for Spatiotemporal Dynamics Forecastingcited by 3
- 2021Modeling massive highly-multivariate nonstationary spatial data with the basis graphical lassocited by 2
- 2021Modeling Massive Spatial Datasets Using a Conjugate Bayesian Linear Regression Frameworkcited by 2
- 2021Nearest neighbor empirical processescited by 2
- 2022Incorporating Prior Knowledge into Neural Networks through an Implicit Composite Kernelcited by 2
- 2022Bayesian Complementary Kernelized Learning for Multidimensional Spatiotemporal Datacited by 2
- 2024Contraction rates for conjugate gradient and Lanczos approximate posteriors in Gaussian process regressioncited by 2
- 2024A Spatio-Temporal Machine Learning Model for Mortgage Credit Risk: Default Probabilities and Loan Portfolioscited by 2
- 2024Stein's method for marginals on large graphical modelscited by 2
- 2024Compactly-supported nonstationary kernels for computing exact Gaussian processes on big datacited by 2
- 2025Modular Jump Gaussian Processescited by 2
- 2025Bayesian Data Sketching for Varying Coefficient Regression Modelscited by 2
- 2022Bayesian Spatial Predictive Synthesiscited by 1
- 2022Fast Gaussian Process Posterior Mean Prediction via Local Cross Validation and Precomputationcited by 1
- 2022Dynamic Bayesian Learning for Spatiotemporal Mechanistic Modelscited by 1
- 2023Scalable Model-Based Gaussian Process Clusteringcited by 1
- 2024Implementation and Analysis of GPU Algorithms for Vecchia Approximationcited by 1
- 2024Positional Encoder Graph Quantile Neural Networks for Geographic Datacited by 1
- 2024Learning non-Gaussian spatial distributions via Bayesian transport maps with parametric shrinkagecited by 1
- 2024Correspondence of NNGP Kernel and the Matern Kernelcited by 1
- 2025gp2Scale: A Class of Compactly Supported Non-Stationary Kernels and Distributed Computing for Exact Gaussian Processes on 10 Million Data Pointscited by 1
- 2021Treegingcited by 0
- 2022Scalable Gaussian Process Hyperparameter Optimization via Coverage Regularizationcited by 0
- 2022Pitfalls of Climate Network Construction: A Statistical Perspectivecited by 0
- 2024Further Understanding of a Local Gaussian Process Approximation: Characterising Convergence in the Finite Regimecited by 0
- 2024Variable importance measure for spatial machine learning models with application to air pollution exposure predictioncited by 0
- 2024S-SIRUS: an explainability algorithm for spatial regression Random Forestcited by 0
- 2024Linear cost and exponentially convergent approximation of Gaussian Mat'ern processes on intervalscited by 0
- 2024Density correction for multivariate spatial fields of global climate model output using deep learningcited by 0
50 most cited of 71 All 71 (JSON)
- 2026Graph-Split Bayesian Causal Forest for Spatial Heterogeneous Treatment Effect Estimation28 Sep 2026
- 2026Sparsity by Default: The Theory and Practice of ARD in Gaussian Process Regression for Variable Selection27 Sep 2026
- 2026Adaptive multi-resolution Gaussian processes: Scalable exact inference with naturally data-sparse covariance matrices24 Sep 2026
- 2026Gaussian Process Decorrelation for Spatiotemporal Deep Learning-Based Snow Water Equivalent Prediction27 Aug 2026
- 2026A Factor Graph Approach to Scalable Multi-Output Gaussian Process Regression12 Aug 2026
- 2026GNet: A scalable and flexible Gaussian process network with nonparametric neurons12 Jul 2026
- 2026Scalable Derivative Gaussian Processes via Exact Gradient Reduction1 Jun 2026
- 2026Permutation-preserving Functions and Neural Vecchia Covariance Kernels6 May 2026
- 2026From Shallow Bayesian Neural Networks to Gaussian Processes: General Convergence, Identifiability and Scalable Inference26 Feb 2026
- 2026Accelerated training of Gaussian processes using banded square exponential covariances26 Jan 2026
- 2025Spatially-informed transformers: Injecting geostatistical covariance biases into self-attention for spatio-temporal forecasting19 Dec 2025
- 2025Self-Supervised Learning with Gaussian Processes10 Dec 2025
38 more
- 2025gp2Scale: A Class of Compactly Supported Non-Stationary Kernels and Distributed Computing for Exact Gaussian Processes on 10 Million Data Points5 Dec 2025
- 2025A Streaming Sparse Cholesky Method for Derivative-Informed Gaussian Process Surrogates Within Digital Twin Applications1 Nov 2025
- 2025A Hierarchical Variational Graph Fused Lasso for Recovering Relative Rates in Spatial Compositional Data25 Sep 2025
- 2025Modeling nonstationary spatial processes with normalizing flows16 Sep 2025
- 2025A comparison between geostatistical and machine learning models for spatio-temporal prediction of PM2.5 data15 Sep 2025
- 2025Spatiodynamic inference using vision-based generative modelling29 Jul 2025
- 2025Vecchia-Inducing-Points Full-Scale Approximations for Gaussian Processes7 Jul 2025
- 2025Transformer with Koopman-Enhanced Graph Convolutional Network for Spatiotemporal Dynamics Forecasting5 Jul 2025
- 2025From Local Interactions to Global Operators: Scalable Gaussian Process Operator for Physical Systems18 Jun 2025
- 2025Bayesian Data Sketching for Varying Coefficient Regression Models30 May 2025
- 2025Unsupervised cell segmentation by fast Gaussian Processes24 May 2025
- 2025Neighbour-Driven Gaussian Process Variational Autoencoders for Scalable Structured Latent Modelling22 May 2025
- 2025Modular Jump Gaussian Processes21 May 2025
- 2024When the whole is greater than the sum of its parts: Scaling black-box inference to large data settings through divide-and-conquer29 Dec 2024
- 2024Density correction for multivariate spatial fields of global climate model output using deep learning27 Nov 2024
- 2024Compactly-supported nonstationary kernels for computing exact Gaussian processes on big data7 Nov 2024
- 2024Computation-Aware Gaussian Processes: Model Selection And Linear-Time Inference1 Nov 2024
- 2024Linear cost and exponentially convergent approximation of Gaussian Mat'ern processes on intervals16 Oct 2024
- 2024Stein's method for marginals on large graphical models15 Oct 2024
- 2024Correspondence of NNGP Kernel and the Matern Kernel10 Oct 2024
- 2024A Spatio-Temporal Machine Learning Model for Mortgage Credit Risk: Default Probabilities and Loan Portfolios3 Oct 2024
- 2024Learning non-Gaussian spatial distributions via Bayesian transport maps with parametric shrinkage28 Sep 2024
- 2024Positional Encoder Graph Quantile Neural Networks for Geographic Data27 Sep 2024
- 2024Physics-Informed Variational State-Space Gaussian Processes20 Sep 2024
- 2024S-SIRUS: an explainability algorithm for spatial regression Random Forest10 Aug 2024
- 2024Implementation and Analysis of GPU Algorithms for Vecchia Approximation3 Jul 2024
- 2024Contraction rates for conjugate gradient and Lanczos approximate posteriors in Gaussian process regression18 Jun 2024
- 2024Variable importance measure for spatial machine learning models with application to air pollution exposure prediction4 Jun 2024
- 2024Iterative Methods for Full-Scale Gaussian Process Approximations for Large Spatial Data23 May 2024
- 2024Further Understanding of a Local Gaussian Process Approximation: Characterising Convergence in the Finite Regime9 Apr 2024
- 2023Iterative Methods for Vecchia-Laplace Approximations for Latent Gaussian Process Models18 Oct 2023
- 2023Scalable Model-Based Gaussian Process Clustering14 Sep 2023
- 2023Leveraging Locality and Robustness to Achieve Massively Scalable Gaussian Process Regression26 Jun 2023
- 2023Neural networks for geospatial data18 Apr 2023
- 2023Variational sparse inverse Cholesky approximation for latent Gaussian processes via double Kullback-Leibler minimization30 Jan 2023
- 2022Pitfalls of Climate Network Construction: A Statistical Perspective5 Nov 2022
- 2022Scalable Gaussian Process Hyperparameter Optimization via Coverage Regularization22 Sep 2022
- 2022Bayesian Complementary Kernelized Learning for Multidimensional Spatiotemporal Data21 Aug 2022
50 newest of 71 All 71 (JSON)
- 2021Spatio-Temporal Variational Gaussian Processescited by 32
- 2022Posterior and Computational Uncertainty in Gaussian Processescited by 23
- 2021Positional Encoder Graph Neural Networks for Geographic Datacited by 20
- 2021Local approximate Gaussian process regression for data-driven constitutive laws: Development and comparison with neural networkscited by 17
- 2021Bias-Free Scalable Gaussian Processes via Randomized Truncationscited by 15
- 2023Neural networks for geospatial datacited by 11
- 2021MuyGPs: Scalable Gaussian Process Hyperparameter Estimation Using Local Cross-Validationcited by 8
- 2022Variational Nearest Neighbor Gaussian Processcited by 8
- 2022Scalable Gaussian-process regression and variable selection using Vecchia approximationscited by 8
- 2024Computation-Aware Gaussian Processes: Model Selection And Linear-Time Inferencecited by 8
- 2021Correlated Product of Experts for Sparse Gaussian Process Regressioncited by 7
- 2024Physics-Informed Variational State-Space Gaussian Processescited by 7
12 most cited of 71 All 71 (JSON)
- 2026Graph-Split Bayesian Causal Forest for Spatial Heterogeneous Treatment Effect Estimation28 Sep 2026
- 2026Sparsity by Default: The Theory and Practice of ARD in Gaussian Process Regression for Variable Selection27 Sep 2026
- 2026Adaptive multi-resolution Gaussian processes: Scalable exact inference with naturally data-sparse covariance matrices24 Sep 2026
- 2026Gaussian Process Decorrelation for Spatiotemporal Deep Learning-Based Snow Water Equivalent Prediction27 Aug 2026
- 2026A Factor Graph Approach to Scalable Multi-Output Gaussian Process Regression12 Aug 2026
- 2026GNet: A scalable and flexible Gaussian process network with nonparametric neurons12 Jul 2026
- 2026Scalable Derivative Gaussian Processes via Exact Gradient Reduction1 Jun 2026
- 2026Permutation-preserving Functions and Neural Vecchia Covariance Kernels6 May 2026
- 2026From Shallow Bayesian Neural Networks to Gaussian Processes: General Convergence, Identifiability and Scalable Inference26 Feb 2026
- 2026Accelerated training of Gaussian processes using banded square exponential covariances26 Jan 2026
- 2025Spatially-informed transformers: Injecting geostatistical covariance biases into self-attention for spatio-temporal forecasting19 Dec 2025
- 2025Self-Supervised Learning with Gaussian Processes10 Dec 2025
12 newest of 71 All 71 (JSON)