mlsanityData to 13 Oct 2026

DeepRV: Accelerating Spatiotemporal Inference with Pre-trained Neural Priors

arXiv 2503.21473 ↗First posted 27 Mar 2025stat.ML cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Gaussian Processes (GPs) provide a flexible and statistically principled foundation for modelling spatiotemporal phenomena, but their O(N3) scaling makes them intractable for large datasets. Approximate methods such as variational inference (VI), inducing-point (sparse) GPs, low-rank kernel approximations (e.g., Nystrom methods and random Fourier features), and approximations such as INLA improve scalability but typically trade off accuracy, calibration, or modelling flexibility. We introduce DeepRV, a neural-network surrogate that replaces GP prior sampling, while closely matching full GP accuracy at inference including hyperparameter estimates, and reducing computational complexity to O(N2), increasing scalability and inference speed. DeepRV serves as a drop-in replacement for GP prior realisations in e.g. MCMC-based probabilistic programming pipelines, preserving full model flexibility. Across simulated benchmarks, non-separable spatiotemporal GPs, and a real-world application to education deprivation in London (n = 4,994 locations), DeepRV achieves the highest fidelity to exact GPs while substantially accelerating inference. Code is provided in the dl4bi Python package, with all experiments run on a single consumer-grade GPU to ensure accessibility for practitioners.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 24 of its 58 references that are in the map. First posted on arXiv 27 Mar 2025.

Builds on

24 of 58 references.

References · 24

  1. 2017Attention Is All You Needcited by 60,106
  2. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,637
  3. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,570
  4. 2024FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisioncited by 515
  5. 2013Gaussian Processes for Big Datacited by 380
  6. 2021Pay Attention to MLPscited by 368
  7. 2014Scalable Variational Gaussian Process Classificationcited by 226
  8. 2019Composable Effects for Flexible and Accelerated Probabilistic Programming in NumPyrocited by 189
  9. 2024Flex Attention: A Programming Model for Generating Optimized Attention Kernelscited by 181
  10. 2016Automatic Differentiation Variational Inferencecited by 159
  11. 2017A general framework for Vecchia approximations of Gaussian processescited by 66
  12. 2015On Sparse variational methods and the Kullback-Leibler divergence between stochastic processescited by 56
12 more
  1. 2017A Case Study Competition Among Methods for Analyzing Large Spatial Datacited by 44
  2. 2016Permutation and Grouping Methods for Sharpening Gaussian Process Approximationscited by 24
  3. 2016Bayesian Computing with INLA: A Reviewcited by 16
  4. 2013Spatial and Spatio-Temporal Log-Gaussian Cox Processes: Extending the Geostatistical Paradigmcited by 13
  5. 2021PriorVAE: Encoding spatial priors with VAEs for small-area estimationcited by 11
  6. 2021Spatiotemporal wildfire modeling through point processes with moderate and extreme markscited by 9
  7. 2023PriorCVAE: scalable MCMC parameter inference with Bayesian deep generative modellingcited by 6
  8. 2018Spatial modelling with R-INLA: A reviewcited by 3
  9. 2020Semiparametric Bayesian Inference for the Transmission Dynamics of COVID-19 with a State-Space Modelcited by 3
  10. 2023Gaussian Processes for Monitoring Air-Quality in Kampalacited by 3
  11. 2022Deep Gaussian Processes for Air Quality Inferencecited by 1
  12. 2024Scalable Gaussian Process Regression Via Median Posterior Inference for Estimating Multi-Pollutant Mixture Health Effectscited by 1

Built on by

Not cited yet.