mlsanityData to 14 Oct 2026

Transformed Latent Variable Multi-Output Gaussian Processes

arXiv 2605.05133 ↗First posted 6 May 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Multi-Output Gaussian Processes (MOGPs) provide a principled probabilistic framework for modelling correlated outputs but face scalability bottlenecks when applied to datasets with high-dimensional output spaces. To maintain tractability, existing methods typically resort to restrictive assumptions, such as employing low-rank or sum-of-separable kernels, which can limit expressiveness. We propose the Transformed Latent Variable MOGP (T-LVMOGP), a novel framework that scales MOGPs to a massive number of outputs while preserving the capacity to capture meaningful inter-output dependencies. T-LVMOGP constructs a flexible multi-output deep kernel by mapping inputs and output-specific latent variables into an embedding space using a Lipschitz-regularised neural network. Combined with stochastic variational inference, our model effectively scales to high-dimensional output settings. Across diverse benchmarks, including climate modelling with over 10,000 outputs and zero-inflated spatial transcriptomics data, T-LVMOGP outperforms baselines in both predictive accuracy and computational efficiency.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 81 references that are in the map. First posted on arXiv 6 May 2026.

Builds on

35 of 81 references.

References · 35

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,636
  4. 2018GPyTorch: Blackbox Matrix-Matrix Gaussian Process Inference with GPU Accelerationcited by 609
  5. 2015Deep Kernel Learningcited by 445
  6. 2020Simple and Principled Uncertainty Estimation with Deterministic Deep Learning via Distance Awarenesscited by 389
  7. 2013Gaussian Processes for Big Datacited by 383
  8. 2015Kernel Interpolation for Scalable Structured Gaussian Processes (KISS-GP)cited by 177
  9. 2016Stochastic Variational Deep Kernel Learningcited by 93
  10. 2021On Feature Collapse and Deep Kernel Learning for Single Forward Pass Uncertaintycited by 87
  11. 2021The Promises and Pitfalls of Deep Kernel Learningcited by 81
  12. 2014Manifold Gaussian Processes for Regressioncited by 80
23 more
  1. 2020A Framework for Interdomain and Multioutput Gaussian Processescited by 48
  2. 2018SLANG: Fast Structured Covariance Approximations for Bayesian Deep Learning with Natural Gradientcited by 34
  3. 2017Spectral Mixture Kernels for Multi-Output Gaussian Processescited by 29
  4. 2018Heterogeneous Multi-output Gaussian Process Predictioncited by 26
  5. 2019Scalable Exact Inference in Multi-Output Gaussian Processescited by 25
  6. 2019Multi-task Learning for Aggregated Data using Gaussian Processescited by 20
  7. 2020Sparse within Sparse Gaussian Processes using Neighbor Informationcited by 18
  8. 2019Meta-Learning Mean Functions for Gaussian Processescited by 17
  9. 2018Representing smooth functions as compositions of near-identity functions with implications for deep network optimizationcited by 15
  10. 2017Efficient Modeling of Latent Information in Supervised Learning using Gaussian Processescited by 14
  11. 2018The Gaussian Process Autoregressive Regression Model (GPAR)cited by 12
  12. 2022Nonstationary multi-output Gaussian processes via harmonizable spectral mixturescited by 8
  13. 2020Multioutput Gaussian Processes with Functional Data: A Study on Coastal Flood Hazard Assessmentcited by 5
  14. 2021Scalable Multi-Task Gaussian Processes with Neural Embedding of Coregionalizationcited by 5
  15. 2019A Fully Natural Gradient Scheme for Improving Inference of the Heterogeneous Multi-Output Gaussian Process Modelcited by 4
  16. 2017Bayesian Alignments of Warped Multi-Output Gaussian Processescited by 3
  17. 2020A conditional one-output likelihood formulation for multitask Gaussian processescited by 3
  18. 2020Cluster-Specific Predictions with Multi-Task Gaussian Processescited by 3
  19. 2023Latent Variable Multi-output Gaussian Processes for Hierarchical Datasetscited by 3
  20. 2025Tighter sparse variational Gaussian processescited by 3
  21. 2024Scalable Multi-Output Gaussian Processes with Stochastic Variational Inferencecited by 2
  22. 2025New Bounds for Sparse Variational Gaussian Processescited by 2
  23. 2025Multi-Output Robust and Conjugate Gaussian Processescited by 2

Built on by

Not cited yet.