HiGP: A high-performance Python package for Gaussian Process
Not on the map. Why?
Abstract (arXiv)
Gaussian Processes (GPs) are flexible, nonparametric Bayesian models widely used for regression and classification because of their ability to capture complex data patterns and quantify predictive uncertainty. However, the O(n3) computational cost of kernel matrix operations poses a major obstacle to applying GPs at scale. HiGP is a high-performance Python package designed to overcome these scalability limitations through advanced numerical linear algebra and hierarchical kernel representations. It integrates H2 matrices to achieve near-linear complexity in both storage and computation for spatial datasets, supports on-the-fly kernel evaluation to avoid explicit storage in large-scale problems, and incorporates a robust Adaptive Factorized Nystr"om (AFN) preconditioner that accelerates convergence of iterative solvers across a broad range of kernel spectra. These computational kernels are implemented in C++ for maximum performance and exposed through Python interfaces, enabling seamless integration with modern machine learning workflows. HiGP also includes analytically derived gradient computations for efficient hyperparameter optimization, avoiding the inefficiencies of automatic differentiation in iterative solvers. By serving as a reusable numerical engine, HiGP complements existing GP frameworks such as GPJax, KeOps, and GaussianProcesses.jl, providing a reliable and scalable computational backbone for large-scale Gaussian Process regression and classification.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 13 of its 32 references that are in the map. First posted on arXiv 4 Mar 2025.
Builds on
13 of 32 references.
References · 13
- 2018GPyTorch: Blackbox Matrix-Matrix Gaussian Process Inference with GPU Accelerationcited by 603
- 2013Gaussian Processes for Big Datacited by 377
- 2016GPflow: A Gaussian process library using TensorFlowcited by 139
- 2020Kernel Operations on the GPU, with Autodiff, without Memory Overflowscited by 101
- 2020Hutch++: Optimal Stochastic Trace Estimationcited by 62
- 2018Constant-Time Predictive Distributions for Gaussian Processescited by 48
- 2020A Framework for Interdomain and Multioutput Gaussian Processescited by 47
- 2015Thoughts on Massively Scalable Gaussian Processescited by 26
- 2021Preconditioning for Scalable Gaussian Process Hyperparameter Optimizationcited by 22
- 2023Large-Scale Gaussian Processes via Alternating Projectioncited by 11
- 2024Robust Gaussian Processes via Relevance Pursuitcited by 7
- 2018GaussianProcesses.jl: A Nonparametric Bayes package for the Julia Languagecited by 5
Built on by
Citing papers per year: 2025: 2.
2 papers.