Generalized Product of Experts for Automatic and Principled Fusion of Gaussian Process Predictions
Not on the map. Why?
Abstract (arXiv)
In this work, we propose a generalized product of experts (gPoE) framework for combining the predictions of multiple probabilistic models. We identify four desirable properties that are important for scalability, expressiveness and robustness, when learning and inferring with a combination of multiple models. Through analysis and experiments, we show that gPoE of Gaussian processes (GP) have these qualities, while no other existing combination schemes satisfy all of them at the same time. The resulting GP-gPoE is highly scalable as individual GP experts can be independently learned in parallel; very expressive as the way experts are combined depends on the input rather than fixed; the combined prediction is still a valid probabilistic model with natural interpretation; and finally robust to unreliable predictions from individual experts.
Key facts. Cited by 66 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Oct 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 13; 2022: 18; 2023: 10; 2024: 12; 2025: 4; 2026: 8.
66 papers.
Sort:
By area:
- 2021OpenBox: A Generalized Black-box Optimization Servicecited by 46
- 2024Prototypical Information Bottlenecking and Disentangling for Multimodal Cancer Survival Predictioncited by 41
- 2021A Variational Information Bottleneck Approach to Multi-Omics Data Integrationcited by 40
- 2023Multimodal Variational Auto-encoder based Audio-Visual Segmentationcited by 37
- 2021ProxyBO: Accelerating Neural Architecture Search via Bayesian Optimization with Zero-cost Proxiescited by 20
- 2023Towards Anytime Classification in Early-Exit Architectures by Enforcing Conditional Monotonicitycited by 16
- 2021Bias-Free Scalable Gaussian Processes via Randomized Truncationscited by 15
- 2022Scalable Bayesian Optimization Using Vecchia Approximations of Gaussian Processescited by 11
- 2022Uncertainty Estimation for Multi-view Data: The Power of Seeing the Whole Picturecited by 10
- 2023Multi-modal Variational Autoencoders for normative modelling across multiple imaging modalitiescited by 10
- 2023Mutual Information Regularization for Weakly-supervised RGB-D Salient Object Detectioncited by 9
- 2021Federated Gaussian Process: Convergence, Automatic Personalization and Multi-fidelity Modelingcited by 8
38 more
- 2022Hierarchical Policy Blending as Inference for Reactive Robot Controlcited by 8
- 2021Correlated Product of Experts for Sparse Gaussian Process Regressioncited by 7
- 2022Foundation Posteriors for Approximate Probabilistic Inferencecited by 6
- 2021Normative Modeling using Multimodal Variational Autoencoders to Identify Abnormal Brain Structural Patterns in Alzheimer Diseasecited by 5
- 2022Federated Bayesian Neural Regression: A Scalable Global Federated Gaussian Processcited by 5
- 2023Leveraging Locality and Robustness to Achieve Massively Scalable Gaussian Process Regressioncited by 5
- 2024XLSTM-HVED: Cross-Modal Brain Tumor Segmentation and MRI Reconstruction Method Using Vision XLSTM and Heteromodal Variational Encoder-Decodercited by 5
- 2021Learning Intuitive Physics with Multimodal Generative Modelscited by 4
- 2022Fully Decentralized, Scalable Gaussian Processes for Multi-Agent Federated Learningcited by 4
- 2022Learning Sequential Latent Variable Models from Multimodal Time Series Datacited by 4
- 2022Generalized Product-of-Experts for Learning Multimodal Representations in Noisy Environmentscited by 4
- 2022Unite and Conquer: Plug & Play Multi-Modal Synthesis using Diffusion Modelscited by 4
- 2025Streaming Generated Gaussian Process Experts for Online Learning and Control: Extended Versioncited by 4
- 2022Encoding Domain Knowledge in Multi-view Latent Variable Models: A Bayesian Approach with Structured Sparsitycited by 3
- 2022Multi-view Multi-label Fine-grained Emotion Decoding from Human Brain Activitycited by 3
- 2023Robust Multi-agent Communication via Multi-view Message Certificationcited by 3
- 2023Vecchia Gaussian Process Ensembles on Internal Representations of Deep Neural Networkscited by 3
- 2023Learning-based Control for PMSM Using Distributed Gaussian Processes with Optimal Aggregation Strategycited by 3
- 2024Whom to Trust? Elective Learning for Distributed Gaussian Process Regressioncited by 3
- 2025Test-Time Steering for Lossless Text Compression via Weighted Product of Expertscited by 3
- 2021Healing Products of Gaussian Processescited by 2
- 2024A Gaussian Process-based Streaming Algorithm for Prediction of Time Series With Regimes and Outlierscited by 2
- 2021Gaussian Experts Selection using Graphical Modelscited by 1
- 2021Distributed Bayesian Online Learning for Cooperative Manipulationcited by 1
- 2021Modular Gaussian Processes for Transfer Learningcited by 1
- 2022Multi-view information fusion using multi-view variational autoencoders to predict proximal femoral strengthcited by 1
- 2023Sense, Imagine, Act: Multimodal Perception Improves Model-Based Reinforcement Learning for Head-to-Head Autonomous Racingcited by 1
- 2023Multi-View Variational Autoencoder for Missing Value Imputation in Untargeted Metabolomicscited by 1
- 2024Towards AI-Based Precision Oncology: A Machine Learning Framework for Personalized Counterfactual Treatment Suggestions based on Multi-Omics Datacited by 1
- 2024Fusion of Gaussian Processes Predictions with Monte Carlo Samplingcited by 1
- 2024A tutorial on multi-view autoencoders using the multi-view-AE librarycited by 1
- 2024Gaussian Process Upper Confidence Bounds in Distributed Point Target Tracking over Wireless Sensor Networkscited by 1
- 2024GPTreeO: An R package for continual regression with dividing local Gaussian processescited by 1
- 2024Asynchronous Distributed Gaussian Process Regression for Online Learning and Dynamical Systems: Complementary Documentcited by 1
- 2025Data-Driven Discovery of Feature Groups in Clinical Time Seriescited by 1
- 2026Quality or Quantity? Error-Informed Selective Online Learning with Gaussian Processes in Multi-Agent Systems: Extended Versioncited by 1
- 2026Geometry-Aware Post-Hoc Uncertainty Quantification in Operator Learningcited by 1
- 2026Information-Based Calibration of Uncertainty Quantification in Product-of-Experts Gaussian Process Modelscited by 1
50 most cited of 66 All 66 (JSON)
- 2026Asynchronous Cooperative Online Learning for Multi-Robot Control under Computational Delays30 Aug 2026
- 2026Information-Based Calibration of Uncertainty Quantification in Product-of-Experts Gaussian Process Models29 Aug 2026
- 2026Auditing Instruction-Trajectory Mismatches in Multimodal Robot Demonstrations8 Aug 2026
- 2026Geometry-Aware Post-Hoc Uncertainty Quantification in Operator Learning16 Jun 2026
- 2026ADKO: Agentic Decentralized Knowledge Optimization8 May 2026
- 2026Beyond Mixtures and Products for Ensemble Aggregation: A Likelihood Perspective on Generalized Means4 Mar 2026
- 2026MolLIBRA: Genetic Molecular Optimization with Multi-Fingerprint Surrogates and Text-Molecule Aligned Critic29 Jan 2026
- 2026Quality or Quantity? Error-Informed Selective Online Learning with Gaussian Processes in Multi-Agent Systems: Extended Version10 Jan 2026
- 2025Data-Driven Discovery of Feature Groups in Clinical Time Series11 Nov 2025
- 2025Test-Time Steering for Lossless Text Compression via Weighted Product of Experts4 Nov 2025
- 2025Streaming Generated Gaussian Process Experts for Online Learning and Control: Extended Version5 Aug 2025
- 2025Adaptive Resolution for Finite-Rank Gaussian Processes29 May 2025
38 more
- 2024Asynchronous Distributed Gaussian Process Regression for Online Learning and Dynamical Systems: Complementary Document16 Dec 2024
- 2024XLSTM-HVED: Cross-Modal Brain Tumor Segmentation and MRI Reconstruction Method Using Vision XLSTM and Heteromodal Variational Encoder-Decoder9 Dec 2024
- 2024GPTreeO: An R package for continual regression with dividing local Gaussian processes1 Oct 2024
- 2024Gaussian Process Upper Confidence Bounds in Distributed Point Target Tracking over Wireless Sensor Networks11 Sep 2024
- 2024Aggregation Models with Optimal Weights for Distributed Gaussian Processes1 Aug 2024
- 2024A Gaussian Process-based Streaming Algorithm for Prediction of Time Series With Regimes and Outliers1 Jun 2024
- 2024A tutorial on multi-view autoencoders using the multi-view-AE library12 Mar 2024
- 2024Fusion of Gaussian Processes Predictions with Monte Carlo Sampling3 Mar 2024
- 2024FlexHB: a More Efficient and Flexible Framework for Hyperparameter Optimization21 Feb 2024
- 2024Towards AI-Based Precision Oncology: A Machine Learning Framework for Personalized Counterfactual Treatment Suggestions based on Multi-Omics Data19 Feb 2024
- 2024Whom to Trust? Elective Learning for Distributed Gaussian Process Regression5 Feb 2024
- 2024Prototypical Information Bottlenecking and Disentangling for Multimodal Cancer Survival Prediction3 Jan 2024
- 2023Multimodal Variational Auto-encoder based Audio-Visual Segmentation12 Oct 2023
- 2023Multi-View Variational Autoencoder for Missing Value Imputation in Untargeted Metabolomics12 Oct 2023
- 2023Learning-based Control for PMSM Using Distributed Gaussian Processes with Optimal Aggregation Strategy26 Jul 2023
- 2023Leveraging Locality and Robustness to Achieve Massively Scalable Gaussian Process Regression26 Jun 2023
- 2023Mutual Information Regularization for Weakly-supervised RGB-D Salient Object Detection6 Jun 2023
- 2023Towards Anytime Classification in Early-Exit Architectures by Enforcing Conditional Monotonicity5 Jun 2023
- 2023Vecchia Gaussian Process Ensembles on Internal Representations of Deep Neural Networks26 May 2023
- 2023Sense, Imagine, Act: Multimodal Perception Improves Model-Based Reinforcement Learning for Head-to-Head Autonomous Racing8 May 2023
- 2023Robust Multi-agent Communication via Multi-view Message Certification7 May 2023
- 2023Multi-modal Variational Autoencoders for normative modelling across multiple imaging modalities16 Mar 2023
- 2022Empirical Asset Pricing via Ensemble Gaussian Process Regression2 Dec 2022
- 2022Unite and Conquer: Plug & Play Multi-Modal Synthesis using Diffusion Models1 Dec 2022
- 2022Entry Dependent Expert Selection in Distributed Gaussian Processes Using Multilabel Classification17 Nov 2022
- 2022Generalized Product-of-Experts for Learning Multimodal Representations in Noisy Environments7 Nov 2022
- 2022Variational Hierarchical Mixtures for Probabilistic Learning of Inverse Dynamics2 Nov 2022
- 2022Multi-view Multi-label Fine-grained Emotion Decoding from Human Brain Activity26 Oct 2022
- 2022Hierarchical Policy Blending as Inference for Reactive Robot Control14 Oct 2022
- 2022Uncertainty Estimation for Multi-view Data: The Power of Seeing the Whole Picture6 Oct 2022
- 2022Multi-view information fusion using multi-view variational autoencoders to predict proximal femoral strength3 Oct 2022
- 2022Decentralized Coordination in Partially Observable Queueing Networks29 Aug 2022
- 2022Federated Bayesian Neural Regression: A Scalable Global Federated Gaussian Process13 Jun 2022
- 2022Scalable Online Disease Diagnosis via Multi-Model-Fused Actor-Critic Reinforcement Learning8 Jun 2022
- 2022Foundation Posteriors for Approximate Probabilistic Inference19 May 2022
- 2022Learning Sequential Latent Variable Models from Multimodal Time Series Data21 Apr 2022
- 2022Encoding Domain Knowledge in Multi-view Latent Variable Models: A Bayesian Approach with Structured Sparsity13 Apr 2022
- 2022Fully Decentralized, Scalable Gaussian Processes for Multi-Agent Federated Learning6 Mar 2022
50 newest of 66 All 66 (JSON)
- 2026ADKO: Agentic Decentralized Knowledge Optimizationcited by 0
- 2026ADKO: Agentic Decentralized Knowledge Optimization8 May 2026
- 2021OpenBox: A Generalized Black-box Optimization Servicecited by 46
- 2024Prototypical Information Bottlenecking and Disentangling for Multimodal Cancer Survival Predictioncited by 41
- 2021A Variational Information Bottleneck Approach to Multi-Omics Data Integrationcited by 40
- 2023Multimodal Variational Auto-encoder based Audio-Visual Segmentationcited by 37
- 2021ProxyBO: Accelerating Neural Architecture Search via Bayesian Optimization with Zero-cost Proxiescited by 20
- 2021Bias-Free Scalable Gaussian Processes via Randomized Truncationscited by 15
- 2022Scalable Bayesian Optimization Using Vecchia Approximations of Gaussian Processescited by 11
- 2022Uncertainty Estimation for Multi-view Data: The Power of Seeing the Whole Picturecited by 10
- 2023Multi-modal Variational Autoencoders for normative modelling across multiple imaging modalitiescited by 10
- 2023Mutual Information Regularization for Weakly-supervised RGB-D Salient Object Detectioncited by 9
- 2021Federated Gaussian Process: Convergence, Automatic Personalization and Multi-fidelity Modelingcited by 8
- 2022Hierarchical Policy Blending as Inference for Reactive Robot Controlcited by 8
12 most cited of 60 All 60 (JSON)
- 2026Asynchronous Cooperative Online Learning for Multi-Robot Control under Computational Delays30 Aug 2026
- 2026Information-Based Calibration of Uncertainty Quantification in Product-of-Experts Gaussian Process Models29 Aug 2026
- 2026Geometry-Aware Post-Hoc Uncertainty Quantification in Operator Learning16 Jun 2026
- 2026Beyond Mixtures and Products for Ensemble Aggregation: A Likelihood Perspective on Generalized Means4 Mar 2026
- 2026MolLIBRA: Genetic Molecular Optimization with Multi-Fingerprint Surrogates and Text-Molecule Aligned Critic29 Jan 2026
- 2026Quality or Quantity? Error-Informed Selective Online Learning with Gaussian Processes in Multi-Agent Systems: Extended Version10 Jan 2026
- 2025Data-Driven Discovery of Feature Groups in Clinical Time Series11 Nov 2025
- 2025Test-Time Steering for Lossless Text Compression via Weighted Product of Experts4 Nov 2025
- 2025Streaming Generated Gaussian Process Experts for Online Learning and Control: Extended Version5 Aug 2025
- 2025Adaptive Resolution for Finite-Rank Gaussian Processes29 May 2025
- 2024Asynchronous Distributed Gaussian Process Regression for Online Learning and Dynamical Systems: Complementary Document16 Dec 2024
- 2024XLSTM-HVED: Cross-Modal Brain Tumor Segmentation and MRI Reconstruction Method Using Vision XLSTM and Heteromodal Variational Encoder-Decoder9 Dec 2024
12 newest of 60 All 60 (JSON)