Semi-supervised Deep Kernel Learning: Regression with Unlabeled Data by Minimizing Predictive Variance
Not on the map. Why?
Abstract (arXiv)
Large amounts of labeled data are typically required to train deep learning models. For many real-world problems, however, acquiring additional data can be expensive or even impossible. We present semi-supervised deep kernel learning (SSDKL), a semi-supervised regression model based on minimizing predictive variance in the posterior regularization framework. SSDKL combines the hierarchical representation learning of neural networks with the probabilistic modeling capabilities of Gaussian processes. By leveraging unlabeled data, we show improvements on a diverse set of real-world regression tasks over supervised deep kernel learning and semi-supervised methods such as VAT and mean teacher adapted for regression.
Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 10; 2023: 8; 2024: 2; 2025: 6; 2026: 2.
34 papers.
Sort:
By area:
- 2022USB: A Unified Semi-supervised Learning Benchmark for Classificationcited by 95
- 2021Extending the WILDS Benchmark for Unsupervised Adaptationcited by 86
- 2021High-Dimensional Bayesian Optimisation with Variational Autoencoders and Deep Metric Learningcited by 54
- 2022Pre-Train Your Loss: Easy Bayesian Transfer Learning with Informative Priorscited by 43
- 2022NP-Match: When Neural Processes meet Semi-Supervised Learningcited by 25
- 2022Improved Training of Physics-Informed Neural Networks with Model Ensemblescited by 19
- 2022FisherMatch: Semi-Supervised Rotation Regression via Entropy-based Filteringcited by 16
- 2023Semi-Supervised Deep Regression with Uncertainty Consistency and Variational Model Ensembling via Bayesian Neural Networkscited by 16
- 2023Semi-Supervised Graph Imbalanced Regressioncited by 14
- 2022MMD-B-Fair: Learning Fair Representations with Statistical Testingcited by 13
- 2023PG-LBO: Enhancing High-Dimensional Bayesian Optimization with Pseudo-Label and Gaussian Process Guidancecited by 9
- 2021Twin Neural Network Regression is a Semi-Supervised Regression Algorithmcited by 6
22 more
- 2023High-Dimensional Bayesian Optimization via Semi-Supervised Learning with Optimized Unlabeled Data Samplingcited by 5
- 2025Taste More, Taste Better: Diverse Data and Strong Model Boost Semi-Supervised Crowd Countingcited by 5
- 2021Semi-supervised Learning for Data-driven Soft-sensing of Biological and Chemical Processescited by 3
- 2022Unsupervised domain adaptation and super resolution on drone images for autonomous dry herbage biomass estimationcited by 3
- 2021A lightweight deep learning based cloud detection method for Sentinel-2A imagery fusing multi-scale spectral and spatial featurescited by 2
- 2024Learning Representations for Independence Testingcited by 2
- 2025Natural Evolutionary Search meets Probabilistic Numericscited by 2
- 2022Consecutive Knowledge Meta-Adaptation Learning for Unsupervised Medical Diagnosiscited by 1
- 2023NP-Match: Towards a New Probabilistic Model for Semi-Supervised Learningcited by 1
- 2023Mixed Semi-Supervised Generalized-Linear-Regression with Applications to Deep-Learning and Interpolatorscited by 1
- 2021Built Year Prediction from Buddha Face with Heterogeneous Labelscited by 0
- 2022A Generalized Weighted Optimization Method for Computational Learning and Inversioncited by 0
- 2022Deep Low-Density Separation for Semi-Supervised Classificationcited by 0
- 2023Regression with Sensor Data Containing Incomplete Observationscited by 0
- 2023An information-Theoretic Approach to Semi-supervised Transfer Learningcited by 0
- 2024Exploring Probabilistic Models for Semi-supervised Learningcited by 0
- 2025Toward Robust Semi-supervised Regression via Dual-stream Knowledge Distillationcited by 0
- 2025Unbiased Stochastic Optimization for Gaussian Processes on Finite Dimensional RKHScited by 0
- 2025Response to Promises and Pitfalls of Deep Kernel Learningcited by 0
- 2025Contrastive Learning for Semi-Supervised Deep Regression with Generalized Ordinal Rankings from Spectral Seriationcited by 0
- 2026SpecRegMatch: Robust Semi-Supervised Regression for Vehicle Interior Noise Predictioncited by 0
- 2026CoGameReg: Cooperative-Game-Based Collaborative Semi-Supervised Regression for Seismic Reservoir Property Predictioncited by 0
- 2026CoGameReg: Cooperative-Game-Based Collaborative Semi-Supervised Regression for Seismic Reservoir Property Prediction9 Oct 2026
- 2026SpecRegMatch: Robust Semi-Supervised Regression for Vehicle Interior Noise Prediction28 Sep 2026
- 2025Contrastive Learning for Semi-Supervised Deep Regression with Generalized Ordinal Rankings from Spectral Seriation10 Dec 2025
- 2025Response to Promises and Pitfalls of Deep Kernel Learning25 Sep 2025
- 2025Unbiased Stochastic Optimization for Gaussian Processes on Finite Dimensional RKHS28 Aug 2025
- 2025Toward Robust Semi-supervised Regression via Dual-stream Knowledge Distillation12 Aug 2025
- 2025Natural Evolutionary Search meets Probabilistic Numerics9 Jul 2025
- 2025Taste More, Taste Better: Diverse Data and Strong Model Boost Semi-Supervised Crowd Counting23 Mar 2025
- 2024Learning Representations for Independence Testing10 Sep 2024
- 2024Exploring Probabilistic Models for Semi-supervised Learning5 Apr 2024
- 2023PG-LBO: Enhancing High-Dimensional Bayesian Optimization with Pseudo-Label and Gaussian Process Guidance28 Dec 2023
- 2023An information-Theoretic Approach to Semi-supervised Transfer Learning11 Jun 2023
22 more
- 2023Semi-Supervised Graph Imbalanced Regression20 May 2023
- 2023High-Dimensional Bayesian Optimization via Semi-Supervised Learning with Optimized Unlabeled Data Sampling4 May 2023
- 2023Regression with Sensor Data Containing Incomplete Observations26 Apr 2023
- 2023Mixed Semi-Supervised Generalized-Linear-Regression with Applications to Deep-Learning and Interpolators19 Feb 2023
- 2023Semi-Supervised Deep Regression with Uncertainty Consistency and Variational Model Ensembling via Bayesian Neural Networks15 Feb 2023
- 2023NP-Match: Towards a New Probabilistic Model for Semi-Supervised Learning31 Jan 2023
- 2022MMD-B-Fair: Learning Fair Representations with Statistical Testing15 Nov 2022
- 2022Consecutive Knowledge Meta-Adaptation Learning for Unsupervised Medical Diagnosis21 Sep 2022
- 2022USB: A Unified Semi-supervised Learning Benchmark for Classification12 Aug 2022
- 2022NP-Match: When Neural Processes meet Semi-Supervised Learning3 Jul 2022
- 2022Deep Low-Density Separation for Semi-Supervised Classification22 May 2022
- 2022Pre-Train Your Loss: Easy Bayesian Transfer Learning with Informative Priors20 May 2022
- 2022Unsupervised domain adaptation and super resolution on drone images for autonomous dry herbage biomass estimation18 Apr 2022
- 2022Improved Training of Physics-Informed Neural Networks with Model Ensembles11 Apr 2022
- 2022FisherMatch: Semi-Supervised Rotation Regression via Entropy-based Filtering29 Mar 2022
- 2022A Generalized Weighted Optimization Method for Computational Learning and Inversion23 Jan 2022
- 2021Extending the WILDS Benchmark for Unsupervised Adaptation9 Dec 2021
- 2021Built Year Prediction from Buddha Face with Heterogeneous Labels2 Sep 2021
- 2021Semi-supervised Learning for Data-driven Soft-sensing of Biological and Chemical Processes29 Jul 2021
- 2021Twin Neural Network Regression is a Semi-Supervised Regression Algorithm11 Jun 2021
- 2021High-Dimensional Bayesian Optimisation with Variational Autoencoders and Deep Metric Learning7 Jun 2021
- 2021A lightweight deep learning based cloud detection method for Sentinel-2A imagery fusing multi-scale spectral and spatial features29 Apr 2021
- 2022USB: A Unified Semi-supervised Learning Benchmark for Classificationcited by 95
- 2021Extending the WILDS Benchmark for Unsupervised Adaptationcited by 86
- 2021High-Dimensional Bayesian Optimisation with Variational Autoencoders and Deep Metric Learningcited by 54
- 2022Pre-Train Your Loss: Easy Bayesian Transfer Learning with Informative Priorscited by 43
- 2022NP-Match: When Neural Processes meet Semi-Supervised Learningcited by 25
- 2022Improved Training of Physics-Informed Neural Networks with Model Ensemblescited by 19
- 2022FisherMatch: Semi-Supervised Rotation Regression via Entropy-based Filteringcited by 16
- 2023Semi-Supervised Deep Regression with Uncertainty Consistency and Variational Model Ensembling via Bayesian Neural Networkscited by 16
- 2023Semi-Supervised Graph Imbalanced Regressioncited by 14
- 2022MMD-B-Fair: Learning Fair Representations with Statistical Testingcited by 13
- 2023PG-LBO: Enhancing High-Dimensional Bayesian Optimization with Pseudo-Label and Gaussian Process Guidancecited by 9
- 2021Twin Neural Network Regression is a Semi-Supervised Regression Algorithmcited by 6
12 most cited of 32 All 32 (JSON)
- 2026CoGameReg: Cooperative-Game-Based Collaborative Semi-Supervised Regression for Seismic Reservoir Property Prediction9 Oct 2026
- 2026SpecRegMatch: Robust Semi-Supervised Regression for Vehicle Interior Noise Prediction28 Sep 2026
- 2025Contrastive Learning for Semi-Supervised Deep Regression with Generalized Ordinal Rankings from Spectral Seriation10 Dec 2025
- 2025Response to Promises and Pitfalls of Deep Kernel Learning25 Sep 2025
- 2025Unbiased Stochastic Optimization for Gaussian Processes on Finite Dimensional RKHS28 Aug 2025
- 2025Natural Evolutionary Search meets Probabilistic Numerics9 Jul 2025
- 2025Taste More, Taste Better: Diverse Data and Strong Model Boost Semi-Supervised Crowd Counting23 Mar 2025
- 2024Learning Representations for Independence Testing10 Sep 2024
- 2024Exploring Probabilistic Models for Semi-supervised Learning5 Apr 2024
- 2023PG-LBO: Enhancing High-Dimensional Bayesian Optimization with Pseudo-Label and Gaussian Process Guidance28 Dec 2023
- 2023An information-Theoretic Approach to Semi-supervised Transfer Learning11 Jun 2023
- 2023Semi-Supervised Graph Imbalanced Regression20 May 2023
12 newest of 32 All 32 (JSON)