# Semi-supervised Inference for Explained Variance in High-dimensional Linear Regression and Its Applications

arXiv: https://arxiv.org/abs/1806.06179 · HTML: https://mlsanity.com/paper/1806.06179/

## Key facts

- Cited by 14 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 16 Jun 2018.

## Built on by (most cited first, 14 of 14)

- [Cross-Prediction-Powered Inference](https://mlsanity.com/paper/2309.16598/) (2023)
- [The Fundamental Limits of Structure-Agnostic Functional Estimation](https://mlsanity.com/paper/2305.04116/) (2023)
- [Surrogate Assisted Semi-supervised Inference for High Dimensional Risk Prediction](https://mlsanity.com/paper/2105.01264/) (2021)
- [Double Robust Semi-Supervised Inference for the Mean: Selection Bias under MAR Labeling with Decaying Overlap](https://mlsanity.com/paper/2104.06667/) (2021)
- [Distributed Semi-Supervised Sparse Statistical Inference](https://mlsanity.com/paper/2306.10395/) (2023)
- [On semi-supervised estimation using exponential tilt mixture models](https://mlsanity.com/paper/2311.08504/) (2023)
- [Efficient semi-supervised inference for logistic regression under case-control studies](https://mlsanity.com/paper/2402.15365/) (2024)
- [Bayesian Semi-supervised Inference via a Debiased Modeling Approach](https://mlsanity.com/paper/2509.17385/) (2025)
- [SADA: Safe and Adaptive Aggregation of Multiple Black-Box Predictions in Semi-Supervised Learning](https://mlsanity.com/paper/2509.21707/) (2025)
- [High-dimensional Semi-supervised Classification via the Fermat Distance](https://mlsanity.com/paper/2604.23573/) (2026)
- [A Heteroskedasticity-Robust Overidentifying Restriction Test with High-Dimensional Covariates](https://mlsanity.com/paper/2205.00171/) (2022)
- [Optimal Exact Recovery in Semi-Supervised Learning: A Study of Spectral Methods and Graph Convolutional Networks](https://mlsanity.com/paper/2412.13754/) (2024)
- [Optimal Sampling for Generalized Linear Model under Measurement Constraint with Surrogate Variables](https://mlsanity.com/paper/2501.00972/) (2025)
- [Semi-supervised learning for linear extremile regression](https://mlsanity.com/paper/2507.01314/) (2025)

## Abstract (arXiv)

This paper considers statistical inference for the explained variance βintercalSigma β under the high-dimensional linear model Y=Xβ+ε in the semi-supervised setting, where β is the regression vector and Sigma is the design covariance matrix. A calibrated estimator, which efficiently integrates both labelled and unlabelled data, is proposed. It is shown that the estimator achieves the minimax optimal rate of convergence in the general semi-supervised framework. The optimality result characterizes how the unlabelled data contributes to the estimation accuracy. Moreover, the limiting distribution for the proposed estimator is established and the unlabelled data has also proven useful in reducing the length of the confidence interval for the explained variance. The proposed method is extended to the semi-supervised inference for the unweighted quadratic functional, |β|22. The obtained inference results are then applied to a range of high-dimensional statistical problems, including signal detection and global testing, prediction accuracy evaluation, and confidence ball construction. The numerical improvement of incorporating the unlabelled data is demonstrated through simulation studies and an analysis of estimating heritability for a yeast segregant data set with multiple traits.