# Efficient Empirical Bayes prediction under check loss using Asymptotic Risk Estimates

arXiv: https://arxiv.org/abs/1511.00028 · HTML: https://mlsanity.com/paper/1511.00028/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 30 Oct 2015.

## Built on by (most cited first, 3 of 3)

- [Adaptive Data Fusion for Multi-task Non-smooth Optimization](https://mlsanity.com/paper/2210.12334/) (2022)
- [LLM-Inspired Pretrain-Then-Finetune for Small-Data, Large-Scale Optimization](https://mlsanity.com/paper/2602.03690/) (2026)
- [Mostly Beneficial Clustering: Aggregating Data for Operational Decision Making](https://mlsanity.com/paper/2311.17326/) (2023)

## Abstract (arXiv)

We develop a novel Empirical Bayes methodology for prediction under check loss in high-dimensional Gaussian models. The check loss is a piecewise linear loss function having differential weights for measuring the amount of underestimation or overestimation. Prediction under it differs in fundamental aspects from estimation or prediction under weighted-quadratic losses. Because of the nature of this loss, our inferential target is a pre-chosen quantile of the predictive distribution rather than the mean of the predictive distribution. We develop a new method for constructing uniformly efficient asymptotic risk estimates which are then minimized to produce effective linear shrinkage predictive rules. In calculating the magnitude and direction of shrinkage, our proposed predictive rules incorporate the asymmetric nature of the loss function and are shown to be asymptotically optimal. Using numerical experiments we compare the performance of our method with traditional Empirical Bayes procedures and obtain encouraging results.
