# Robust angle-based transfer learning in high dimensions

arXiv: https://arxiv.org/abs/2210.12759 · HTML: https://mlsanity.com/paper/2210.12759/

## Key facts

- Cited by 16 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 23 Oct 2022.

## Built on by (most cited first, 16 of 16)

- [Multi-Task Learning with Summary Statistics](https://mlsanity.com/paper/2307.02388/) (2023)
- [Efficient and Multiply Robust Risk Estimation under General Forms of Dataset Shift](https://mlsanity.com/paper/2306.16406/) (2023)
- [Representation Retrieval Learning for Heterogeneous Data Integration](https://mlsanity.com/paper/2503.09494/) (2025)
- [Quantifying Data Similarity Using Cross Learning](https://mlsanity.com/paper/2510.10866/) (2025)
- [Multi-Task Dynamic Pricing in Credit Market with Contextual Information](https://mlsanity.com/paper/2410.14839/) (2024)
- [Late Fusion Multi-task Learning for Semiparametric Inference with Nuisance Parameters](https://mlsanity.com/paper/2507.07941/) (2025)
- [Transfer Learning through Enhanced Sufficient Representation: Enriching Source Domain Knowledge with Target Data](https://mlsanity.com/paper/2502.20414/) (2025)
- [When More Data Doesn't Help: Limits of Adaptation in Multitask Learning](https://mlsanity.com/paper/2601.20774/) (2026)
- [Statistical Learning for Heterogeneous Treatment Effects: Pretraining, Prognosis, and Prediction](https://mlsanity.com/paper/2505.00310/) (2025)
- [GeoERM: Geometry-Aware Multi-Task Representation Learning on Riemannian Manifolds](https://mlsanity.com/paper/2505.02972/) (2025)
- [Transfer Learning for Matrix Completion](https://mlsanity.com/paper/2507.02248/) (2025)
- [Adaptive Multi-task Learning for Multi-sector Portfolio Optimization](https://mlsanity.com/paper/2507.16433/) (2025)
- [Robust and Adaptive Spectral Method for Representation Multi-Task Learning with Contamination](https://mlsanity.com/paper/2509.06575/) (2025)
- [Representation-Aware Distributionally Robust Optimization: A Knowledge Transfer Framework](https://mlsanity.com/paper/2509.09371/) (2025)
- [Hierarchical Projection for Adaptive Knowledge Transfer](https://mlsanity.com/paper/2606.08691/) (2026)
- [Enhancing Spectral Embedding through Robust and Flexible Knowledge Transfer in Electronic Health Records](https://mlsanity.com/paper/2606.11570/) (2026)

## Abstract (arXiv)

Transfer learning aims to improve the performance of a target model by leveraging data from related source populations, which is known to be especially helpful in cases with insufficient target data. In this paper, we study the problem of how to train a high-dimensional ridge regression model using limited target data and existing regression models trained in heterogeneous source populations. We consider a practical setting where only the parameter estimates of the fitted source models are accessible, instead of the individual-level source data. Under the setting with only one source model, we propose a novel flexible angle-based transfer learning (angleTL) method, which leverages the concordance between the source and the target model parameters. We show that angleTL unifies several benchmark methods by construction, including the target-only model trained using target data alone, the source model fitted on source data, and distance-based transfer learning method that incorporates the source parameter estimates and the target data under a distance-based similarity constraint. We also provide algorithms to effectively incorporate multiple source models accounting for the fact that some source models may be more helpful than others. Our high-dimensional asymptotic analysis provides interpretations and insights regarding when a source model can be helpful to the target model, and demonstrates the superiority of angleTL over other benchmark methods. We perform extensive simulation studies to validate our theoretical conclusions and show the feasibility of applying angleTL to transfer existing genetic risk prediction models across multiple biobanks.