Sparse Optimization for Transfer Learning: A L0-Regularized Framework for Multi-Source Domain Adaptation
Not on the map. Why?
Abstract (arXiv)
This paper explores transfer learning in heterogeneous multi-source environments with distributional divergence between target and auxiliary domains. To address challenges in statistical bias and computational efficiency, we propose a Sparse Optimization for Transfer Learning (SOTL) framework based on L0-regularization. The method extends the Joint Estimation Transferred from Strata (JETS) paradigm with two key innovations: (1) L0-constrained exact sparsity for parameter space compression and complexity reduction, and (2) refining optimization focus to emphasize target parameters over redundant ones. Simulations show that SOTL significantly improves both estimation accuracy and computational speed, especially under adversarial auxiliary domain conditions. Empirical validation on the Community and Crime benchmarks demonstrates the statistical robustness of the SOTL method in cross-domain transfer.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 37 references that are in the map. First posted on arXiv 7 Apr 2025.
Builds on
11 of 37 references.
References · 11
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2020Transfer Learning for High-dimensional Linear Regression: Prediction, Estimation, and Minimax Optimalitycited by 89
- 2021Transfer Learning under High-dimensional Generalized Linear Modelscited by 69
- 2019Transfer Learning for Nonparametric Classification: Minimax Rate and Adaptive Classifiercited by 64
- 2020Transfer Learning in Large-scale Gaussian Graphical Models with False Discovery Rate Controlcited by 38
- 2018Predicting with Proxies: Transfer Learning in High Dimensioncited by 24
- 2021abess: A Fast Best Subset Selection Library in Python and Rcited by 16
- 2018Bayesian multi-domain learning for cancer subtype discovery from next-generation sequencing count datacited by 10
- 2017Adversarial Transfer Learning for Cross-domain Visual Recognitioncited by 4
- 2021Variable selection in convex quantile regression: L1-norm or L0-norm regularization?cited by 3
Built on by
Not cited yet.