mlsanityData to 13 Oct 2026

Harnessing Source Heterogeneity for Cluster-Structured Transfer Learning

arXiv 2606.05258 ↗First posted 3 Jun 2026stat.ML cs.LG stat.APcited by 0

Not on the map. Why?

Abstract (arXiv)

Transfer learning is a natural strategy when a target population has limited data but multiple related auxiliary sources are available. A central difficulty is source heterogeneity: auxiliary sources may not be equally useful, and their usefulness may vary in a structured, cluster-like fashion. Existing transfer-learning methods often reduce source selection to a binary informative/non-informative decision, overlooking subgroups of sources with differential transferability. Motivated by a suicide-risk study using data from the Connecticut Hospital Information Management Exchange (CHIME), comprising 636,758 patients across 27 hospitals, we propose Trans-GLMC, a cluster-structured transfer-learning procedure for generalized linear models. The CHIME setting illustrates the core challenge: hospital-specific risk models are unstable because suicide attempts are rare at any single facility, whereas indiscriminate pooling across hospitals can obscure facility-level differences in patient mix and risk profiles. Trans-GLMC first constructs a coefficient-based distance among the target and candidate sources to recover latent source clusters. It then combines global fusion, within-cluster refinement, and target debiasing to produce an estimator that adapts to the detected structure. We establish a non-asymptotic error bound that improves over its unclustered counterpart whenever a meaningful target cluster exists and matches the unclustered rate up to constants otherwise. In simulations and in the CHIME study, Trans-GLMC improves facility-specific prediction, identifies interpretable communities of hospitals with mutual transferability, and recovers clinically coherent suicide-risk factors.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 11 of its 49 references that are in the map. First posted on arXiv 3 Jun 2026.

Builds on

11 of 49 references.

References · 11

  1. 2020Transfer Learning for High-dimensional Linear Regression: Prediction, Estimation, and Minimax Optimalitycited by 90
  2. 2021Transfer Learning under High-dimensional Generalized Linear Modelscited by 70
  3. 2013Regularized M-estimators with nonconvexity: Statistical and algorithmic theory for local optimacited by 66
  4. 2019Transfer Learning for Nonparametric Classification: Minimax Rate and Adaptive Classifiercited by 65
  5. 2020Transfer Learning in Large-scale Gaussian Graphical Models with False Discovery Rate Controlcited by 38
  6. 2018Learning Tasks for Multitask Learning: Heterogenous Patient Populations in the ICUcited by 21
  7. 2021Targeting Underrepresented Populations in Precision Medicine: A Federated Transfer Learning Approachcited by 20
  8. 2022Active Learning for Regression by Inverse Distance Weightingcited by 9
  9. 2024Federated Transfer Learning with Differential Privacycited by 8
  10. 2023Inverse distance weighting attentioncited by 4
  11. 2022Transfer Learning with Large-Scale Quantile Regressioncited by 2

Built on by

Not cited yet.