mlsanityData to 7 Oct 2026

Robust X-Learner: Breaking the Curse of Imbalance and Heavy Tails via Robust Cross-Imputation

arXiv 2601.15360 ↗First posted 21 Jan 2026stat.ML cs.LG econ.EMcited by 0

Not on the map. Why?

Abstract (arXiv)

Estimating Heterogeneous Treatment Effects (HTE) in industrial applications such as AdTech and healthcare presents a dual challenge: extreme class imbalance and heavy-tailed outcome distributions. While the X-Learner framework effectively addresses imbalance through cross-imputation, we demonstrate that it is fundamentally vulnerable to "Outlier Smearing" when reliant on Mean Squared Error (MSE) minimization. In this failure mode, the bias from a few extreme observations ("whales") in the minority group is propagated to the entire majority group during the imputation step, corrupting the estimated treatment effect structure. To resolve this, we propose the Robust X-Learner (RX-Learner). This framework integrates a redescending γ-divergence objective -- structurally equivalent to the Welsch loss under Gaussian assumptions -- into the gradient boosting machinery. We further stabilize the non-convex optimization using a Proxy Hessian strategy grounded in Majorization-Minimization (MM) principles. Empirical evaluation on a semi-synthetic Criteo Uplift dataset demonstrates that the RX-Learner reduces the Precision in Estimation of Heterogeneous Effect (PEHE) metric by 98.6% compared to the standard X-Learner, effectively decoupling the stable "Core" population from the volatile "Periphery".

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 5 of its 17 references that are in the map. First posted on arXiv 21 Jan 2026.

Builds on

5 of 17 references.

References · 5

  1. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  2. 2017Meta-learners for Estimating Heterogeneous Treatment Effects using Machine Learningcited by 475
  3. 2017Quasi-Oracle Estimation of Heterogeneous Treatment Effectscited by 328
  4. 2015Recursive Partitioning for Heterogeneous Causal Effectscited by 254
  5. 2019NGBoost: Natural Gradient Boosting for Probabilistic Predictioncited by 94

Built on by

Not cited yet.