# Modular Regression: Improving Linear Models by Incorporating Auxiliary Data

arXiv: https://arxiv.org/abs/2211.10032 · HTML: https://mlsanity.com/paper/2211.10032/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 18 Nov 2022.

## Built on by (most cited first, 5 of 5)

- [Imputation-Powered Inference](https://mlsanity.com/paper/2509.13778/) (2025)
- [GReaTER: Generate Realistic Tabular data after data Enhancement and Reduction](https://mlsanity.com/paper/2503.15564/) (2025)
- [DEREC-SIMPRO: unlock Language Model benefits to advance Synthesis in Data Clean Room](https://mlsanity.com/paper/2411.00879/) (2024)
- [Distributionally Robust Transfer Learning with Structurally Missing Covariates, with Application to Cross-National Cardiac Arrest Prediction](https://mlsanity.com/paper/2605.24212/) (2026)
- [Shapley Value Estimation for Multi-Site Data with Blockwise-Missing Features](https://mlsanity.com/paper/2609.14902/) (2026)

## Abstract (arXiv)

This paper develops a new framework, called modular regression, to utilize auxiliary information -- such as variables other than the original features or additional data sets -- in the training process of linear models. At a high level, our method follows the routine: (i) decomposing the regression task into several sub-tasks, (ii) fitting the sub-task models, and (iii) using the sub-task models to provide an improved estimate for the original regression problem. This routine applies to widely-used low-dimensional (generalized) linear models and high-dimensional regularized linear regression. It also naturally extends to missing-data settings where only partial observations are available. By incorporating auxiliary information, our approach improves the estimation efficiency and prediction accuracy upon linear regression or the Lasso under a conditional independence assumption for predicting the outcome. For high-dimensional settings, we develop an extension of our procedure that is robust to violations of the conditional independence assumption, in the sense that it improves efficiency if this assumption holds and coincides with the Lasso otherwise. We demonstrate the efficacy of our methods with simulated and real data sets.