# An adaptive subsampling method for large-sample feature screening

arXiv: https://arxiv.org/abs/2509.16085 · HTML: https://mlsanity.com/paper/2509.16085/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 11 of its 46 references that are in the map.
- First posted on arXiv 19 Sep 2025.

## Builds on (most cited first, 11 of 11)

- [Graph Neural Networks in Recommender Systems: A Survey](https://mlsanity.com/paper/2011.02260/) (2020)
- [Large Language Models are Zero-Shot Rankers for Recommender Systems](https://mlsanity.com/paper/2305.08845/) (2023)
- [On the Complexity of Best Arm Identification in Multi-Armed Bandit Models](https://mlsanity.com/paper/1407.4443/) (2014)
- [Self-supervised Learning on Graphs: Contrastive, Generative,or Predictive](https://mlsanity.com/paper/2105.07342/) (2021)
- [Improving Graph Collaborative Filtering with Neighborhood-enriched Contrastive Learning](https://mlsanity.com/paper/2202.06200/) (2022)
- [Model-free Feature Screening and FDR Control with Knockoff Features](https://mlsanity.com/paper/1908.06597/) (2019)
- [A Bandit Approach to Maximum Inner Product Search](https://mlsanity.com/paper/1812.06360/) (2018)
- [Reverse Maximum Inner Product Search: How to efficiently find users who would like to buy my item?](https://mlsanity.com/paper/2110.07131/) (2021)
- [Modern Subsampling Methods for Large-Scale Least Squares Regression](https://mlsanity.com/paper/2105.01552/) (2021)
- [Core-Elements for Large-Scale Least Squares Estimation](https://mlsanity.com/paper/2206.10240/) (2022)
- [Accelerating Matrix Factorization by Dynamic Pruning for Fast Recommendation](https://mlsanity.com/paper/2404.04265/) (2024)

## Abstract (arXiv)

We consider the sure independence screening (SIS) method, a standard feature screening approach that aims to eliminate non-informative features in ultrahigh-dimensional datasets. Although effective, SIS incurs a computational cost of order O(np) for a predictor matrix of size n× p, which can be prohibitively expensive when both n and p are considerable. Motivated by the multi-armed bandit (MAB) problem, we propose a more computationally efficient feature screening algorithm that reduces the cost to O(√np). The core idea is to progressively increase the subsample size and eliminate variables with small empirical marginal Pearson correlations, thereby avoiding unnecessary computation on unpromising features. We develop a new interpretable statistical theoretical analysis that characterizes how the subsample size affects screening accuracy, thereby revealing the balance between computational efficiency and statistical reliability. Moreover, we show that the proposed method retains the sure screening property under mild regularity conditions. Extensive numerical experiments on synthetic and real-world datasets show that BanditSIS achieves screening and prediction performance comparable to SIS while substantially reducing computational time. Our method offers a scalable and adaptive alternative to SIS, particularly well-suited for large-sample, high-dimensional applications where computational efficiency is critical.