# Benchmarking Relief-Based Feature Selection Methods for Bioinformatics Data Mining

arXiv: https://arxiv.org/abs/1711.08477 · HTML: https://mlsanity.com/paper/1711.08477/

## Key facts

- Cited by 17 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 22 Nov 2017.

## Built on by (most cited first, 17 of 17)

- [Hybrid gene selection approach using XGBoost and multi-objective genetic algorithm for cancer classification](https://mlsanity.com/paper/2106.05841/) (2021)
- [Automatic feature selection and weighting in molecular systems using Differentiable Information Imbalance](https://mlsanity.com/paper/2411.00851/) (2024)
- [LCS-DIVE: An Automated Rule-based Machine Learning Visualization Pipeline for Characterizing Complex Associations in Classification](https://mlsanity.com/paper/2104.12844/) (2021)
- [First Step Towards EXPLAINable DGA Multiclass Classification](https://mlsanity.com/paper/2106.12336/) (2021)
- [A Hybrid Ensemble Feature Selection Design for Candidate Biomarkers Discovery from Transcriptome Profiles](https://mlsanity.com/paper/2108.00290/) (2021)
- [Utilizing Semantic Textual Similarity for Clinical Survey Data Feature Selection](https://mlsanity.com/paper/2308.09892/) (2023)
- [Cost-based feature selection for network model choice](https://mlsanity.com/paper/2101.07766/) (2021)
- [ReliefE: Feature Ranking in High-dimensional Spaces via Manifold Embeddings](https://mlsanity.com/paper/2101.09577/) (2021)
- [Feature Selection Tutorial with Python Examples](https://mlsanity.com/paper/2106.06437/) (2021)
- [An automated machine learning framework to optimize radiomics model construction validated on twelve clinical applications](https://mlsanity.com/paper/2108.08618/) (2021)
- [STREAMLINE: A Simple, Transparent, End-To-End Automated Machine Learning Pipeline Facilitating Data Analysis and Algorithm Comparison](https://mlsanity.com/paper/2206.12002/) (2022)
- [Evaluating Soccer Match Prediction Models: A Deep Learning Approach and Feature Optimization for Gradient-Boosted Trees](https://mlsanity.com/paper/2309.14807/) (2023)
- [A novel evaluation methodology for supervised Feature Ranking algorithms](https://mlsanity.com/paper/2207.04258/) (2022)
- [Genetic heterogeneity analysis using genetic algorithm and network science](https://mlsanity.com/paper/2308.06429/) (2023)
- [FeatureCuts: Feature Selection for Large Data by Optimizing the Cutoff](https://mlsanity.com/paper/2508.00954/) (2025)
- [MOELIGA: a multi-objective evolutionary approach for feature selection with local improvement](https://mlsanity.com/paper/2603.20934/) (2026)
- [Advancing Interaction-Sensitive Feature Selection: Novel Relief-Based Algorithms, Expanded Comparisons, and Recommendations for Biomedical Data Mining](https://mlsanity.com/paper/2608.28552/) (2026)

## Abstract (arXiv)

Modern biomedical data mining requires feature selection methods that can (1) be applied to large scale feature spaces (e.g. `omics' data), (2) function in noisy problems, (3) detect complex patterns of association (e.g. gene-gene interactions), (4) be flexibly adapted to various problem domains and data types (e.g. genetic variants, gene expression, and clinical data) and (5) are computationally tractable. To that end, this work examines a set of filter-style feature selection algorithms inspired by the `Relief' algorithm, i.e. Relief-Based algorithms (RBAs). We implement and expand these RBAs in an open source framework called ReBATE (Relief-Based Algorithm Training Environment). We apply a comprehensive genetic simulation study comparing existing RBAs, a proposed RBA called MultiSURF, and other established feature selection methods, over a variety of problems. The results of this study (1) support the assertion that RBAs are particularly flexible, efficient, and powerful feature selection methods that differentiate relevant features having univariate, multivariate, epistatic, or heterogeneous associations, (2) confirm the efficacy of expansions for classification vs. regression, discrete vs. continuous features, missing data, multiple classes, or class imbalance, (3) identify previously unknown limitations of specific RBAs, and (4) suggest that while MultiSURF* performs best for explicitly identifying pure 2-way interactions, MultiSURF yields the most reliable feature selection performance across a wide range of problem types.