mlsanityData to 7 Oct 2026

A Review of Feature Selection Methods Based on Mutual Information

arXiv 1509.07577 ↗First posted 24 Sep 2015cs.LG stat.MLcited by 67

Not on the map. Why?

Abstract (arXiv)

In this work we present a review of the state of the art of information theoretic feature selection methods. The concepts of feature relevance, redundance and complementarity (synergy) are clearly defined, as well as Markov blanket. The problem of optimal feature selection is defined. A unifying theoretical framework is described, which can retrofit successful heuristic criteria, indicating the approximations made by each method. A number of open problems in the field are presented.

Key facts. Cited by 67 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Sep 2015.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 9; 2022: 12; 2023: 14; 2024: 7; 2025: 14; 2026: 11.

67 papers.

Sort:

By area:

  1. 2022A Consistent and Efficient Evaluation Strategy for Attribution Methodscited by 100
  2. 2023Factorized Contrastive Learning: Going Beyond Multi-view Redundancycited by 73
  3. 2022ZIN: When and How to Learn Invariance Without Environment Partition?cited by 58
  4. 2024TuneTables: Context Optimization for Scalable Prior-Data Fitted Networkscited by 47
  5. 2022Beyond Images: Label Noise Transition Matrix Estimation for Tasks with Lower-Quality Featurescited by 27
  6. 2025Speech DF Arena: A Leaderboard for Speech DeepFake Detection Modelscited by 20
  7. 2021Layer-wise Model Pruning based on Mutual Informationcited by 19
  8. 2023FLAC: Fairness-Aware Representation Learning by Suppressing Attribute-Class Associationscited by 18
  9. 2023Scaling TabPFN: Sketching and Feature Selection for Tabular Prior-Data Fitted Networkscited by 18
  10. 2025Explainable Deep Neural Network for Multimodal ECG Signals: Intermediate vs Late Fusioncited by 6
  11. 2025Exact Shapley Attributions in Quadratic-time for FANOVA Gaussian Processescited by 6
  12. 2021Evaluating Resilience of Encrypted Traffic Classification Against Adversarial Evasion Attackscited by 4
38 more
  1. 2022Active Learning and Novel Model Calibration Measurements for Automated Visual Inspection in Manufacturingcited by 4
  2. 2022A robust estimator of mutual information for deep learning interpretabilitycited by 4
  3. 2025FMMI: Flow Matching Mutual Information Estimationcited by 4
  4. 2022Unsupervised Features Ranking via Coalitional Game Theory for Categorical Datacited by 3
  5. 2022A survey of some recent developments in measures of associationcited by 3
  6. 2023Causal Entropy and Information Gain for Measuring Causal Controlcited by 3
  7. 2021Enhancing ensemble learning and transfer learning in multimodal data analysis by adaptive dimensionality reductioncited by 2
  8. 2021Network Generalization Prediction for Safety Critical Tasks in Novel Operating Domainscited by 2
  9. 2022ManiFeSt: Manifold-based Feature Selection for Small Data Setscited by 2
  10. 2023Effective Neural Network L0 Regularization With BinMaskcited by 2
  11. 2023A statistical approach to detect sensitive features in a group fairness settingcited by 2
  12. 2023Feature Selection: A perspective on inter-attribute cooperationcited by 2
  13. 2024Binary Feature Mask Optimization for Feature Selectioncited by 2
  14. 2024Active Few-Shot Fine-Tuningcited by 2
  15. 2024A Backdoor-based Explainable AI Benchmark for High Fidelity Evaluation of Attributionscited by 2
  16. 2021Data augmentation and feature selection for automatic model recommendation in computational physicscited by 1
  17. 2021Cost-based feature selection for network model choicecited by 1
  18. 2021Feature selection for medical diagnosis: Evaluation for using a hybrid Stacked-Genetic approach in the diagnosis of heart diseasecited by 1
  19. 2021Active feature selection discovers minimal gene sets for classifying cell types and disease states with single-cell mRNA-seq datacited by 1
  20. 2021A graph representation based on fluid diffusion model for data analysis: theoretical aspects and enhanced community detectioncited by 1
  21. 2022Model-free feature selection to facilitate automatic discovery of divergent subgroups in tabular datacited by 1
  22. 2023PIKS: A Technique to Identify Actionable Trends for Policy-Makers Through Open Healthcare Datacited by 1
  23. 2023A representation learning approach to probe for dynamical dark energy in matter power spectracited by 1
  24. 2024Enhancing Feature Selection and Interpretability in AI Regression Tasks Through Feature Attributioncited by 1
  25. 2025LambdaCDM and early dark energy in latent space: a data-driven parametrization of the CMB temperature power spectrumcited by 1
  26. 2025A Neural Difference-of-Entropies Estimator for Mutual Informationcited by 1
  27. 2025k-fold Subsampling based Sequential Backward Feature Eliminationcited by 1
  28. 2025Improving Audio Classification by Transitioning from Zero- to Few-Shotcited by 1
  29. 2025SoK: Data Minimization in Machine Learningcited by 1
  30. 2026Multi-Adapter PPO: A Cross-Attention Enhanced Wavelength Selection Framework for LIBS Quantitative Analysiscited by 1
  31. 2022Sparsity-based Feature Selection for Anomalous Subgroup Discoverycited by 0
  32. 2022Sparse Centroid-Encoder: A Nonlinear Model for Feature Selectioncited by 0
  33. 2022A GA-like Dynamic Probability Method With Mutual Information for Feature Selectioncited by 0
  34. 2023Fuzzy Gene Selection and Cancer Classification Based on Deep Learning Modelcited by 0
  35. 2023Hardness of Deceptive Certificate Selectioncited by 0
  36. 2023Feature Selection using Sparse Adaptive Bottleneck Centroid-Encodercited by 0
  37. 2023Feature selection simultaneously preserving both class and cluster structurescited by 0
  38. 2023Multi-Label Feature Selection Using Adaptive and Transformed Relevancecited by 0

50 most cited of 67 All 67 (JSON)