mlsanityData to 7 Oct 2026

Hyperparameter Search in Machine Learning

arXiv 1502.02127 ↗First posted 7 Feb 2015cs.LG stat.MLcited by 33

Not on the map. Why?

Abstract (arXiv)

We introduce the hyperparameter search problem in the field of machine learning and discuss its main challenges from an optimization perspective. Machine learning methods attempt to build models that capture some element of interest based on given data. Most common learning algorithms feature a set of hyperparameters that must be determined before training commences. The choice of hyperparameters can significantly affect the resulting model's performance, but determining good values can be complex; hence a disciplined, theoretically sound search strategy is essential.

Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Feb 2015.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 10; 2022: 6; 2023: 7; 2024: 5; 2025: 4; 2026: 1.

33 papers.

Sort:

  1. 2021The Out-of-Distribution Problem in Explainability and Search Methods for Feature Importance Explanationscited by 86
  2. 2024Super Consistency of Neural Network Landscapes and Learning Rate Transfercited by 23
  3. 2021Hyperparameter Optimization Is Deceiving Us, and How to Stop Itcited by 20
  4. 2021Edge-Native Intelligence for 6G Communications Driven by Federated Learning: A Survey of Trends and Challengescited by 12
  5. 2021An Overview of Machine Learning Techniques for Radiowave Propagation Modelingcited by 8
  6. 2021VisRuler: Visual Analytics for Extracting Decision Rules from Bagged and Boosted Decision Treescited by 8
  7. 2021A Novel Genetic Algorithm with Hierarchical Evaluation Strategy for Hyperparameter Optimisation of Graph Neural Networkscited by 7
  8. 2022KGTuner: Efficient Hyper-parameter Search for Knowledge Graph Learningcited by 7
  9. 2022Distributed intelligence on the Edge-to-Cloud Continuum: A systematic literature reviewcited by 6
  10. 2023An Efficient Drifters Deployment Strategy to Evaluate Water Current Velocity Fieldscited by 6
  11. 2023AutoML for Large Capacity Modeling of Meta's Ranking Systemscited by 4
  12. 2024Machine Learning Approaches for Mental Illness Detection on Social Media: A Systematic Review of Biases and Methodological Challengescited by 4
21 more
  1. 2023Efficient and Joint Hyperparameter and Architecture Search for Collaborative Filteringcited by 3
  2. 2021Characterizing Social Imaginaries and Self-Disclosures of Dissonance in Online Conspiracy Discussion Communitiescited by 2
  3. 2021Jasmine: A New Active Learning Approach to Combat Cybercrimecited by 2
  4. 2021HyP-ABC: A Novel Automated Hyper-Parameter Tuning Algorithm Using Evolutionary Optimizationcited by 2
  5. 2022Nothing makes sense in deep learning, except in the light of evolutioncited by 2
  6. 2024Boosting House Price Estimations with Multi-Head Gated Attentioncited by 2
  7. 2025Hierarchical Deep Feature Fusion and Ensemble Learning for Enhanced Brain Tumor MRI Classificationcited by 2
  8. 2022Practitioner Motives to Use Different Hyperparameter Optimization Methodscited by 1
  9. 2022Forecasting the abnormal events at well drilling with machine learningcited by 1
  10. 2023Mithridates: Auditing and Boosting Backdoor Resistance of Machine Learning Pipelinescited by 1
  11. 2024GenAI4UQ: A Software for Inverse Uncertainty Quantification Using Conditional Generative Modelscited by 1
  12. 2025A Unified Hyperparameter Optimization Pipeline for Transformer-Based Time Series Forecasting Modelscited by 1
  13. 2025Hybrid Ensemble Approaches: Optimal Deep Feature Fusion and Hyperparameter-Tuned Classifier Ensembling for Enhanced Brain Tumor Classificationcited by 1
  14. 2021Artificial Intelligence and Design of Experiments for Assessing Security of Electricity Supply: A Review and Strategic Outlookcited by 0
  15. 2022Density reconstruction from schlieren images through Bayesian nonparametric modelscited by 0
  16. 2023FairPilot: An Explorative System for Hyperparameter Tuning through the Lens of Fairnesscited by 0
  17. 2023Evolution under Length Constraints for CNN Architecture designcited by 0
  18. 2023Towards Sobolev Pruningcited by 0
  19. 2024Inference Stage Denoising for Undersampled MRI Reconstructioncited by 0
  20. 2025From Edge to HPC: Investigating Cross-Facility Data Streaming Architecturescited by 0
  21. 2026Joint Optimization of Storage and Loading for High-Performance 3D Point Cloud Data Processingcited by 0