mlsanityData to 14 Oct 2026

Position: Embracing Negative Results in Machine Learning

arXiv 2406.03980 ↗First posted 6 Jun 2024cs.LGcited by 6

Not on the map. Why?

Abstract (arXiv)

Publications proposing novel machine learning methods are often primarily rated by exhibited predictive performance on selected problems. In this position paper we argue that predictive performance alone is not a good indicator for the worth of a publication. Using it as such even fosters problems like inefficiencies of the machine learning research community as a whole and setting wrong incentives for researchers. We therefore put out a call for the publication of "negative" results, which can help alleviate some of these problems and improve the scientific output of the machine learning research community. To substantiate our position, we present the advantages of publishing negative results and provide concrete measures for the community to move towards a paradigm where their publication is normalized.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 12 of its 27 references that are in the map. First posted on arXiv 6 Jun 2024.

Builds on

12 of 27 references.

References · 12

  1. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  2. 2014Explaining and Harnessing Adversarial Examplescited by 7,364
  3. 2013Intriguing properties of neural networkscited by 5,155
  4. 2014Going Deeper with Convolutionscited by 4,241
  5. 2018YOLOv3: An Incremental Improvementcited by 2,659
  6. 2020Improving Reproducibility in Machine Learning Research (A Report from the NeurIPS 2019 Reproducibility Program)cited by 322
  7. 2020Common pitfalls and recommendations for using machine learning to detect and prognosticate for COVID-19 using chest radiographs and CT scanscited by 158
  8. 2021Torch.manual_seed(3407) is all you need: On the influence of random seeds in deep learning architectures for computer visioncited by 81
  9. 2019NAS evaluation is frustratingly hardcited by 70
  10. 2018Re-evaluating Evaluationcited by 47
  11. 2022Predicting the Future of AI with AI: High-quality link prediction in an exponentially growing knowledge networkcited by 36
  12. 2023Pre-registration for Predictive Modelingcited by 13

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 4.

6 papers.