In Defense of the Paper
Not on the map. Why?
Abstract (arXiv)
The machine learning publication process is broken, of that there can be no doubt. Many of these flaws are attributed to the current workflow: LaTeX to PDF to reviewers to camera ready PDF. This has understandably resulted in the desire for new forms of publications; ones that can increase inclusively, accessibility and pedagogical strength. However, this venture fails to address the origins of these inadequacies in the contemporary paper workflow. The paper, being the basic unit of academic research, is merely how problems in the publication and research ecosystem manifest; but is not itself responsible for them. Not only will simply replacing or augmenting papers with different formats not fix existing problems; when used as a band-aid without systemic changes, will likely exacerbate the existing inequities. In this work, we argue that the root cause of hindrances in the accessibility of machine learning research lies not in the paper workflow but within the misaligned incentives behind the publishing and research processes. We discuss these problems and argue that the paper is the optimal workflow. We also highlight some potential solutions for the incentivization problems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 51 references that are in the map. First posted on arXiv 16 Apr 2021.
Builds on
20 of 51 references.
References · 20
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2015Continuous control with deep reinforcement learningcited by 3,407
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,274
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
- 2020Extracting Training Data from Large Language Modelscited by 2,189
- 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,254
- 2018Soft Actor-Critic Algorithms and Applicationscited by 1,240
- 2017Deep Reinforcement Learning that Matterscited by 754
- 2017Distributional Reinforcement Learning with Quantile Regressioncited by 474
- 2020Improving Reproducibility in Machine Learning Research (A Report from the NeurIPS 2019 Reproducibility Program)cited by 322
8 more
- 2019Differential Privacy Has Disparate Impact on Model Accuracycited by 316
- 2020Characterising Bias in Compressed Modelscited by 167
- 2020Maxmin Q-learning: Controlling the Estimation Bias of Q-learningcited by 117
- 2018Troubling Trends in Machine Learning Scholarshipcited by 108
- 2019Fairwashing: the risk of rationalizationcited by 81
- 2020The Radicalization Risks of GPT-3 and Advanced Neural Language Modelscited by 76
- 2018The Mirage of Action-Dependent Baselines in Reinforcement Learningcited by 48
- 2019HARK Side of Deep Learning -- From Grad Student Descent to Automated Machine Learningcited by 13
Built on by
Not cited yet.