mlsanityData to 7 Oct 2026

On Tables with Numbers, with Numbers

arXiv 2408.06062 ↗First posted 12 Aug 2024cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

This paper is a critical reflection on the epistemic culture of contemporary computational linguistics, framed in the context of its growing obsession with tables with numbers. We argue against tables with numbers on the basis of their epistemic irrelevance, their environmental impact, their role in enabling and exacerbating social inequalities, and their deep ties to commercial applications and profit-driven research. We substantiate our arguments with empirical evidence drawn from a meta-analysis of computational linguistics research over the last decade.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 26 of its 84 references that are in the map. First posted on arXiv 12 Aug 2024.

Builds on

26 of 84 references.

References · 26

  1. 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,507
  2. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
  3. 2019Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inferencecited by 864
  4. 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
  5. 2019Green AIcited by 620
  6. 2021AI and the Everything in the Whole Wide World Benchmarkcited by 340
  7. 2022Challenges and Strategies in Cross-Cultural NLPcited by 216
  8. 2019Are We Modeling the Task or the Annotator? An Investigation of Annotator Bias in Natural Language Understanding Datasetscited by 173
  9. 2021The Values Encoded in Machine Learning Researchcited by 172
  10. 2019Show Your Work: Improved Reporting of Experimental Resultscited by 164
  11. 2019The Ethics of AI Ethics -- An Evaluation of Guidelinescited by 129
  12. 2018Troubling Trends in Machine Learning Scholarshipcited by 107
14 more
  1. 2020The Cost of Training NLP Models: A Concise Overviewcited by 97
  2. 2023A Systematic Review of Green AIcited by 77
  3. 2021A Survey of Race, Racism, and Anti-Racism in NLPcited by 74
  4. 2022On scientific understanding with artificial intelligencecited by 68
  5. 2020The De-democratization of AI: Deep Learning and the Compute Divide in Artificial Intelligence Researchcited by 67
  6. 2020Targeting the Benchmark: On Methodology in Current Natural Language Processing Researchcited by 44
  7. 2020The Grey Hoodie Project: Big Tobacco, Big Tech, and the threat on academic integritycited by 38
  8. 2020What Can We Do to Improve Peer Review in NLP?cited by 32
  9. 2022What Do NLP Researchers Believe? Results of the NLP Community Metasurveycited by 28
  10. 2023The Elephant in the Room: Analyzing the Presence of Big Tech in Natural Language Processing Researchcited by 27
  11. 2022Geographic Citation Gaps in NLP Researchcited by 19
  12. 2023Forgotten Knowledge: Examining the Citational Amnesia in NLPcited by 13
  13. 2020A narrowing of AI research?cited by 12
  14. 2021The Privatization of AI Research(-ers): Causes and Potential Consequences -- From university-industry interaction to public research brain-drain?cited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 1.

4 papers.

  1. 2025Interdisciplinary Research in Conversation: A Case Study in Computational Morphology for Language Documentationcited by 4
  2. 2025Souper-Model: How Simple Arithmetic Unlocks State-of-the-Art LLM Performancecited by 4
  3. 2025Big AI is accelerating the metacrisis: What can we do?cited by 0
  4. 2026Beyond Good Intentions: When Does the Framing of Multilingual and Low-Resource NLP Research Become a Caricature?cited by 0