mlsanityData to 7 Oct 2026

The Cake that is Intelligence and Who Gets to Bake it: An AI Analogy and its Implications for Participation

arXiv 2502.03038 ↗First posted 5 Feb 2025cs.AI cs.CY cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

In a widely popular analogy by Turing Award Laureate Yann LeCun, machine intelligence has been compared to cake - where unsupervised learning forms the base, supervised learning adds the icing, and reinforcement learning is the cherry on top. We expand this 'cake that is intelligence' analogy from a simple structural metaphor to the full life-cycle of AI systems, extending it to sourcing of ingredients (data), conception of recipes (instructions), the baking process (training), and the tasting and selling of the cake (evaluation and distribution). Leveraging our re-conceptualization, we describe each step's entailed social ramifications and how they are bounded by statistical assumptions within machine learning. Whereas these technical foundations and social impacts are deeply intertwined, they are often studied in isolation, creating barriers that restrict meaningful participation. Our re-conceptualization paves the way to bridge this gap by mapping where technical foundations interact with social outcomes, highlighting opportunities for cross-disciplinary dialogue. Finally, we conclude with actionable recommendations at each stage of the metaphorical AI cake's life-cycle, empowering prospective AI practitioners, users, and researchers, with increased awareness and ability to engage in broader AI discourse.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 55 of its 153 references that are in the map. First posted on arXiv 5 Feb 2025.

Builds on

55 of 153 references.

References · 55

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  5. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  6. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  7. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  8. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  9. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,018
  10. 2023Let's Verify Step by Stepcited by 3,598
  11. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
  12. 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,140
38 more
  1. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,793
  2. 2016Understanding deep learning requires rethinking generalizationcited by 1,657
  3. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
  4. 2018Datasheets for Datasetscited by 1,371
  5. 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
  6. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
  7. 2023LIMA: Less Is More for Alignmentcited by 1,080
  8. 2018Experience Replay for Continual Learningcited by 1,074
  9. 2019An Introduction to Variational Autoencoderscited by 997
  10. 2017Revisiting Unreasonable Effectiveness of Data in Deep Learning Eracited by 916
  11. 2017Counterfactual Fairnesscited by 802
  12. 2017Dynamic Routing Between Capsulescited by 689
  13. 2019Deep Double Descent: Where Bigger Models and More Data Hurtcited by 667
  14. 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 582
  15. 2017Opening the Black Box of Deep Neural Networks via Informationcited by 494
  16. 2018Do Deep Generative Models Know What They Don't Know?cited by 443
  17. 2018QuAC : Question Answering in Contextcited by 379
  18. 2019Unmasking Clever Hans Predictors and Assessing What Machines Really Learncited by 359
  19. 2023How is ChatGPT's behavior changing over time?cited by 265
  20. 2023The Unlocking Spell on Base LLMs: Rethinking Alignment via In-Context Learningcited by 251
  21. 2019The Evolved Transformercited by 180
  22. 2022Power to the People? Opportunities and Challenges for Participatory AIcited by 137
  23. 2021Harms of Gender Exclusivity and Challenges in Non-Binary Representation in Language Technologiescited by 128
  24. 2019On the Apparent Conflict Between Individual and Group Fairnesscited by 126
  25. 2021A Clarification of the Nuances in the Fairness Metrics Landscapecited by 98
  26. 2018The Measure and Mismeasure of Fairnesscited by 94
  27. 2017One Model To Learn Them Allcited by 86
  28. 2020A Wholistic View of Continual Learning with Deep Neural Networks: Forgotten Lessons and the Bridge to Active and Open World Learningcited by 86
  29. 2023The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practicecited by 86
  30. 2022GradMax: Growing Neural Networks using Gradient Informationcited by 64
  31. 2023"I'm fully who I am": Towards Centering Transgender and Non-Binary Voices to Measure Biases in Open Language Generationcited by 56
  32. 2023Into the LAIONs Den: Investigating Hate in Multimodal Datasetscited by 54
  33. 2014Deep Neural Networks Rival the Representation of Primate IT Cortex for Core Visual Object Recognitioncited by 50
  34. 2023On the De-duplication of LAION-2Bcited by 47
  35. 2023Queer In AI: A Case Study in Community-Led Participatory AIcited by 33
  36. 2021CLEVA-Compass: A Continual Learning EValuation Assessment Compass to Promote Research Transparency and Comparabilitycited by 28
  37. 2021Stakeholder Participation in AI: Beyond "Add Diverse Stakeholders and Stir"cited by 26
  38. 2022A Theory for Knowledge Transfer in Continual Learningcited by 16

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.