The Cake that is Intelligence and Who Gets to Bake it: An AI Analogy and its Implications for Participation
Not on the map. Why?
Abstract (arXiv)
In a widely popular analogy by Turing Award Laureate Yann LeCun, machine intelligence has been compared to cake - where unsupervised learning forms the base, supervised learning adds the icing, and reinforcement learning is the cherry on top. We expand this 'cake that is intelligence' analogy from a simple structural metaphor to the full life-cycle of AI systems, extending it to sourcing of ingredients (data), conception of recipes (instructions), the baking process (training), and the tasting and selling of the cake (evaluation and distribution). Leveraging our re-conceptualization, we describe each step's entailed social ramifications and how they are bounded by statistical assumptions within machine learning. Whereas these technical foundations and social impacts are deeply intertwined, they are often studied in isolation, creating barriers that restrict meaningful participation. Our re-conceptualization paves the way to bridge this gap by mapping where technical foundations interact with social outcomes, highlighting opportunities for cross-disciplinary dialogue. Finally, we conclude with actionable recommendations at each stage of the metaphorical AI cake's life-cycle, empowering prospective AI practitioners, users, and researchers, with increased awareness and ability to engage in broader AI discourse.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 55 of its 153 references that are in the map. First posted on arXiv 5 Feb 2025.
Builds on
55 of 153 references.
References · 55
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,018
- 2023Let's Verify Step by Stepcited by 3,598
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,140
38 more
- 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,793
- 2016Understanding deep learning requires rethinking generalizationcited by 1,657
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
- 2018Datasheets for Datasetscited by 1,371
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
- 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
- 2023LIMA: Less Is More for Alignmentcited by 1,080
- 2018Experience Replay for Continual Learningcited by 1,074
- 2019An Introduction to Variational Autoencoderscited by 997
- 2017Revisiting Unreasonable Effectiveness of Data in Deep Learning Eracited by 916
- 2017Counterfactual Fairnesscited by 802
- 2017Dynamic Routing Between Capsulescited by 689
- 2019Deep Double Descent: Where Bigger Models and More Data Hurtcited by 667
- 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 582
- 2017Opening the Black Box of Deep Neural Networks via Informationcited by 494
- 2018Do Deep Generative Models Know What They Don't Know?cited by 443
- 2018QuAC : Question Answering in Contextcited by 379
- 2019Unmasking Clever Hans Predictors and Assessing What Machines Really Learncited by 359
- 2023How is ChatGPT's behavior changing over time?cited by 265
- 2023The Unlocking Spell on Base LLMs: Rethinking Alignment via In-Context Learningcited by 251
- 2019The Evolved Transformercited by 180
- 2022Power to the People? Opportunities and Challenges for Participatory AIcited by 137
- 2021Harms of Gender Exclusivity and Challenges in Non-Binary Representation in Language Technologiescited by 128
- 2019On the Apparent Conflict Between Individual and Group Fairnesscited by 126
- 2021A Clarification of the Nuances in the Fairness Metrics Landscapecited by 98
- 2018The Measure and Mismeasure of Fairnesscited by 94
- 2017One Model To Learn Them Allcited by 86
- 2020A Wholistic View of Continual Learning with Deep Neural Networks: Forgotten Lessons and the Bridge to Active and Open World Learningcited by 86
- 2023The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practicecited by 86
- 2022GradMax: Growing Neural Networks using Gradient Informationcited by 64
- 2023"I'm fully who I am": Towards Centering Transgender and Non-Binary Voices to Measure Biases in Open Language Generationcited by 56
- 2023Into the LAIONs Den: Investigating Hate in Multimodal Datasetscited by 54
- 2014Deep Neural Networks Rival the Representation of Primate IT Cortex for Core Visual Object Recognitioncited by 50
- 2023On the De-duplication of LAION-2Bcited by 47
- 2023Queer In AI: A Case Study in Community-Led Participatory AIcited by 33
- 2021CLEVA-Compass: A Continual Learning EValuation Assessment Compass to Promote Research Transparency and Comparabilitycited by 28
- 2021Stakeholder Participation in AI: Beyond "Add Diverse Stakeholders and Stir"cited by 26
- 2022A Theory for Knowledge Transfer in Continual Learningcited by 16
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.