Revisiting Rogers' Paradox in the Context of Human-AI Interaction
Not on the map. Why?
Abstract (arXiv)
Humans learn about the world, and how to act in the world, in many ways: from individually conducting experiments to observing and reproducing others' behavior. Different learning strategies come with different costs and likelihoods of successfully learning more about the world. The choice that any one individual makes of how to learn can have an impact on the collective understanding of a whole population if people learn from each other. Alan Rogers developed simulations of a population of agents to study these network phenomena where agents could individually or socially learn amidst a dynamic, uncertain world and uncovered a confusing result: the availability of cheap social learning yielded no benefit to population fitness over individual learning. This paradox spawned decades of work trying to understand and uncover factors that foster the relative benefit of social learning that centuries of human behavior suggest exists. What happens in such network models now that humans can socially learn from AI systems that are themselves socially learning from us? We revisit Rogers' Paradox in the context of human-AI interaction to probe a simplified network of humans and AI systems learning together about an uncertain world. We propose and examine the impact of several learning strategies on the quality of the equilibrium of a society's 'collective world model'. We consider strategies that can be undertaken by various stakeholders involved in a single human-AI interaction: human, AI model builder, and society or regulators around the interaction. We then consider possible negative feedback loops that may arise from humans learning socially from AI: that learning from the AI may impact our own ability to learn about the world. We close with open directions into studying networks of human and AI systems that can be explored in enriched versions of our simulation framework.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 48 of its 96 references that are in the map. First posted on arXiv 16 Jan 2025.
Builds on
48 of 96 references.
References · 48
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
- 2023Reasoning with Language Model is Planning with World Modelcited by 861
- 2017Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithmcited by 734
- 2022Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskcited by 431
- 2023Language Models Represent Space and Timecited by 316
- 2020Towards Continual Reinforcement Learning: A Review and Perspectivescited by 274
- 2020Consistent Estimators for Learning to Defer to an Expertcited by 271
- 2023Data-centric Artificial Intelligence: A Surveycited by 203
36 more
- 2023Gender bias and stereotypes in Large Language Modelscited by 187
- 2024The PRISM Alignment Dataset: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Modelscited by 144
- 2022The Debate Over Understanding in AI's Large Language Modelscited by 142
- 2023Harms from Increasingly Agentic Algorithmic Systemscited by 135
- 2022Language Models as Agent Modelscited by 132
- 2020Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertaintycited by 129
- 2024Simple and Scalable Strategies to Continually Pre-train Large Language Modelscited by 127
- 2021Expanding Explainability: Towards Social Transparency in AI systemscited by 124
- 2023From Word Models to World Models: Translating from Natural Language to the Probabilistic Language of Thoughtcited by 119
- 2024Evaluating the World Model Implicit in a Generative Modelcited by 113
- 2024The Ethics of Advanced AI Assistantscited by 107
- 2024When combinations of humans and AI are useful: A systematic review and meta-analysiscited by 106
- 2017Grounded Language Learning in a Simulated 3D Worldcited by 100
- 2021Algorithmic Monoculture and Social Welfarecited by 100
- 2024Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systemscited by 96
- 2024Building Machines that Learn and Think with Peoplecited by 73
- 2023Evaluating Language Models for Mathematics through Interactionscited by 70
- 2019Rapid trial-and-error learning with simulation supports flexible tool use and physical reasoningcited by 61
- 2023Machine Culturecited by 55
- 2024Elements of World Knowledge (EWoK): A Cognition-Inspired Framework for Evaluating Basic World Knowledge in Language Modelscited by 55
- 2024Large Language Models Assume People are More Rational than We Really arecited by 54
- 2023From task structures to world models: What do LLMs know?cited by 46
- 2022Eliciting and Learning with Soft Labels from Every Annotatorcited by 43
- 2023The Unequal Opportunities of Large Language Models: Revealing Demographic Bias through Job Recommendationscited by 41
- 2023Human Uncertainty in Concept-Based AI Systemscited by 39
- 2020Understanding Human Intelligence through Human Limitationscited by 33
- 2024A Decision Theoretic Framework for Measuring AI Reliancecited by 28
- 2024Do Large Language Models Perform the Way People Expect? Measuring the Human Generalization Functioncited by 24
- 2023Accuracy-Time Tradeoffs in AI-Assisted Decision Making under Time Pressurecited by 17
- 2023Learning Personalized Decision Support Policiescited by 14
- 2024Modulating Language Model Experiences through Frictionscited by 13
- 2022On the Informativeness of Supervision Signalscited by 12
- 2024Decoding AI's Nudge: A Unified Framework to Predict Human Behavior in AI-assisted Decision Makingcited by 9
- 2024When Should Algorithms Resign? A Proposal for AI Governancecited by 6
- 2024Representational Alignment Supports Effective Machine Teachingcited by 3
- 2022Explanations as Programs in Probabilistic Logic Programmingcited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
- 2025When Should We Orchestrate Multiple Agents?cited by 7
- 2026Why Human Guidance Matters in Collaborative Vibe Codingcited by 3
- 2026Why Human Guidance Matters in Collaborative Vibe Coding11 Feb 2026
- 2025When Should We Orchestrate Multiple Agents?17 Mar 2025
Similar, not cited
Close in wording, no citation either way
- 2026Emergent social transmission of model-based representations without inference
- 2026Increasing intelligence in AI agents can worsen collective outcomes
- 2024Multi-Agent, Human-Agent and Beyond: A Survey on Cooperation in Social Dilemmas
- 2023Understanding the World to Solve Social Dilemmas Using Multi-Agent Reinforcement Learning
- 2026Agentivism: a learning theory for the age of artificial intelligence
- 2025Language and Experience: A Computational Model of Social Learning in Complex Tasks
- 2026Collective cooperation without individual fidelity in LLM agents
- 2026Causal Effects with Unobserved Unit Types in Interacting Human-AI Systems