mlsanityData to 14 Oct 2026

Revisiting Rogers' Paradox in the Context of Human-AI Interaction

arXiv 2501.10476 ↗First posted 16 Jan 2025cs.AI cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Humans learn about the world, and how to act in the world, in many ways: from individually conducting experiments to observing and reproducing others' behavior. Different learning strategies come with different costs and likelihoods of successfully learning more about the world. The choice that any one individual makes of how to learn can have an impact on the collective understanding of a whole population if people learn from each other. Alan Rogers developed simulations of a population of agents to study these network phenomena where agents could individually or socially learn amidst a dynamic, uncertain world and uncovered a confusing result: the availability of cheap social learning yielded no benefit to population fitness over individual learning. This paradox spawned decades of work trying to understand and uncover factors that foster the relative benefit of social learning that centuries of human behavior suggest exists. What happens in such network models now that humans can socially learn from AI systems that are themselves socially learning from us? We revisit Rogers' Paradox in the context of human-AI interaction to probe a simplified network of humans and AI systems learning together about an uncertain world. We propose and examine the impact of several learning strategies on the quality of the equilibrium of a society's 'collective world model'. We consider strategies that can be undertaken by various stakeholders involved in a single human-AI interaction: human, AI model builder, and society or regulators around the interaction. We then consider possible negative feedback loops that may arise from humans learning socially from AI: that learning from the AI may impact our own ability to learn about the world. We close with open directions into studying networks of human and AI systems that can be explored in enriched versions of our simulation framework.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 48 of its 96 references that are in the map. First posted on arXiv 16 Jan 2025.

Builds on

48 of 96 references.

References · 48

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  3. 2017Deep reinforcement learning from human preferencescited by 3,912
  4. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
  5. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
  6. 2023Reasoning with Language Model is Planning with World Modelcited by 861
  7. 2017Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithmcited by 734
  8. 2022Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskcited by 431
  9. 2023Language Models Represent Space and Timecited by 316
  10. 2020Towards Continual Reinforcement Learning: A Review and Perspectivescited by 274
  11. 2020Consistent Estimators for Learning to Defer to an Expertcited by 271
  12. 2023Data-centric Artificial Intelligence: A Surveycited by 203
36 more
  1. 2023Gender bias and stereotypes in Large Language Modelscited by 187
  2. 2024The PRISM Alignment Dataset: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Modelscited by 144
  3. 2022The Debate Over Understanding in AI's Large Language Modelscited by 142
  4. 2023Harms from Increasingly Agentic Algorithmic Systemscited by 135
  5. 2022Language Models as Agent Modelscited by 132
  6. 2020Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertaintycited by 129
  7. 2024Simple and Scalable Strategies to Continually Pre-train Large Language Modelscited by 127
  8. 2021Expanding Explainability: Towards Social Transparency in AI systemscited by 124
  9. 2023From Word Models to World Models: Translating from Natural Language to the Probabilistic Language of Thoughtcited by 119
  10. 2024Evaluating the World Model Implicit in a Generative Modelcited by 113
  11. 2024The Ethics of Advanced AI Assistantscited by 107
  12. 2024When combinations of humans and AI are useful: A systematic review and meta-analysiscited by 106
  13. 2017Grounded Language Learning in a Simulated 3D Worldcited by 100
  14. 2021Algorithmic Monoculture and Social Welfarecited by 100
  15. 2024Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systemscited by 96
  16. 2024Building Machines that Learn and Think with Peoplecited by 73
  17. 2023Evaluating Language Models for Mathematics through Interactionscited by 70
  18. 2019Rapid trial-and-error learning with simulation supports flexible tool use and physical reasoningcited by 61
  19. 2023Machine Culturecited by 55
  20. 2024Elements of World Knowledge (EWoK): A Cognition-Inspired Framework for Evaluating Basic World Knowledge in Language Modelscited by 55
  21. 2024Large Language Models Assume People are More Rational than We Really arecited by 54
  22. 2023From task structures to world models: What do LLMs know?cited by 46
  23. 2022Eliciting and Learning with Soft Labels from Every Annotatorcited by 43
  24. 2023The Unequal Opportunities of Large Language Models: Revealing Demographic Bias through Job Recommendationscited by 41
  25. 2023Human Uncertainty in Concept-Based AI Systemscited by 39
  26. 2020Understanding Human Intelligence through Human Limitationscited by 33
  27. 2024A Decision Theoretic Framework for Measuring AI Reliancecited by 28
  28. 2024Do Large Language Models Perform the Way People Expect? Measuring the Human Generalization Functioncited by 24
  29. 2023Accuracy-Time Tradeoffs in AI-Assisted Decision Making under Time Pressurecited by 17
  30. 2023Learning Personalized Decision Support Policiescited by 14
  31. 2024Modulating Language Model Experiences through Frictionscited by 13
  32. 2022On the Informativeness of Supervision Signalscited by 12
  33. 2024Decoding AI's Nudge: A Unified Framework to Predict Human Behavior in AI-assisted Decision Makingcited by 9
  34. 2024When Should Algorithms Resign? A Proposal for AI Governancecited by 6
  35. 2024Representational Alignment Supports Effective Machine Teachingcited by 3
  36. 2022Explanations as Programs in Probabilistic Logic Programmingcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Emergent social transmission of model-based representations without inference
  2. 2026Increasing intelligence in AI agents can worsen collective outcomes
  3. 2024Multi-Agent, Human-Agent and Beyond: A Survey on Cooperation in Social Dilemmas
  4. 2023Understanding the World to Solve Social Dilemmas Using Multi-Agent Reinforcement Learning
  5. 2026Agentivism: a learning theory for the age of artificial intelligence
  6. 2025Language and Experience: A Computational Model of Social Learning in Complex Tasks
  7. 2026Collective cooperation without individual fidelity in LLM agents
  8. 2026Causal Effects with Unobserved Unit Types in Interacting Human-AI Systems