The Ratchet Effect in Silico: How Interaction Drives Cumulative Intelligence in Large Language Models
Not on the map. Why?
Abstract (arXiv)
Human intelligence scales through cumulative cultural evolution (CCE), a ratchet process in which innovations are retained against entropic drift. Large language model training, by contrast, still depends primarily on static corpora and parameter growth, leaving little room for endogenous accumulation through interaction. We present POLIS (Population Orchestrated Learning and Inference Society), a framework in which heterogeneous agents generate solutions, verify one another's outputs, retain validated artifacts in shared cultural memory, and internalize them through parameter updates. On mathematical reasoning benchmarks, populations of 1--4B-parameter models achieved average gains of 8.8--18.9 points over base models and narrowed the gap to 70B+ monoliths. Mechanistic ablations identify peer verification as the main ratchet operator and show that internalization sustains accumulation across rounds, providing computational evidence that epistemic vigilance organizes durable knowledge growth. These results position structured social interaction as a scaling lever orthogonal to parameter count.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 62 references that are in the map. First posted on arXiv 25 Jul 2025.
Builds on
23 of 62 references.
References · 23
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2025Qwen3 Technical Reportcited by 8,820
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2024GPT-4o System Cardcited by 4,588
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2022Emergent Abilities of Large Language Modelscited by 2,512
- 2024Qwen2 Technical Reportcited by 2,120
11 more
- 2025Gemma 3 Technical Reportcited by 1,824
- 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
- 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 521
- 2024Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothingcited by 346
- 2023From Quantity to Quality: Boosting LLM Performance with Self-Guided Data Selection for Instruction Tuningcited by 307
- 2024DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solvingcited by 95
- 2025Multiagent Finetuning: Self Improvement with Diverse Reasoning Chainscited by 95
- 2024Building Machines that Learn and Think with Peoplecited by 73
- 2025MiniCPM4: Ultra-Efficient LLMs on End Devicescited by 52
- 2023MuggleMath: Assessing the Impact of Query and Response Augmentation on Math Reasoningcited by 45
- 2025A Strategic Coordination Framework of Small LLMs Matches Large LLMs in Data Synthesiscited by 9
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Bias Amplification in Language Model Evolution: An Iterated Learning Perspective
- 2026Human-AI Co-Evolution and Epistemic Collapse: A Dynamical Systems Perspective
- 2026Dynamics of Human-AI Collective Knowledge on the Web: A Scalable Model and Insights for Sustainable Growth
- 2025LLMs Can't Handle Peer Pressure: Crumbling under Multi-Agent Social Interactions
- 2025Language and Experience: A Computational Model of Social Learning in Complex Tasks
- 2025SocialMaze: A Benchmark for Evaluating and Enhancing Social Reasoning in Large Language Models in Complex Social Environments
- 2026Do Agent Societies Develop Intellectual Elites? The Hidden Power Laws of Collective Cognition in LLM Multi-Agent Systems
- 2026Reasoning aligns language models to human cognition