mlsanityData to 14 Oct 2026

The evolution of sex for artificial intelligence: a population-genetic framework for multigenerational model populations

arXiv 2609.18560 ↗First posted 16 Sep 2026cs.LG cs.NE q-bio.PEcited by 0

Not on the map. Why?

Abstract (arXiv)

Some aspects of AI development resemble a population process in which models are specialised, retrained on the output of peers, or combined by averaging weights. These practices lead to generations of models, in the biological sense studied by population genetics. Here, I develop this parallelism and interpret multigenerational model populations in terms of sexual and asexual reproduction, formally recombining the two fields. I test these analogies in an exact inheritance model, in trained networks (recurrent, feedforward and variational autoencoder generators) and in large language models, and show that they hold generally, with some measurable architecture-specific biases. Training recursively on model output is known to lead to model collapse, a process previously described as akin to genetic drift; I develop all that follows. A minimal model of a learner retrained on its parent's output reproduces the Wright-Fisher process exactly; verified real data added to each generation play the role of immigration, with the surprising finding that the absolute number of real data samples matters, not their share, exactly as in population genetics. Training a child on the average of its parents' outputs cancels the benefit of having several parents, matching blending inheritance (and reviving Jenkin's objection to Darwin), whereas combining parents so that each keeps its strongest contribution preserves it; merged language-model specialists exceeded every parent across seeds (the Fisher-Muller effect); and lineages become reproductively isolated, losing the ability to merge at all, when they have learned conflicting conventions and not when they have merely drifted apart. As AI societies become societies in time as well as in space, a mathematical framework for their inheritance acquires predictive power. Remarkably, that framework can be adapted almost wholesale from biology.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 78 of its 110 references that are in the map. First posted on arXiv 16 Sep 2026.

Builds on

78 of 110 references.

References · 78

  1. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  2. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  3. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
  4. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  5. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  6. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
  7. 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,183
  8. 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
  9. 2016Progressive Neural Networkscited by 1,361
  10. 2017Continual Learning with Deep Generative Replaycited by 1,158
  11. 2023TIES-Merging: Resolving Interference When Merging Modelscited by 818
  12. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 769
38 more
  1. 2024Phi-4 Technical Reportcited by 711
  2. 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 694
  3. 2018An Empirical Study of Example Forgetting during Deep Neural Network Learningcited by 678
  4. 2018Progress & Compress: A scalable framework for continual learningcited by 520
  5. 2022Git Re-Basin: Merging Models modulo Permutation Symmetriescited by 471
  6. 2022Large Language Models Struggle to Learn Long-Tail Knowledgecited by 458
  7. 2024LoRA Learns Less and Forgets Lesscited by 328
  8. 2024Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunitiescited by 254
  9. 2023Self-Consuming Generative Models Go MADcited by 250
  10. 2024Evolutionary Optimization of Model Merging Recipescited by 208
  11. 2024Arcee's MergeKit: A Toolkit for Merging Large Language Modelscited by 194
  12. 2023Does Writing with Language Models Reduce Content Diversity?cited by 192
  13. 2022Branch-Train-Merge: Embarrassingly Parallel Training of Expert Language Modelscited by 191
  14. 2023ZipIt! Merging Models from Different Tasks without Trainingcited by 179
  15. 2023Generative artificial intelligence enhances creativity but reduces the diversity of novel contentcited by 167
  16. 2024Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviewscited by 164
  17. 2019Ensemble Distribution Distillationcited by 158
  18. 2022Fine-tuned Language Models are Continual Learnerscited by 156
  19. 2024Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Datacited by 151
  20. 2023Understanding Catastrophic Forgetting in Language Models via Implicit Inferencecited by 144
  21. 2024Nemotron-4 340B Technical Reportcited by 144
  22. 2024A Tale of Tails: Model Collapse as a Change of Scaling Lawscited by 130
  23. 2024Simple and Scalable Strategies to Continually Pre-train Large Language Modelscited by 127
  24. 2022REPAIR: REnormalizing Permuted Activations for Interpolation Repaircited by 120
  25. 2023On the Stability of Iterative Retraining of Generative Models on their own Datacited by 100
  26. 2023The Curious Decline of Linguistic Diversity: Training Language Models on Synthetic Textcited by 100
  27. 2025Multiagent Finetuning: Self Improvement with Diverse Reasoning Chainscited by 95
  28. 2025Poisoning Attacks on LLMs Require a Near-constant Number of Poison Samplescited by 72
  29. 2024MagMax: Leveraging Model Merging for Seamless Continual Learningcited by 67
  30. 2024Strong Model Collapsecited by 65
  31. 2023Machine Culturecited by 55
  32. 2024Collapse or Thrive? Perils and Promises of Synthetic Data in a Self-Generating Worldcited by 52
  33. 2024Beyond Model Collapse: Scaling Up with Synthesized Data Requires Verificationcited by 45
  34. 2022Long-Tailed Class Incremental Learningcited by 36
  35. 2024Mitigating Catastrophic Forgetting in Language Transfer via Model Mergingcited by 36
  36. 2024A Shocking Amount of the Web is Machine Translated: Insights from Multi-Way Parallelismcited by 35
  37. 2025WikiBigEdit: Understanding the Limits of Lifelong Knowledge Editing in LLMscited by 26
  38. 2024Rate of Model Collapse in Recursive Trainingcited by 25

50 most cited of 78 All 78 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Uneven Evolution of Cognition Across Generations of Generative AI Models
  2. 2024Artificial Generational Intelligence: Cultural Accumulation in Reinforcement Learning
  3. 2026Human-AI Co-Evolution and Epistemic Collapse: A Dynamical Systems Perspective
  4. 2026Gender Dynamics and Homophily in a Social Network of LLM Agents
  5. 2025The Philosophical Foundations of Growing AI Like A Child
  6. 2026Imaginative Generative AI: Crossing the Entropy Wall into Worlds Beyond Imitation
  7. 2025If generative AI is the answer, what is the question?
  8. 2025A Review of Developmental Interpretability in Large Language Models