mlsanityData to 7 Oct 2026

Mutation Without Variation: Convergence Dynamics in LLM-Driven Program Evolution

arXiv 2606.05408 ↗First posted 3 Jun 2026cs.AI cs.NEcited by 4

Not on the map. Why?

Abstract (arXiv)

When an LLM repeatedly mutates a program, does it explore new forms or circle back to the same ones? We study this question by analyzing LLM-driven mutation chains in the absence of selection pressure within a domain-specific language, varying prompt design, model family, and stochastic replication. We find that LLM-based mutation consistently converges toward restricted attractor regions in program space. Convergence is especially severe at the structural level: in 87% of chains, over 93% of mutations revisit a previously seen structural form, with most variation confined to terminal substitutions within recurring templates. Cycle analysis reveals short cycles and self-loops dominating the transition structure. The rate of convergence varies with prompt wording and model choice, but the phenomenon is robust across conditions. A classical GP subtree mutation operator does not exhibit comparable convergence, suggesting that the effect is intrinsic to the LLM mutation pipeline. These findings reveal a tension at the heart of LLM-driven program evolution: the same capabilities that enable semantics-aware program transformation also carry a systematic bias toward structural homogeneity that must be accounted for if such systems are to sustain open-ended exploration. Source code is available at https://github.com/can-gurkan/lmca.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 22 of its 55 references that are in the map. First posted on arXiv 3 Jun 2026.

Builds on

22 of 55 references.

References · 22

  1. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  2. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
  3. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
  4. 2023Can AI-Generated Text be Reliably Detected?cited by 372
  5. 2023The Curse of Recursion: Training on Generated Data Makes Models Forgetcited by 343
  6. 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 266
  7. 2025ShinkaEvolve: Towards Open-Ended And Sample-Efficient Program Evolutioncited by 146
  8. 2023Language Model Crossover: Variation through Few-Shot Promptingcited by 119
  9. 2024LLaMEA: A Large Language Model Evolutionary Algorithm for Automatically Generating Metaheuristicscited by 92
  10. 2024Evolutionary Computation in the Era of Large Language Model: Survey and Roadmapcited by 89
  11. 2024Large Language Models As Evolution Strategiescited by 57
  12. 2024Evolving Code with A Large Language Modelcited by 42
10 more
  1. 2024Discovering Preference Optimization Algorithms with and for Large Language Modelscited by 38
  2. 2023A Ship of Theseus: Curious Cases of Paraphrasing in LLM-Generated Textscited by 23
  3. 2025Unveiling Attractor Cycles in Large Language Models: A Dynamical Systems View of Successive Paraphrasingcited by 14
  4. 2024Cultural evolution in populations of Large Language Modelscited by 12
  5. 2025LLM as a Broken Telephone: Iterative Generation Distorts Informationcited by 12
  6. 2025Code Evolution Graphs: Understanding Large Language Model Driven Design of Algorithmscited by 10
  7. 2026Digital Red Queen: Adversarial Program Evolution in Core War with LLMscited by 7
  8. 2024An investigation on the use of Large Language Models for hyperparameter tuning in Evolutionary Algorithmscited by 6
  9. 2025The Telephone Game: Evaluating Semantic Drift in Unified Modelscited by 4
  10. 2026Code Evolution for Control: Synthesizing Policies via LLM-Driven Evolutionary Searchcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.