Mutation Without Variation: Convergence Dynamics in LLM-Driven Program Evolution
Not on the map. Why?
Abstract (arXiv)
When an LLM repeatedly mutates a program, does it explore new forms or circle back to the same ones? We study this question by analyzing LLM-driven mutation chains in the absence of selection pressure within a domain-specific language, varying prompt design, model family, and stochastic replication. We find that LLM-based mutation consistently converges toward restricted attractor regions in program space. Convergence is especially severe at the structural level: in 87% of chains, over 93% of mutations revisit a previously seen structural form, with most variation confined to terminal substitutions within recurring templates. Cycle analysis reveals short cycles and self-loops dominating the transition structure. The rate of convergence varies with prompt wording and model choice, but the phenomenon is robust across conditions. A classical GP subtree mutation operator does not exhibit comparable convergence, suggesting that the effect is intrinsic to the LLM mutation pipeline. These findings reveal a tension at the heart of LLM-driven program evolution: the same capabilities that enable semantics-aware program transformation also carry a systematic bias toward structural homogeneity that must be accounted for if such systems are to sustain open-ended exploration. Source code is available at https://github.com/can-gurkan/lmca.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 22 of its 55 references that are in the map. First posted on arXiv 3 Jun 2026.
Builds on
22 of 55 references.
References · 22
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
- 2023Can AI-Generated Text be Reliably Detected?cited by 372
- 2023The Curse of Recursion: Training on Generated Data Makes Models Forgetcited by 343
- 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 266
- 2025ShinkaEvolve: Towards Open-Ended And Sample-Efficient Program Evolutioncited by 146
- 2023Language Model Crossover: Variation through Few-Shot Promptingcited by 119
- 2024LLaMEA: A Large Language Model Evolutionary Algorithm for Automatically Generating Metaheuristicscited by 92
- 2024Evolutionary Computation in the Era of Large Language Model: Survey and Roadmapcited by 89
- 2024Large Language Models As Evolution Strategiescited by 57
- 2024Evolving Code with A Large Language Modelcited by 42
10 more
- 2024Discovering Preference Optimization Algorithms with and for Large Language Modelscited by 38
- 2023A Ship of Theseus: Curious Cases of Paraphrasing in LLM-Generated Textscited by 23
- 2025Unveiling Attractor Cycles in Large Language Models: A Dynamical Systems View of Successive Paraphrasingcited by 14
- 2024Cultural evolution in populations of Large Language Modelscited by 12
- 2025LLM as a Broken Telephone: Iterative Generation Distorts Informationcited by 12
- 2025Code Evolution Graphs: Understanding Large Language Model Driven Design of Algorithmscited by 10
- 2026Digital Red Queen: Adversarial Program Evolution in Core War with LLMscited by 7
- 2024An investigation on the use of Large Language Models for hyperparameter tuning in Evolutionary Algorithmscited by 6
- 2025The Telephone Game: Evaluating Semantic Drift in Unified Modelscited by 4
- 2026Code Evolution for Control: Synthesizing Policies via LLM-Driven Evolutionary Searchcited by 4
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026If It's Not Buggy, Don't Fix It: On the Dynamics of Iterative Bug-fixing with LLMscited by 0
- 2026Operator Packages, Proposer Strength, and Construction-Family Plateaus in Office-Scale Verified Searchcited by 0
- 2026Evolving Towards Better Codes: LLM-Guided Search for High-Distance Binary Linear Codescited by 0
- 2026Towards Better Exploration in Sequential Test-Time Scalingcited by 0
- 2026Towards Better Exploration in Sequential Test-Time Scaling30 Sep 2026
- 2026Evolving Towards Better Codes: LLM-Guided Search for High-Distance Binary Linear Codes29 Sep 2026
- 2026If It's Not Buggy, Don't Fix It: On the Dynamics of Iterative Bug-fixing with LLMs9 Sep 2026
- 2026Operator Packages, Proposer Strength, and Construction-Family Plateaus in Office-Scale Verified Search28 Aug 2026