mlsanityData to 7 Oct 2026

Discovering Sensorimotor Agency in Cellular Automata using Diversity Search

arXiv 2402.10236 ↗First posted 14 Feb 2024cs.MA cs.AI cs.LGcited by 9

Not on the map. Why?

Abstract (arXiv)

The research field of Artificial Life studies how life-like phenomena such as autopoiesis, agency, or self-regulation can self-organize in computer simulations. In cellular automata (CA), a key open-question has been whether it it is possible to find environment rules that self-organize robust "individuals" from an initial state with no prior existence of things like "bodies", "brain", "perception" or "action". In this paper, we leverage recent advances in machine learning, combining algorithms for diversity search, curriculum learning and gradient descent, to automate the search of such "individuals", i.e. localized structures that move around with the ability to react in a coherent manner to external obstacles and maintain their integrity, hence primitive forms of sensorimotor agency. We show that this approach enables to find systematically environmental conditions in CA leading to self-organization of such basic forms of agency. Through multiple experiments, we show that the discovered agents have surprisingly robust capabilities to move, maintain their body integrity and navigate among various obstacles. They also show strong generalization abilities, with robustness to changes of scale, random updates or perturbations from the environment not seen during training. We discuss how this approach opens new perspectives in AI and synthetic bioengineering.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 23 of its 75 references that are in the map. First posted on arXiv 14 Feb 2024.

Builds on

23 of 75 references.

References · 23

  1. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  2. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
  3. 2019Solving Rubik's Cube with a Robot Handcited by 699
  4. 2019Emergent Tool Use From Multi-Agent Autocurriculacited by 308
  5. 2019Paired Open-Ended Trailblazer (POET): Endlessly Generating Increasingly Complex and Diverse Learning Environments and Their Solutionscited by 182
  6. 2021Open-Ended Learning Leads to Generally Capable Agentscited by 177
  7. 2020Automatic Curriculum Learning For Deep RL: A Short Surveycited by 141
  8. 2017Emergent Complexity via Multi-Agent Competitioncited by 117
  9. 2017Intrinsically Motivated Goal Exploration Processes with Automatic Curriculum Learningcited by 79
  10. 2018CURIOUS: Intrinsically Motivated Modular Multi-Goal Reinforcement Learningcited by 78
  11. 2020Language as a Cognitive Tool to Imagine Goals in Curiosity-Driven Explorationcited by 68
  12. 2013Active Learning of Inverse Models with Intrinsically Motivated Goal Exploration in Robotscited by 56
11 more
  1. 2018FIRST: A Framework for Optimizing Information Quality in Mobile Crowdsensing Systemscited by 50
  2. 2018Cellular automata as convolutional neural networkscited by 45
  3. 2021Technological Approach to Mind Everywhere (TAME): an experimentally-grounded framework for understanding diverse bodies and mindscited by 25
  4. 2020Lenia and Expanded Universecited by 23
  5. 2021Towards self-organized control: Using neural cellular automata to robustly control a cart-pole agentcited by 15
  6. 2019Intrinsically Motivated Discovery of Diverse Patterns in Self-Organizing Systemscited by 13
  7. 2020Hierarchically Organized Latent Modules for Exploratory Search in Morphogenetic Systemscited by 13
  8. 2022Flow-Lenia: Towards open-ended evolution in cellular automata through mass conservation and parameter localizationcited by 11
  9. 2023Towards Large-Scale Simulations of Open-Ended Evolution in Continuous Cellular Automatacited by 10
  10. 2022Interpreting systems as solving POMDPs: a step towards a formal understanding of agencycited by 7
  11. 2016Towards information based spatiotemporal patterns as a foundation for agent representation in dynamical systemscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 6; 2026: 1.

9 papers.