Learning spatio-temporal patterns with Neural Cellular Automata
Not on the map. Why?
Abstract (arXiv)
Neural Cellular Automata (NCA) are a powerful combination of machine learning and mechanistic modelling. We train NCA to learn complex dynamics from time series of images and PDE trajectories. Our method is designed to identify underlying local rules that govern large scale dynamic emergent behaviours. Previous work on NCA focuses on learning rules that give stationary emergent structures. We extend NCA to capture both transient and stable structures within the same system, as well as learning rules that capture the dynamics of Turing pattern formation in nonlinear Partial Differential Equations (PDEs). We demonstrate that NCA can generalise very well beyond their PDE training data, we show how to constrain NCA to respect given symmetries, and we explore the effects of associated hyperparameters on model performance and stability. Being able to learn arbitrary dynamics gives NCA great potential as a data driven modelling framework, especially for modelling biological pattern formation.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 13 of its 56 references that are in the map. First posted on arXiv 23 Oct 2023.
Builds on
13 of 56 references.
References · 13
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
- 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,404
- 2020What is the State of Neural Network Pruning?cited by 578
- 2018Recurrent Residual Convolutional Neural Network based on U-Net (R2U-Net) for Medical Image Segmentationcited by 180
- 2022Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Modelscited by 172
- 2018Revisiting Small Batch Training for Deep Neural Networkscited by 100
- 2020Learning Low-rank Deep Neural Networks via Singular Vector Orthogonality Regularization and Singular Value Sparsificationcited by 52
- 2018Cellular automata as convolutional neural networkscited by 45
- 2022Growing Isotropic Neural Cellular Automatacited by 19
- 2019Extended Dynamic Mode Decomposition with Learned Koopman Eigenfunctions for Prediction and Controlcited by 14
1 more
Built on by
Citing papers per year: 2024: 1; 2025: 3; 2026: 4.
8 papers.
- 2025Beyond Memorization: Extending Reasoning Depth with Recurrence, Memory and Test-Time Compute Scalingcited by 4
- 2024Learning Elementary Cellular Automata with Transformerscited by 3
- 2025AutomataGPT: Forecasting and Ruleset Inference for Two-Dimensional Cellular Automatacited by 2
- 2026A New Kind of Network? Review and Reference Implementation of Neural Cellular Automatacited by 2
- 2025Mixtures of Neural Cellular Automata: A Stochastic Framework for Growth Modelling and Self-Organizationcited by 0
- 2026AugRelNet: Relation-Augmented Dynamics for Structure Discovery and Forecasting from Limited Datacited by 0
- 2026Learning PDE Time-Stepping with Neural Cellular Automatacited by 0
- 2026Applications of Neural Cellular Automata: State of the Art, Challenges and Opportunitiescited by 0
- 2026Applications of Neural Cellular Automata: State of the Art, Challenges and Opportunities21 Sep 2026
- 2026Learning PDE Time-Stepping with Neural Cellular Automata31 Aug 2026
- 2026AugRelNet: Relation-Augmented Dynamics for Structure Discovery and Forecasting from Limited Data8 Jun 2026
- 2026A New Kind of Network? Review and Reference Implementation of Neural Cellular Automata27 Apr 2026
- 2025Beyond Memorization: Extending Reasoning Depth with Recurrence, Memory and Test-Time Compute Scaling22 Aug 2025
- 2025Mixtures of Neural Cellular Automata: A Stochastic Framework for Growth Modelling and Self-Organization25 Jun 2025
- 2025AutomataGPT: Forecasting and Ruleset Inference for Two-Dimensional Cellular Automata19 Jun 2025
- 2024Learning Elementary Cellular Automata with Transformers2 Dec 2024