mlsanityData to 7 Oct 2026

Learning spatio-temporal patterns with Neural Cellular Automata

arXiv 2310.14809 ↗First posted 23 Oct 2023nlin.PS cs.LG cs.NEcited by 8

Not on the map. Why?

Abstract (arXiv)

Neural Cellular Automata (NCA) are a powerful combination of machine learning and mechanistic modelling. We train NCA to learn complex dynamics from time series of images and PDE trajectories. Our method is designed to identify underlying local rules that govern large scale dynamic emergent behaviours. Previous work on NCA focuses on learning rules that give stationary emergent structures. We extend NCA to capture both transient and stable structures within the same system, as well as learning rules that capture the dynamics of Turing pattern formation in nonlinear Partial Differential Equations (PDEs). We demonstrate that NCA can generalise very well beyond their PDE training data, we show how to constrain NCA to respect given symmetries, and we explore the effects of associated hyperparameters on model performance and stability. Being able to learn arbitrary dynamics gives NCA great potential as a data driven modelling framework, especially for modelling biological pattern formation.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 13 of its 56 references that are in the map. First posted on arXiv 23 Oct 2023.

Builds on

13 of 56 references.

References · 13

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
  4. 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,404
  5. 2020What is the State of Neural Network Pruning?cited by 578
  6. 2018Recurrent Residual Convolutional Neural Network based on U-Net (R2U-Net) for Medical Image Segmentationcited by 180
  7. 2022Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Modelscited by 172
  8. 2018Revisiting Small Batch Training for Deep Neural Networkscited by 100
  9. 2020Learning Low-rank Deep Neural Networks via Singular Vector Orthogonality Regularization and Singular Value Sparsificationcited by 52
  10. 2018Cellular automata as convolutional neural networkscited by 45
  11. 2022Growing Isotropic Neural Cellular Automatacited by 19
  12. 2019Extended Dynamic Mode Decomposition with Learned Koopman Eigenfunctions for Prediction and Controlcited by 14
1 more
  1. 2021μNCA: Texture Generation with Ultra-Compact Neural Cellular Automatacited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 4.

8 papers.