# Neural Cellular Automata: From Cells to Pixels

arXiv: https://arxiv.org/abs/2506.22899 · HTML: https://mlsanity.com/paper/2506.22899/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- Builds on 24 of its 41 references that are in the map.
- First posted on arXiv 28 Jun 2025.

## Builds on (most cited first, 24 of 24)

- [Very Deep Convolutional Networks for Large-Scale Image Recognition](https://mlsanity.com/paper/1409.1556/) (2014)
- [The Unreasonable Effectiveness of Deep Features as a Perceptual Metric](https://mlsanity.com/paper/1801.03924/) (2018)
- [Instant Neural Graphics Primitives with a Multiresolution Hash Encoding](https://mlsanity.com/paper/2201.05989/) (2022)
- [DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation](https://mlsanity.com/paper/1901.05103/) (2019)
- [Implicit Neural Representations with Periodic Activation Functions](https://mlsanity.com/paper/2006.09661/) (2020)
- [ARC-AGI-2: A New Challenge for Frontier AI Reasoning Systems](https://mlsanity.com/paper/2505.11831/) (2025)
- [Style Transfer by Relaxed Optimal Transport and Self-Similarity](https://mlsanity.com/paper/1904.12785/) (2019)
- [Cellular automata as convolutional neural networks](https://mlsanity.com/paper/1809.02942/) (2018)
- [Growing 3D Artefacts and Functional Machines with Neural Cellular Automata](https://mlsanity.com/paper/2103.08737/) (2021)
- [Variational Neural Cellular Automata](https://mlsanity.com/paper/2201.12360/) (2022)
- [Attention-based Neural Cellular Automata](https://mlsanity.com/paper/2211.01233/) (2022)
- [Med-NCA: Robust and Lightweight Segmentation with Neural Cellular Automata](https://mlsanity.com/paper/2302.03473/) (2023)
- [DyNCA: Real-time Dynamic Texture Synthesis Using Neural Cellular Automata](https://mlsanity.com/paper/2211.11417/) (2022)
- [Image segmentation via Cellular Automata](https://mlsanity.com/paper/2008.04965/) (2020)
- [Generative Adversarial Neural Cellular Automata](https://mlsanity.com/paper/2108.04328/) (2021)
- [Mesh Neural Cellular Automata](https://mlsanity.com/paper/2311.02820/) (2023)
- [ARC-NCA: Towards Developmental Solutions to the Abstraction and Reasoning Corpus](https://mlsanity.com/paper/2505.08778/) (2025)
- [Goal-Guided Neural Cellular Automata: Learning to Control Self-Organising Systems](https://mlsanity.com/paper/2205.06806/) (2022)
- [Frequency-Time Diffusion with Neural Cellular Automata](https://mlsanity.com/paper/2401.06291/) (2024)
- [NoiseNCA: Noisy Seed Improves Spatio-Temporal Continuity of Neural Cellular Automata](https://mlsanity.com/paper/2404.06279/) (2024)
- [High resolution neural texture synthesis with long range constraints](https://mlsanity.com/paper/2008.01808/) (2020)
- [AdaNCA: Neural Cellular Automata As Adaptors For More Robust Vision Transformer](https://mlsanity.com/paper/2406.08298/) (2024)
- [Emergent Dynamics in Neural Cellular Automata](https://mlsanity.com/paper/2404.06406/) (2024)
- [Volumetric Temporal Texture Synthesis for Smoke Stylization using Neural Cellular Automata](https://mlsanity.com/paper/2502.09631/) (2025)

## Built on by (most cited first, 5 of 5)

- [Neural cellular automata: applications to biology and beyond classical AI](https://mlsanity.com/paper/2509.11131/) (2025)
- [Neural Particle Automata: Learning Self-Organizing Particle Dynamics](https://mlsanity.com/paper/2601.16096/) (2026)
- [Neural Field Turing Machine: A Differentiable Spatial Computer](https://mlsanity.com/paper/2509.03370/) (2025)
- [One-Shot Generative Design for Disordered Metamaterials via Self-Organizing Neural Cellular Automata](https://mlsanity.com/paper/2607.14475/) (2026)
- [Applications of Neural Cellular Automata: State of the Art, Challenges and Opportunities](https://mlsanity.com/paper/2609.24595/) (2026)

## Abstract (arXiv)

Neural Cellular Automata (NCAs) are bio-inspired dynamical systems in which identical cells iteratively apply a learned local update rule to self-organize into complex patterns, exhibiting regeneration, robustness, and spontaneous dynamics. Despite their success in texture synthesis and morphogenesis, NCAs remain largely confined to low-resolution outputs. This limitation stems from (1) training time and memory requirements that grow quadratically with grid size, (2) the strictly local propagation of information that impedes long-range cell communication, and (3) the heavy compute demands of real-time inference at high resolution. In this work, we overcome this limitation by pairing an NCA that evolves on a coarse grid with a lightweight implicit decoder that maps cell states and local coordinates to appearance attributes, enabling the same model to render outputs at arbitrary resolution. Moreover, because both the decoder and NCA updates are local, inference remains highly parallelizable. To supervise high-resolution outputs efficiently, we introduce task-specific losses for morphogenesis (growth from a seed) and texture synthesis with minimal additional memory and computation overhead. Our experiments across 2D/3D grids and mesh domains demonstrate that our hybrid models produce high-resolution outputs in real-time, and preserve the characteristic self-organizing behavior of NCAs.
