Remapping and navigation of an embedding space via error minimization: a fundamental organizational principle of cognition in natural and artificial systems
Not on the map. Why?
Abstract (arXiv)
The emerging field of diverse intelligence seeks an integrated view of problem-solving in agents of very different provenance, composition, and substrates. From subcellular chemical networks to swarms of organisms, and across evolved, engineered, and chimeric systems, it is hypothesized that scale-invariant principles of decision-making can be discovered. We propose that cognition in both natural and synthetic systems can be characterized and understood by the interplay between two equally important invariants: (1) the remapping of embedding spaces, and (2) the navigation within these spaces. Biological collectives, from single cells to entire organisms (and beyond), remap transcriptional, morphological, physiological, or 3D spaces to maintain homeostasis and regenerate structure, while navigating these spaces through distributed error correction. Modern Artificial Intelligence (AI) systems, including transformers, diffusion models, and neural cellular automata enact analogous processes by remapping data into latent embeddings and refining them iteratively through contextualization. We argue that this dual principle - remapping and navigation of embedding spaces via iterative error minimization - constitutes a substrate-independent invariant of cognition. Recognizing this shared mechanism not only illuminates deep parallels between living systems and artificial models, but also provides a unifying framework for engineering adaptive intelligence across scales.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 91 of its 264 references that are in the map. First posted on arXiv 20 Jan 2026.
Builds on
91 of 264 references.
References · 91
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
38 more
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2018Deep contextualized word representationscited by 2,290
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2016Enriching Word Vectors with Subword Informationcited by 1,583
- 2021Improving language models by retrieving from trillions of tokenscited by 1,293
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
- 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,057
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
- 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,013
- 2020On Layer Normalization in the Transformer Architecturecited by 922
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2023RWKV: Reinventing RNNs for the Transformer Eracited by 827
- 2020A Primer in BERTology: What we know about how BERT workscited by 815
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
- 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
- 2022Transformers learn in-context by gradient descentcited by 732
- 2018Universal Transformerscited by 647
- 2020Hopfield Networks is All You Needcited by 475
- 2022Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskcited by 431
- 2025Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approachcited by 415
- 2023Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyondcited by 411
- 2023Augmented Language Models: a Surveycited by 403
- 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 320
- 2023Emergent Linear Representations in World Models of Self-Supervised Sequence Modelscited by 319
- 2023Language Models Represent Space and Timecited by 316
- 2025The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexitycited by 302
- 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 300
- 2024Continual Learning of Large Language Models: A Comprehensive Surveycited by 234
- 2025Learning to Reason without External Rewardscited by 210
50 most cited of 91 All 91 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Information Structure in Mappings: An Approach to Learning, Representation, and Generalisation
- 2026The Umwelt Representation Hypothesis: Rethinking Universality
- 2021A brain basis of dynamical intelligence for AI and computational neuroscience
- 2026A Brain-like Synergistic Core in LLMs Drives Behaviour and Learning
- 2026Cultivating Machine Intelligence: The OMEGA Shift from Top-Down Optimization to Autopoietic Cognitive Ecologies
- 2024Possible Principles for Aligned Structure Learning Agents
- 2026Toward Controlling Biology with Language:Offline Learning of Prompt-Conditioned Interventions for Cells, Organoids, and Biobots
- 2024Growing Artificial Neural Networks for Control: the Role of Neuronal Diversity