mlsanityData to 14 Oct 2026

Remapping and navigation of an embedding space via error minimization: a fundamental organizational principle of cognition in natural and artificial systems

arXiv 2601.14096 ↗First posted 20 Jan 2026cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

The emerging field of diverse intelligence seeks an integrated view of problem-solving in agents of very different provenance, composition, and substrates. From subcellular chemical networks to swarms of organisms, and across evolved, engineered, and chimeric systems, it is hypothesized that scale-invariant principles of decision-making can be discovered. We propose that cognition in both natural and synthetic systems can be characterized and understood by the interplay between two equally important invariants: (1) the remapping of embedding spaces, and (2) the navigation within these spaces. Biological collectives, from single cells to entire organisms (and beyond), remap transcriptional, morphological, physiological, or 3D spaces to maintain homeostasis and regenerate structure, while navigating these spaces through distributed error correction. Modern Artificial Intelligence (AI) systems, including transformers, diffusion models, and neural cellular automata enact analogous processes by remapping data into latent embeddings and refining them iteratively through contextualization. We argue that this dual principle - remapping and navigation of embedding spaces via iterative error minimization - constitutes a substrate-independent invariant of cognition. Recognizing this shared mechanism not only illuminates deep parallels between living systems and artificial models, but also provides a unifying framework for engineering adaptive intelligence across scales.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 91 of its 264 references that are in the map. First posted on arXiv 20 Jan 2026.

Builds on

91 of 264 references.

References · 91

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2020Language Models are Few-Shot Learnerscited by 32,419
  5. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  6. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  7. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  8. 2020Denoising Diffusion Implicit Modelscited by 9,781
  9. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  10. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  11. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  12. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
38 more
  1. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  2. 2022Classifier-Free Diffusion Guidancecited by 5,847
  3. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  4. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  5. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  6. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  7. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  8. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  9. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  10. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  11. 2018Deep contextualized word representationscited by 2,290
  12. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  13. 2016Enriching Word Vectors with Subword Informationcited by 1,583
  14. 2021Improving language models by retrieving from trillions of tokenscited by 1,293
  15. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
  16. 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,057
  17. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
  18. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,013
  19. 2020On Layer Normalization in the Transformer Architecturecited by 922
  20. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  21. 2023RWKV: Reinventing RNNs for the Transformer Eracited by 827
  22. 2020A Primer in BERTology: What we know about how BERT workscited by 815
  23. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
  24. 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
  25. 2022Transformers learn in-context by gradient descentcited by 732
  26. 2018Universal Transformerscited by 647
  27. 2020Hopfield Networks is All You Needcited by 475
  28. 2022Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskcited by 431
  29. 2025Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approachcited by 415
  30. 2023Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyondcited by 411
  31. 2023Augmented Language Models: a Surveycited by 403
  32. 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 320
  33. 2023Emergent Linear Representations in World Models of Self-Supervised Sequence Modelscited by 319
  34. 2023Language Models Represent Space and Timecited by 316
  35. 2025The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexitycited by 302
  36. 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 300
  37. 2024Continual Learning of Large Language Models: A Comprehensive Surveycited by 234
  38. 2025Learning to Reason without External Rewardscited by 210

50 most cited of 91 All 91 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Information Structure in Mappings: An Approach to Learning, Representation, and Generalisation
  2. 2026The Umwelt Representation Hypothesis: Rethinking Universality
  3. 2021A brain basis of dynamical intelligence for AI and computational neuroscience
  4. 2026A Brain-like Synergistic Core in LLMs Drives Behaviour and Learning
  5. 2026Cultivating Machine Intelligence: The OMEGA Shift from Top-Down Optimization to Autopoietic Cognitive Ecologies
  6. 2024Possible Principles for Aligned Structure Learning Agents
  7. 2026Toward Controlling Biology with Language:Offline Learning of Prompt-Conditioned Interventions for Cells, Organoids, and Biobots
  8. 2024Growing Artificial Neural Networks for Control: the Role of Neuronal Diversity