mlsanityData to 14 Oct 2026

nDNA -- the Semantic Helix of Artificial Cognition

arXiv 2509.18216 ↗First posted 21 Sep 2025cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

As AI foundation models grow in capability, a deeper question emerges: What shapes their internal cognitive identity -- beyond fluency and output? Benchmarks measure behavior, but the soul of a model resides in its latent geometry. In this work, we propose Neural DNA (nDNA) as a semantic-genotypic representation that captures this latent identity through the intrinsic geometry of belief. At its core, nDNA is synthesized from three principled and indispensable dimensions of latent geometry: spectral curvature, which reveals the curvature of conceptual flow across layers; thermodynamic length, which quantifies the semantic effort required to traverse representational transitions through layers; and belief vector field, which delineates the semantic torsion fields that guide a model's belief directional orientations. Like biological DNA, it encodes ancestry, mutation, and semantic inheritance, found in finetuning and alignment scars, cultural imprints, and architectural drift. In naming it, we open a new field: Neural Genomics, where models are not just tools, but digital semantic organisms with traceable inner cognition. Modeling statement. We read AI foundation models as semantic fluid dynamics: meaning is transported through layers like fluid in a shaped conduit; nDNA is the physics-grade readout of that flow -- a geometry-first measure of how meaning is bent, paid for, and pushed -- yielding a stable, coordinate-free neural DNA fingerprint tied to on-input behavior; with this fingerprint we cross into biology: tracing lineages across pretraining, fine-tuning, alignment, pruning, distillation, and merges; measuring inheritance between checkpoints; detecting drift as traits shift under new data or objectives; and, ultimately, studying the evolution of artificial cognition to compare models, diagnose risks, and govern change over time.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 68 of its 169 references that are in the map. First posted on arXiv 21 Sep 2025.

Builds on

68 of 169 references.

References · 68

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2022Training language models to follow instructions with human feedbackcited by 15,971
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  6. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  7. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  8. 2020Scaling Laws for Neural Language Modelscited by 6,586
  9. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  10. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
  11. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  12. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
38 more
  1. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  2. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  3. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  4. 2020Longformer: The Long-Document Transformercited by 3,413
  5. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  6. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  7. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  8. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
  9. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
  10. 2022Emergent Abilities of Large Language Modelscited by 2,512
  11. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  12. 2018Deep contextualized word representationscited by 2,290
  13. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,262
  14. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  15. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
  16. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
  17. 2014FitNets: Hints for Thin Deep Netscited by 1,653
  18. 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
  19. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
  20. 2018Sanity Checks for Saliency Mapscited by 1,156
  21. 2017Visualizing the Loss Landscape of Neural Netscited by 1,130
  22. 2022Editing Models with Task Arithmeticcited by 1,120
  23. 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
  24. 2016Geometric deep learning: going beyond Euclidean datacited by 1,048
  25. 2019What Does BERT Look At? An Analysis of BERT's Attentioncited by 1,003
  26. 2019Attention is not Explanationcited by 929
  27. 2018Reconciling modern machine learning practice and the bias-variance trade-offcited by 927
  28. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 924
  29. 2019Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Prunedcited by 856
  30. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 828
  31. 2019Are Sixteen Heads Really Better than One?cited by 816
  32. 2020AdapterFusion: Non-Destructive Task Composition for Transfer Learningcited by 788
  33. 2020Quantifying Attention Flow in Transformerscited by 775
  34. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 774
  35. 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
  36. 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 766
  37. 2019How multilingual is Multilingual BERT?cited by 645
  38. 2019Attention is not not Explanationcited by 636

50 most cited of 68 All 68 (JSON)

Built on by

Not cited yet.