nDNA -- the Semantic Helix of Artificial Cognition
Not on the map. Why?
Abstract (arXiv)
As AI foundation models grow in capability, a deeper question emerges: What shapes their internal cognitive identity -- beyond fluency and output? Benchmarks measure behavior, but the soul of a model resides in its latent geometry. In this work, we propose Neural DNA (nDNA) as a semantic-genotypic representation that captures this latent identity through the intrinsic geometry of belief. At its core, nDNA is synthesized from three principled and indispensable dimensions of latent geometry: spectral curvature, which reveals the curvature of conceptual flow across layers; thermodynamic length, which quantifies the semantic effort required to traverse representational transitions through layers; and belief vector field, which delineates the semantic torsion fields that guide a model's belief directional orientations. Like biological DNA, it encodes ancestry, mutation, and semantic inheritance, found in finetuning and alignment scars, cultural imprints, and architectural drift. In naming it, we open a new field: Neural Genomics, where models are not just tools, but digital semantic organisms with traceable inner cognition. Modeling statement. We read AI foundation models as semantic fluid dynamics: meaning is transported through layers like fluid in a shaped conduit; nDNA is the physics-grade readout of that flow -- a geometry-first measure of how meaning is bent, paid for, and pushed -- yielding a stable, coordinate-free neural DNA fingerprint tied to on-input behavior; with this fingerprint we cross into biology: tracing lineages across pretraining, fine-tuning, alignment, pruning, distillation, and merges; measuring inheritance between checkpoints; detecting drift as traits shift under new data or objectives; and, ultimately, studying the evolution of artificial cognition to compare models, diagnose risks, and govern change over time.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 68 of its 169 references that are in the map. First posted on arXiv 21 Sep 2025.
Builds on
68 of 169 references.
References · 68
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
38 more
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2022Emergent Abilities of Large Language Modelscited by 2,512
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2018Deep contextualized word representationscited by 2,290
- 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,262
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
- 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
- 2014FitNets: Hints for Thin Deep Netscited by 1,653
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
- 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
- 2018Sanity Checks for Saliency Mapscited by 1,156
- 2017Visualizing the Loss Landscape of Neural Netscited by 1,130
- 2022Editing Models with Task Arithmeticcited by 1,120
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
- 2016Geometric deep learning: going beyond Euclidean datacited by 1,048
- 2019What Does BERT Look At? An Analysis of BERT's Attentioncited by 1,003
- 2019Attention is not Explanationcited by 929
- 2018Reconciling modern machine learning practice and the bias-variance trade-offcited by 927
- 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 924
- 2019Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Prunedcited by 856
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 828
- 2019Are Sixteen Heads Really Better than One?cited by 816
- 2020AdapterFusion: Non-Destructive Task Composition for Transfer Learningcited by 788
- 2020Quantifying Attention Flow in Transformerscited by 775
- 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 774
- 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
- 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 766
- 2019How multilingual is Multilingual BERT?cited by 645
- 2019Attention is not not Explanationcited by 636
50 most cited of 68 All 68 (JSON)
Built on by
Not cited yet.