We Should Chart an Atlas of All the World's Models
Not on the map. Why?
Abstract (arXiv)
Public model repositories now contain millions of models, yet most models remain undocumented and effectively lost. In this position paper, we advocate for charting the world's model population in a unified structure we call the Model Atlas: a graph that captures models, their attributes, and the weight transformations that connect them. The Model Atlas enables applications in model forensics, meta-ML research, and model discovery, challenging tasks given today's unstructured model repositories. However, because most models lack documentation, large atlas regions remain uncharted. Addressing this gap motivates new machine learning methods that treat models themselves as data, inferring properties such as functionality, performance, and lineage directly from their weights. We argue that a scalable path forward is to bypass the unique parameter symmetries that plague model weights. Charting all the world's models will require a community effort, and we hope its broad utility will rally researchers toward this goal.
Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Builds on 52 of its 67 references that are in the map. First posted on arXiv 13 Mar 2025.
Builds on
52 of 67 references.
References · 52
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
- 2018Model Cards for Model Reportingcited by 1,080
- 2016HyperNetworkscited by 1,027
- 2023TIES-Merging: Resolving Interference When Merging Modelscited by 818
- 2023ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAscited by 194
- 2020LEEP: A New Measure to Evaluate Transferability of Learned Representationscited by 188
- 2021LogME: Practical Assessment of Pre-trained Models for Transfer Learningcited by 172
- 2024Stealing Part of a Production Language Modelcited by 159
- 2023HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusioncited by 152
38 more
- 2019Transferability and Hardness of Supervised Classification Taskscited by 127
- 2024Model merging with SVD to tie the Knotscited by 122
- 2020Predicting Neural Network Accuracy from Weightscited by 110
- 2023Equivariant Architectures for Learning in Deep Weight Spacescited by 107
- 2022Learning to Learn with Generative Models of Neural Network Checkpointscited by 86
- 2023Permutation Equivariant Neural Functionalscited by 70
- 2024Instructional Fingerprinting of Large Language Modelscited by 68
- 2020Classifying the classifier: dissecting the weight space of neural networkscited by 65
- 2022Hyper-Representations as Generative Models: Sampling Unseen Neural Network Weightscited by 64
- 2024Graph Neural Networks for Learning Equivariant Representations of Neural Networkscited by 59
- 2023Knowledge is a Region in Weight Space for Fine-tuned Language Modelscited by 58
- 2023Graph Metanetworks for Processing Diverse Neural Architecturescited by 57
- 2023Neural Functional Transformerscited by 52
- 2024A Survey on Model MoErging: Recycling and Routing Among Specialized Experts for Collaborative Learningcited by 52
- 2020Ranking Neural Checkpointscited by 51
- 2021Copy, Right? A Testing Framework for Copyright Protection of Deep Learning Modelscited by 46
- 2021Frustratingly Easy Transferability Estimationcited by 45
- 2024Towards Scalable and Versatile Weight Space Learningcited by 41
- 2022Model Zoos: A Dataset of Diverse Populations of Neural Network Modelscited by 39
- 2024Interpreting the Weight Space of Customized Diffusion Modelscited by 36
- 2023Equivariant Deep Weight Space Alignmentcited by 35
- 2023Model Spider: Learning to Rank Pre-Trained Models Efficientlycited by 32
- 2022PACTran: PAC-Bayesian Metrics for Estimating the Transferability of Pretrained Models to Classification Taskscited by 30
- 2024A Fingerprint for Large Language Modelscited by 28
- 2024Universal Neural Functionalscited by 26
- 2024Improved Generalization of Weight Space Networks via Augmentationscited by 24
- 2024Learning on LoRAs: GL-Equivariant Processing of Low-Rank Weight Spaces for Large Finetuned Modelscited by 22
- 2024The Empirical Impact of Neural Parameter Symmetries, or Lack Thereofcited by 21
- 2024PhyloLM : Inferring the Phylogeny of Large Language Models and Predicting their Performances in Benchmarkscited by 19
- 2024Stylus: Automatic Adapter Selection for Diffusion Modelscited by 18
- 2024Deep Linear Probe Generators for Weight Space Learningcited by 17
- 2024Recovering the Pre-Fine-Tuning Weights of Generative Modelscited by 16
- 2024Learning Useful Representations of Recurrent Neural Network Weight Matricescited by 15
- 2022NeRN -- Learning Neural Representations for Neural Networkscited by 14
- 2024Unsupervised Model Tree Heritage Recoverycited by 11
- 2024Neural Lineagecited by 9
- 2022Content-Based Search for Deep Generative Modelscited by 7
- 2024Dataset Size Recovery from LoRA Weightscited by 7
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2025: 3; 2026: 22.
25 papers.
Sort:
By area:
- 2025Symmetry in Neural Network Parameter Spacescited by 36
- 2026Learning a Generative Meta-Model of LLM Activationscited by 8
- 2026W2T: LoRA Weights Already Know What They Can Docited by 5
- 2025Economies of Open Intelligence: Tracing Power & Participation in the Model Ecosystemcited by 4
- 2025Likelihood Variance as Text Importance for Resampling Texts to Map Language Modelscited by 3
- 2026Future of Edge AI in biodiversity monitoringcited by 3
- 2026LOCUS: Low-Dimensional Model Embeddings for Efficient Model Exploration, Comparison, and Selectioncited by 2
- 2026The Appeal and Reality of Recycling LoRAs with Adaptive Mergingcited by 2
- 2026GeoSANE: Learning Geospatial Representations from Models, Not Datacited by 2
- 2026Query-efficient model evaluation using cached responsescited by 2
- 2026The Case for Model Science: Verify, Explore, Steer, Refinecited by 2
- 2026Discovering Hidden Gems in Model Repositoriescited by 1
13 more
- 2026Ensuring Semantics in Weights of Implicit Neural Representations through the Implicit Function Theoremcited by 1
- 2026ModelLens: Finding the Best for Your Task from Myriads of Modelscited by 1
- 2026Which Models Are Our Models Built On? Auditing Invisible Dependencies in Modern LLMscited by 1
- 2026Language Model Maps for Prompt-Response Distributions via Log-Likelihood Vectorscited by 0
- 2026MetaGAI: A Large-Scale and High-Quality Benchmark for Generative AI Model and Data Card Generationcited by 0
- 2026ABLE: Representing and Mapping LLMs via Attribution-Based Large-model Embeddingcited by 0
- 2026AI Supply Chain Galaxy: 3D Visual Analytics for License Compliancecited by 0
- 2026A Gravitational Interpretation of Safety Reversion under Fine-Tuningcited by 0
- 2026Spectral Signatures of Large Language Modelscited by 0
- 2026WeightCLIP: Aligning Datasets and Models for Weight Space Learningcited by 0
- 2026Scalable Black-Box Model Attribution for Imagescited by 0
- 2026An Investigation of the NeurIPS and ICML 2025 Position Trackscited by 0
- 2026Sparse Priors for Efficient Distribution Learningcited by 0
- 2026Sparse Priors for Efficient Distribution Learning16 Sep 2026
- 2026Scalable Black-Box Model Attribution for Images16 Aug 2026
- 2026An Investigation of the NeurIPS and ICML 2025 Position Tracks6 Jul 2026
- 2026WeightCLIP: Aligning Datasets and Models for Weight Space Learning3 Jul 2026
- 2026Spectral Signatures of Large Language Models3 Jul 2026
- 2026A Gravitational Interpretation of Safety Reversion under Fine-Tuning26 Jun 2026
- 2026AI Supply Chain Galaxy: 3D Visual Analytics for License Compliance15 Jun 2026
- 2026Which Models Are Our Models Built On? Auditing Invisible Dependencies in Modern LLMs10 Jun 2026
- 2026The Case for Model Science: Verify, Explore, Steer, Refine31 May 2026
- 2026Query-efficient model evaluation using cached responses8 May 2026
- 2026ModelLens: Finding the Best for Your Task from Myriads of Models8 May 2026
- 2026MetaGAI: A Large-Scale and High-Quality Benchmark for Generative AI Model and Data Card Generation26 Apr 2026
13 more
- 2026ABLE: Representing and Mapping LLMs via Attribution-Based Large-model Embedding20 Apr 2026
- 2026GeoSANE: Learning Geospatial Representations from Models, Not Data24 Mar 2026
- 2026Language Model Maps for Prompt-Response Distributions via Log-Likelihood Vectors19 Mar 2026
- 2026W2T: LoRA Weights Already Know What They Can Do16 Mar 2026
- 2026Future of Edge AI in biodiversity monitoring13 Feb 2026
- 2026The Appeal and Reality of Recycling LoRAs with Adaptive Merging12 Feb 2026
- 2026Learning a Generative Meta-Model of LLM Activations6 Feb 2026
- 2026Ensuring Semantics in Weights of Implicit Neural Representations through the Implicit Function Theorem30 Jan 2026
- 2026Discovering Hidden Gems in Model Repositories29 Jan 2026
- 2026LOCUS: Low-Dimensional Model Embeddings for Efficient Model Exploration, Comparison, and Selection28 Jan 2026
- 2025Economies of Open Intelligence: Tracing Power & Participation in the Model Ecosystem27 Nov 2025
- 2025Symmetry in Neural Network Parameter Spaces16 Jun 2025
- 2025Likelihood Variance as Text Importance for Resampling Texts to Map Language Models21 May 2025
- 2026Learning a Generative Meta-Model of LLM Activationscited by 8
- 2026Learning a Generative Meta-Model of LLM Activations6 Feb 2026
- 2025Symmetry in Neural Network Parameter Spacescited by 36
- 2026W2T: LoRA Weights Already Know What They Can Docited by 5
- 2025Economies of Open Intelligence: Tracing Power & Participation in the Model Ecosystemcited by 4
- 2025Likelihood Variance as Text Importance for Resampling Texts to Map Language Modelscited by 3
- 2026Future of Edge AI in biodiversity monitoringcited by 3
- 2026LOCUS: Low-Dimensional Model Embeddings for Efficient Model Exploration, Comparison, and Selectioncited by 2
- 2026The Appeal and Reality of Recycling LoRAs with Adaptive Mergingcited by 2
- 2026GeoSANE: Learning Geospatial Representations from Models, Not Datacited by 2
- 2026Query-efficient model evaluation using cached responsescited by 2
- 2026The Case for Model Science: Verify, Explore, Steer, Refinecited by 2
- 2026Discovering Hidden Gems in Model Repositoriescited by 1
- 2026Ensuring Semantics in Weights of Implicit Neural Representations through the Implicit Function Theoremcited by 1
12 most cited of 23 All 23 (JSON)
- 2026Sparse Priors for Efficient Distribution Learning16 Sep 2026
- 2026Scalable Black-Box Model Attribution for Images16 Aug 2026
- 2026An Investigation of the NeurIPS and ICML 2025 Position Tracks6 Jul 2026
- 2026WeightCLIP: Aligning Datasets and Models for Weight Space Learning3 Jul 2026
- 2026Spectral Signatures of Large Language Models3 Jul 2026
- 2026AI Supply Chain Galaxy: 3D Visual Analytics for License Compliance15 Jun 2026
- 2026Which Models Are Our Models Built On? Auditing Invisible Dependencies in Modern LLMs10 Jun 2026
- 2026The Case for Model Science: Verify, Explore, Steer, Refine31 May 2026
- 2026Query-efficient model evaluation using cached responses8 May 2026
- 2026ModelLens: Finding the Best for Your Task from Myriads of Models8 May 2026
- 2026MetaGAI: A Large-Scale and High-Quality Benchmark for Generative AI Model and Data Card Generation26 Apr 2026
- 2026ABLE: Representing and Mapping LLMs via Attribution-Based Large-model Embedding20 Apr 2026
12 newest of 23 All 23 (JSON)