mlsanityData to 14 Oct 2026

We Should Chart an Atlas of All the World's Models

arXiv 2503.10633 ↗First posted 13 Mar 2025cs.LG cs.CL cs.CVcited by 25

Not on the map. Why?

Abstract (arXiv)

Public model repositories now contain millions of models, yet most models remain undocumented and effectively lost. In this position paper, we advocate for charting the world's model population in a unified structure we call the Model Atlas: a graph that captures models, their attributes, and the weight transformations that connect them. The Model Atlas enables applications in model forensics, meta-ML research, and model discovery, challenging tasks given today's unstructured model repositories. However, because most models lack documentation, large atlas regions remain uncharted. Addressing this gap motivates new machine learning methods that treat models themselves as data, inferring properties such as functionality, performance, and lineage directly from their weights. We argue that a scalable path forward is to bypass the unique parameter symmetries that plague model weights. Charting all the world's models will require a community effort, and we hope its broad utility will rally researchers toward this goal.

Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Builds on 52 of its 67 references that are in the map. First posted on arXiv 13 Mar 2025.

Builds on

52 of 67 references.

References · 52

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
  5. 2018Model Cards for Model Reportingcited by 1,080
  6. 2016HyperNetworkscited by 1,027
  7. 2023TIES-Merging: Resolving Interference When Merging Modelscited by 818
  8. 2023ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAscited by 194
  9. 2020LEEP: A New Measure to Evaluate Transferability of Learned Representationscited by 188
  10. 2021LogME: Practical Assessment of Pre-trained Models for Transfer Learningcited by 172
  11. 2024Stealing Part of a Production Language Modelcited by 159
  12. 2023HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusioncited by 152
38 more
  1. 2019Transferability and Hardness of Supervised Classification Taskscited by 127
  2. 2024Model merging with SVD to tie the Knotscited by 122
  3. 2020Predicting Neural Network Accuracy from Weightscited by 110
  4. 2023Equivariant Architectures for Learning in Deep Weight Spacescited by 107
  5. 2022Learning to Learn with Generative Models of Neural Network Checkpointscited by 86
  6. 2023Permutation Equivariant Neural Functionalscited by 70
  7. 2024Instructional Fingerprinting of Large Language Modelscited by 68
  8. 2020Classifying the classifier: dissecting the weight space of neural networkscited by 65
  9. 2022Hyper-Representations as Generative Models: Sampling Unseen Neural Network Weightscited by 64
  10. 2024Graph Neural Networks for Learning Equivariant Representations of Neural Networkscited by 59
  11. 2023Knowledge is a Region in Weight Space for Fine-tuned Language Modelscited by 58
  12. 2023Graph Metanetworks for Processing Diverse Neural Architecturescited by 57
  13. 2023Neural Functional Transformerscited by 52
  14. 2024A Survey on Model MoErging: Recycling and Routing Among Specialized Experts for Collaborative Learningcited by 52
  15. 2020Ranking Neural Checkpointscited by 51
  16. 2021Copy, Right? A Testing Framework for Copyright Protection of Deep Learning Modelscited by 46
  17. 2021Frustratingly Easy Transferability Estimationcited by 45
  18. 2024Towards Scalable and Versatile Weight Space Learningcited by 41
  19. 2022Model Zoos: A Dataset of Diverse Populations of Neural Network Modelscited by 39
  20. 2024Interpreting the Weight Space of Customized Diffusion Modelscited by 36
  21. 2023Equivariant Deep Weight Space Alignmentcited by 35
  22. 2023Model Spider: Learning to Rank Pre-Trained Models Efficientlycited by 32
  23. 2022PACTran: PAC-Bayesian Metrics for Estimating the Transferability of Pretrained Models to Classification Taskscited by 30
  24. 2024A Fingerprint for Large Language Modelscited by 28
  25. 2024Universal Neural Functionalscited by 26
  26. 2024Improved Generalization of Weight Space Networks via Augmentationscited by 24
  27. 2024Learning on LoRAs: GL-Equivariant Processing of Low-Rank Weight Spaces for Large Finetuned Modelscited by 22
  28. 2024The Empirical Impact of Neural Parameter Symmetries, or Lack Thereofcited by 21
  29. 2024PhyloLM : Inferring the Phylogeny of Large Language Models and Predicting their Performances in Benchmarkscited by 19
  30. 2024Stylus: Automatic Adapter Selection for Diffusion Modelscited by 18
  31. 2024Deep Linear Probe Generators for Weight Space Learningcited by 17
  32. 2024Recovering the Pre-Fine-Tuning Weights of Generative Modelscited by 16
  33. 2024Learning Useful Representations of Recurrent Neural Network Weight Matricescited by 15
  34. 2022NeRN -- Learning Neural Representations for Neural Networkscited by 14
  35. 2024Unsupervised Model Tree Heritage Recoverycited by 11
  36. 2024Neural Lineagecited by 9
  37. 2022Content-Based Search for Deep Generative Modelscited by 7
  38. 2024Dataset Size Recovery from LoRA Weightscited by 7

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 22.

25 papers.

Sort:

By area:

  1. 2025Symmetry in Neural Network Parameter Spacescited by 36
  2. 2026Learning a Generative Meta-Model of LLM Activationscited by 8
  3. 2026W2T: LoRA Weights Already Know What They Can Docited by 5
  4. 2025Economies of Open Intelligence: Tracing Power & Participation in the Model Ecosystemcited by 4
  5. 2025Likelihood Variance as Text Importance for Resampling Texts to Map Language Modelscited by 3
  6. 2026Future of Edge AI in biodiversity monitoringcited by 3
  7. 2026LOCUS: Low-Dimensional Model Embeddings for Efficient Model Exploration, Comparison, and Selectioncited by 2
  8. 2026The Appeal and Reality of Recycling LoRAs with Adaptive Mergingcited by 2
  9. 2026GeoSANE: Learning Geospatial Representations from Models, Not Datacited by 2
  10. 2026Query-efficient model evaluation using cached responsescited by 2
  11. 2026The Case for Model Science: Verify, Explore, Steer, Refinecited by 2
  12. 2026Discovering Hidden Gems in Model Repositoriescited by 1
13 more
  1. 2026Ensuring Semantics in Weights of Implicit Neural Representations through the Implicit Function Theoremcited by 1
  2. 2026ModelLens: Finding the Best for Your Task from Myriads of Modelscited by 1
  3. 2026Which Models Are Our Models Built On? Auditing Invisible Dependencies in Modern LLMscited by 1
  4. 2026Language Model Maps for Prompt-Response Distributions via Log-Likelihood Vectorscited by 0
  5. 2026MetaGAI: A Large-Scale and High-Quality Benchmark for Generative AI Model and Data Card Generationcited by 0
  6. 2026ABLE: Representing and Mapping LLMs via Attribution-Based Large-model Embeddingcited by 0
  7. 2026AI Supply Chain Galaxy: 3D Visual Analytics for License Compliancecited by 0
  8. 2026A Gravitational Interpretation of Safety Reversion under Fine-Tuningcited by 0
  9. 2026Spectral Signatures of Large Language Modelscited by 0
  10. 2026WeightCLIP: Aligning Datasets and Models for Weight Space Learningcited by 0
  11. 2026Scalable Black-Box Model Attribution for Imagescited by 0
  12. 2026An Investigation of the NeurIPS and ICML 2025 Position Trackscited by 0
  13. 2026Sparse Priors for Efficient Distribution Learningcited by 0