mlsanityData to 7 Oct 2026

Large Physics Models: Towards a collaborative approach with Large Language Models and Foundation Models

arXiv 2501.05382 ↗First posted 9 Jan 2025physics.data-an cs.AI hep-phcited by 14

Not on the map. Why?

Abstract (arXiv)

This paper explores ideas and provides a potential roadmap for the development and evaluation of physics-specific large-scale AI models, which we call Large Physics Models (LPMs). These models, based on foundation models such as Large Language Models (LLMs) - trained on broad data - are tailored to address the demands of physics research. LPMs can function independently or as part of an integrated framework. This framework can incorporate specialized tools, including symbolic reasoning modules for mathematical manipulations, frameworks to analyse specific experimental and simulated data, and mechanisms for synthesizing theories and scientific literature. We begin by examining whether the physics community should actively develop and refine dedicated models, rather than relying solely on commercial LLMs. We then outline how LPMs can be realized through interdisciplinary collaboration among experts in physics, computer science, and philosophy of science. To integrate these models effectively, we identify three key pillars: Development, Evaluation, and Philosophical Reflection. Development focuses on constructing models capable of processing physics texts, mathematical formulations, and diverse physical data. Evaluation assesses accuracy and reliability by testing and benchmarking. Finally, Philosophical Reflection encompasses the analysis of broader implications of LLMs in physics, including their potential to generate new scientific understanding and what novel collaboration dynamics might arise in research. Inspired by the organizational structure of experimental collaborations in particle physics, we propose a similarly interdisciplinary and collaborative approach to building and refining Large Physics Models. This roadmap provides specific objectives, defines pathways to achieve them, and identifies challenges that must be addressed to realise physics-specific large scale AI models.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 68 of its 156 references that are in the map. First posted on arXiv 9 Jan 2025.

Builds on

68 of 156 references.

References · 68

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  4. 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,818
  5. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  6. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  7. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  8. 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,507
  9. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
  10. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
  11. 2023Towards Understanding Sycophancy in Language Modelscited by 988
  12. 2023Progress measures for grokking via mechanistic interpretabilitycited by 822
38 more
  1. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
  2. 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 700
  3. 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
  4. 2021AI and the Everything in the Whole Wide World Benchmarkcited by 340
  5. 2023Explainability for Large Language Models: A Surveycited by 331
  6. 2019Deep Learning for Symbolic Mathematicscited by 266
  7. 2023SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Modelscited by 246
  8. 2024World Model on Million-Length Video And Language With Blockwise RingAttentioncited by 196
  9. 2023Causal Abstraction: A Theoretical Foundation for Mechanistic Interpretabilitycited by 194
  10. 2023AI Deception: A Survey of Examples, Risks, and Potential Solutionscited by 185
  11. 2022MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoningcited by 153
  12. 2024BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrievalcited by 153
  13. 2023PaperQA: Retrieval-Augmented Generative Agent for Scientific Researchcited by 143
  14. 2024Observational Scaling Laws and the Predictability of Language Model Performancecited by 128
  15. 2023The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-4cited by 112
  16. 2024ChemLLM: A Chemical Large Language Modelcited by 100
  17. 2023Revisiting Out-of-distribution Robustness in NLP: Benchmark, Analysis, and LLMs Evaluationscited by 96
  18. 2023Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language Modelscited by 87
  19. 2024Video as the New Language for Real-World Decision Makingcited by 86
  20. 2021A Living Review of Machine Learning for Particle Physicscited by 77
  21. 2023Have LLMs Advanced Enough? A Challenging Problem Solving Benchmark For Large Language Modelscited by 76
  22. 2022On scientific understanding with artificial intelligencecited by 68
  23. 2019Ablation Studies in Artificial Neural Networkscited by 58
  24. 2024Fine Tuning vs. Retrieval Augmented Generation for Less Popular Knowledgecited by 49
  25. 2018Machine Learning in High Energy Physics Community White Papercited by 48
  26. 2024Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Modelscited by 44
  27. 2023AstroLLaMA: Towards Specialized Foundation Models in Astronomycited by 41
  28. 2024OmniJet-α: The first cross-task foundation model for particle physicscited by 41
  29. 2024Sora Generates Videos with Stunning Geometrical Consistencycited by 31
  30. 2024Artificial Intelligence for Literature Reviews: Opportunities and Challengescited by 30
  31. 2021The Dark Machines Anomaly Score Challenge: Benchmark Data and Model Independent Event Classification for the Large Hadron Collidercited by 28
  32. 2024A Lorentz-Equivariant Transformer for All of the LHCcited by 27
  33. 2024An Interactive Agent Foundation Modelcited by 25
  34. 2024Generating Interesting Scientific Ideas using Knowledge Graphs and LLMs: Evaluations with 100 Research Group Leaderscited by 21
  35. 2024LLMs Are Prone to Fallacies in Causal Inferencecited by 21
  36. 2024Is Tokenization Needed for Masked Particle Modelling?cited by 20
  37. 2024Finetuning Foundation Models for Joint Analysis Optimizationcited by 18
  38. 2024Transforming the Bootstrap: Using Transformers to Compute Scattering Amplitudes in Planar N = 4 Super Yang-Mills Theorycited by 17

50 most cited of 68 All 68 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 11; 2026: 3.

14 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025Can Theoretical Physics Research Benefit from Language Agents?
  2. 2025PhysicsEval: Inference-Time Techniques to Improve the Reasoning Proficiency of Large Language Models on Physics Problems
  3. 2025Advancing AI-Scientist Understanding: Multi-Agent LLMs with Interpretable Physics Reasoning
  4. 2026PhysMent: An Interactive Approach For LLM Reasoning In Physics Problems
  5. 2025ABench-Physics: Benchmarking Physical Reasoning in LLMs via High-Difficulty and Dynamic Physics Problems
  6. 2024Testing Uncertainty of Large Language Models for Physics Knowledge and Reasoning
  7. 2026PRL-Bench: A Comprehensive Benchmark Evaluating LLMs' Capabilities in Frontier Physics Research
  8. 2025Scaling Physical Reasoning with the PHYSICS Dataset