Large Physics Models: Towards a collaborative approach with Large Language Models and Foundation Models
Not on the map. Why?
Abstract (arXiv)
This paper explores ideas and provides a potential roadmap for the development and evaluation of physics-specific large-scale AI models, which we call Large Physics Models (LPMs). These models, based on foundation models such as Large Language Models (LLMs) - trained on broad data - are tailored to address the demands of physics research. LPMs can function independently or as part of an integrated framework. This framework can incorporate specialized tools, including symbolic reasoning modules for mathematical manipulations, frameworks to analyse specific experimental and simulated data, and mechanisms for synthesizing theories and scientific literature. We begin by examining whether the physics community should actively develop and refine dedicated models, rather than relying solely on commercial LLMs. We then outline how LPMs can be realized through interdisciplinary collaboration among experts in physics, computer science, and philosophy of science. To integrate these models effectively, we identify three key pillars: Development, Evaluation, and Philosophical Reflection. Development focuses on constructing models capable of processing physics texts, mathematical formulations, and diverse physical data. Evaluation assesses accuracy and reliability by testing and benchmarking. Finally, Philosophical Reflection encompasses the analysis of broader implications of LLMs in physics, including their potential to generate new scientific understanding and what novel collaboration dynamics might arise in research. Inspired by the organizational structure of experimental collaborations in particle physics, we propose a similarly interdisciplinary and collaborative approach to building and refining Large Physics Models. This roadmap provides specific objectives, defines pathways to achieve them, and identifies challenges that must be addressed to realise physics-specific large scale AI models.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 68 of its 156 references that are in the map. First posted on arXiv 9 Jan 2025.
Builds on
68 of 156 references.
References · 68
- 2023GPT-4 Technical Reportcited by 18,132
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,818
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,507
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
- 2023Towards Understanding Sycophancy in Language Modelscited by 988
- 2023Progress measures for grokking via mechanistic interpretabilitycited by 822
38 more
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
- 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 700
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
- 2021AI and the Everything in the Whole Wide World Benchmarkcited by 340
- 2023Explainability for Large Language Models: A Surveycited by 331
- 2019Deep Learning for Symbolic Mathematicscited by 266
- 2023SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Modelscited by 246
- 2024World Model on Million-Length Video And Language With Blockwise RingAttentioncited by 196
- 2023Causal Abstraction: A Theoretical Foundation for Mechanistic Interpretabilitycited by 194
- 2023AI Deception: A Survey of Examples, Risks, and Potential Solutionscited by 185
- 2022MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoningcited by 153
- 2024BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrievalcited by 153
- 2023PaperQA: Retrieval-Augmented Generative Agent for Scientific Researchcited by 143
- 2024Observational Scaling Laws and the Predictability of Language Model Performancecited by 128
- 2023The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-4cited by 112
- 2024ChemLLM: A Chemical Large Language Modelcited by 100
- 2023Revisiting Out-of-distribution Robustness in NLP: Benchmark, Analysis, and LLMs Evaluationscited by 96
- 2023Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language Modelscited by 87
- 2024Video as the New Language for Real-World Decision Makingcited by 86
- 2021A Living Review of Machine Learning for Particle Physicscited by 77
- 2023Have LLMs Advanced Enough? A Challenging Problem Solving Benchmark For Large Language Modelscited by 76
- 2022On scientific understanding with artificial intelligencecited by 68
- 2019Ablation Studies in Artificial Neural Networkscited by 58
- 2024Fine Tuning vs. Retrieval Augmented Generation for Less Popular Knowledgecited by 49
- 2018Machine Learning in High Energy Physics Community White Papercited by 48
- 2024Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Modelscited by 44
- 2023AstroLLaMA: Towards Specialized Foundation Models in Astronomycited by 41
- 2024OmniJet-α: The first cross-task foundation model for particle physicscited by 41
- 2024Sora Generates Videos with Stunning Geometrical Consistencycited by 31
- 2024Artificial Intelligence for Literature Reviews: Opportunities and Challengescited by 30
- 2021The Dark Machines Anomaly Score Challenge: Benchmark Data and Model Independent Event Classification for the Large Hadron Collidercited by 28
- 2024A Lorentz-Equivariant Transformer for All of the LHCcited by 27
- 2024An Interactive Agent Foundation Modelcited by 25
- 2024Generating Interesting Scientific Ideas using Knowledge Graphs and LLMs: Evaluations with 100 Research Group Leaderscited by 21
- 2024LLMs Are Prone to Fallacies in Causal Inferencecited by 21
- 2024Is Tokenization Needed for Masked Particle Modelling?cited by 20
- 2024Finetuning Foundation Models for Joint Analysis Optimizationcited by 18
- 2024Transforming the Bootstrap: Using Transformers to Compute Scattering Amplitudes in Planar N = 4 Super Yang-Mills Theorycited by 17
50 most cited of 68 All 68 (JSON)
Built on by
Citing papers per year: 2025: 11; 2026: 3.
14 papers.
Sort:
By area:
- 2025Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoningcited by 33
- 2025Exploring the Evolution of Physics Cognition in Video Generation: A Surveycited by 31
- 2025Autonomous Agents for Scientific Discovery: Orchestrating Scientists, Language, Code, and Physicscited by 11
- 2025Towards autonomous quantum physics research using LLM agents with access to intelligent toolscited by 7
- 2025Agentic Exploration of Physics Modelscited by 5
- 2025Science Is Falling Behind the Frontier: Foundation Model Adoption Across Half a Million Paperscited by 5
- 2025PhySense: Principle-Based Physics Reasoning Benchmarking for Large Language Modelscited by 4
- 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AIcited by 3
- 2026gwBenchmarks: Stress-Testing LLM Agents on High-Precision Gravitational Wave Astronomycited by 3
- 2025Agents of Discoverycited by 2
- 2025Towards a Large Physics Benchmarkcited by 1
- 2025Strategic White Paper on AI Infrastructure for Particle, Nuclear, and Astroparticle Physics: Insights from JENA and EuCAIFcited by 0
- 2026Machine Learning Meets High-Energy Nuclear Physics: From Pattern Recognition to Physics-Integrated Discovery8 Oct 2026
- 2026Learning Standard Model structure from LHC data with Riemannian flow matching17 Jul 2026
- 2026gwBenchmarks: Stress-Testing LLM Agents on High-Precision Gravitational Wave Astronomy11 May 2026
- 2025Science Is Falling Behind the Frontier: Foundation Model Adoption Across Half a Million Papers21 Nov 2025
- 2025Towards autonomous quantum physics research using LLM agents with access to intelligent tools13 Nov 2025
- 2025Autonomous Agents for Scientific Discovery: Orchestrating Scientists, Language, Code, and Physics10 Oct 2025
- 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AI6 Oct 2025
- 2025Agentic Exploration of Physics Models29 Sep 2025
- 2025Agents of Discovery10 Sep 2025
- 2025Towards a Large Physics Benchmark29 Jul 2025
- 2025PhySense: Principle-Based Physics Reasoning Benchmarking for Large Language Models30 May 2025
- 2025Exploring the Evolution of Physics Cognition in Video Generation: A Survey27 Mar 2025
- 2025Autonomous Agents for Scientific Discovery: Orchestrating Scientists, Language, Code, and Physicscited by 11
- 2025Towards autonomous quantum physics research using LLM agents with access to intelligent toolscited by 7
- 2025Agentic Exploration of Physics Modelscited by 5
- 2026gwBenchmarks: Stress-Testing LLM Agents on High-Precision Gravitational Wave Astronomycited by 3
- 2025Agents of Discoverycited by 2
- 2026gwBenchmarks: Stress-Testing LLM Agents on High-Precision Gravitational Wave Astronomy11 May 2026
- 2025Towards autonomous quantum physics research using LLM agents with access to intelligent tools13 Nov 2025
- 2025Autonomous Agents for Scientific Discovery: Orchestrating Scientists, Language, Code, and Physics10 Oct 2025
- 2025Agentic Exploration of Physics Models29 Sep 2025
- 2025Agents of Discovery10 Sep 2025
- 2025Science Is Falling Behind the Frontier: Foundation Model Adoption Across Half a Million Paperscited by 5
- 2025Towards a Large Physics Benchmarkcited by 1
- 2025Strategic White Paper on AI Infrastructure for Particle, Nuclear, and Astroparticle Physics: Insights from JENA and EuCAIFcited by 0
- 2026Learning Standard Model structure from LHC data with Riemannian flow matchingcited by 0
- 2026Machine Learning Meets High-Energy Nuclear Physics: From Pattern Recognition to Physics-Integrated Discoverycited by 0
- 2026Machine Learning Meets High-Energy Nuclear Physics: From Pattern Recognition to Physics-Integrated Discovery8 Oct 2026
- 2026Learning Standard Model structure from LHC data with Riemannian flow matching17 Jul 2026
- 2025Science Is Falling Behind the Frontier: Foundation Model Adoption Across Half a Million Papers21 Nov 2025
- 2025Towards a Large Physics Benchmark29 Jul 2025
- 2025Strategic White Paper on AI Infrastructure for Particle, Nuclear, and Astroparticle Physics: Insights from JENA and EuCAIF18 Mar 2025
Similar, not cited
Close in wording, no citation either way
- 2025Can Theoretical Physics Research Benefit from Language Agents?
- 2025PhysicsEval: Inference-Time Techniques to Improve the Reasoning Proficiency of Large Language Models on Physics Problems
- 2025Advancing AI-Scientist Understanding: Multi-Agent LLMs with Interpretable Physics Reasoning
- 2026PhysMent: An Interactive Approach For LLM Reasoning In Physics Problems
- 2025ABench-Physics: Benchmarking Physical Reasoning in LLMs via High-Difficulty and Dynamic Physics Problems
- 2024Testing Uncertainty of Large Language Models for Physics Knowledge and Reasoning
- 2026PRL-Bench: A Comprehensive Benchmark Evaluating LLMs' Capabilities in Frontier Physics Research
- 2025Scaling Physical Reasoning with the PHYSICS Dataset