Superstudent intelligence in thermodynamics
Not on the map. Why?
Abstract (arXiv)
In this short note, we report and analyze a striking event: OpenAI's large language model o3 has outwitted all students in a university exam on thermodynamics. The thermodynamics exam is a difficult hurdle for most students, where they must show that they have mastered the fundamentals of this important topic. Consequently, the failure rates are very high, A-grades are rare - and they are considered proof of the students' exceptional intellectual abilities. This is because pattern learning does not help in the exam. The problems can only be solved by knowledgeably and creatively combining principles of thermodynamics. We have given our latest thermodynamics exam not only to the students but also to OpenAI's most powerful reasoning model, o3, and have assessed the answers of o3 exactly the same way as those of the students. In zero-shot mode, the model o3 solved all problems correctly, better than all students who took the exam; its overall score was in the range of the best scores we have seen in more than 10,000 similar exams since 1985. This is a turning point: machines now excel in complex tasks, usually taken as proof of human intellectual capabilities. We discuss the consequences this has for the work of engineers and the education of future engineers.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 13 of its 35 references that are in the map. First posted on arXiv 11 Jun 2025.
Builds on
13 of 35 references.
References · 13
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2023GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Modelscited by 176
- 2022When Physics Meets Machine Learning: A Survey of Physics-Informed Machine Learningcited by 65
- 2025LLM Agents for Education: Advances and Applicationscited by 59
- 2025UGPhysics: A Comprehensive Benchmark for Undergraduate Physics Reasoning with Large Language Modelscited by 48
- 2021MathBERT: A Pre-trained Language Model for General NLP Tasks in Mathematics Educationcited by 37
- 2023On the application of Large Language Models for language teaching and assessment technologycited by 27
- 2024HANNA: Hard-constraint Neural Network for Consistent Activity Coefficient Predictioncited by 17
- 2024GPT-4 as a Homework Tutor can Improve Student Engagement and Learning Outcomescited by 9
- 2025Evaluating GPT- and Reasoning-based Large Language Models on Physics Olympiad Problems: Surpassing Human Performance and Implications for Educational Assessmentcited by 7
- 2024Effective and Scalable Math Support: Evidence on the Impact of an AI- Tutor on Math Achievement in Ghanacited by 4
- 2024KnowTD-An Actionable Knowledge Representation System for Thermodynamicscited by 4
1 more
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024System 2 thinking in OpenAI's o1-preview model: Near-perfect performance on a mathematics exam
- 2022Asymmetric Temperature Scaling Makes Larger Networks Teach Well Again
- 2026Stan: An LLM-based thermodynamics course assistant
- 2024OpenAI-o1 AB Testing: Does the o1 model really do good reasoning in math problem solving?
- 2025Training thermodynamic computers by gradient descent
- 2024A Systematic Assessment of OpenAI o1-Preview for Higher Order Thinking in Education
- 2024O1 Replication Journey -- Part 2: Surpassing O1-preview through Simple Distillation, Big Progress or Bitter Lesson?
- 2022Curriculum Temperature for Knowledge Distillation