PhysicsSolutionAgent: Towards Multimodal Explanations for Numerical Physics Problem Solving
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Explaining numerical physics problems often requires more than text-based solutions; clear visual reasoning can substantially improve conceptual understanding. While large language models (LLMs) demonstrate strong performance on many physics questions in textual form, their ability to generate long, high-quality visual explanations remains insufficiently explored. In this work, we introduce PhysicsSolutionAgent (PSA), an autonomous agent that generates physics-problem explanation videos of up to six minutes using Manim animations. To evaluate the generated videos, we design an assessment pipeline that performs automated checks across 15 quantitative parameters and incorporates feedback from a vision-language model (VLM) to iteratively improve video quality. We evaluate PSA on 32 videos spanning numerical and theoretical physics problems. Our results reveal systematic differences in video quality depending on problem difficulty and whether the task is numerical or theoretical. Using GPT-5-mini, PSA achieves a 100% video-completion rate with an average automated score of 3.8/5. However, qualitative analysis and human inspection uncover both minor and major issues, including visual layout inconsistencies and errors in how visual content is interpreted during feedback. These findings expose key limitations in reliable Manim code generation and highlight broader challenges in multimodal reasoning and evaluation for visual explanations of numerical physics problems. Our work underscores the need for improved visual understanding, verification, and evaluation frameworks in future multimodal educational systems
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 9 of its 21 references that are in the map. First posted on arXiv 19 Jan 2026.
Builds on
9 of 21 references.
References · 9
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2025Rubric Is All You Need: Enhancing LLM-based Code Evaluation With Question-Specific Rubricscited by 29
- 2025PlotGen: Multi-Agent LLM-based Scientific Data Visualization via Multimodal Feedbackcited by 20
- 2023ManimML: Communicating Machine Learning Architectures with Animationcited by 5
- 2025Optimizing Neural Architectures for Hindi Speech Separation and Enhancement in Noisy Environmentscited by 1
- 2025DEF-YOLO: Leveraging YOLO for Concealed Weapon Detection in Thermal Imagincited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026PhysicsMind: Sim and Real Mechanics Benchmarking for Physical Reasoning and Prediction in Foundational VLMs and World Models
- 2025PhysVidBench: Language-Grounded Evaluation of Physical Commonsense in Text-to-Video Models
- 2025Bootstrapping Physics-Grounded Video Generation through VLM-Guided Iterative Self-Refinement
- 2026Perceptual Self-Reflection in Agentic Physics Simulation Code Generation
- 2026Integrating Simulation and Chain-of-thought Reasoning in Multimodal-Language Models For Physical Reasoning
- 2026PhyGround: Benchmarking Physical Reasoning in Generative World Models
- 2025PhysUniBench: A Multi-Modal Physics Reasoning Benchmark at Undergraduate Level
- 2026Training and Benchmarking Code Generation for Physics-Inspired Animations