mlsanityData to 14 Oct 2026

Reliable generation of isomorphic physics problems using Generative AI with prompt-chaining and tool use

arXiv 2508.14755 ↗First posted 20 Aug 2025physics.ed-ph cs.AIcited by 0

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

We present a method for generating large numbers of isomorphic physics problems using generative AI services such as ChatGPT, through prompt chaining and tool use. This approach enables precise control over structural variations-such as numeric values and spatial relations-while supporting diverse contextual variations in the problem body. By utilizing the Python code interpreter, the method supports automatic solution validation and simple diagram generation, addressing key limitations in existing LLM-based methods. We generated two example isomorphic problem banks and compared the outcome against two simpler prompt-based approaches. Results show that prompt-chaining produces significantly higher quality and more consistent outputs than simpler, non-chaining prompts. We also show that GenAI services can be used to validate the quality of the generated isomorphic problems. This work demonstrates a promising method for efficient and scalable problem creation accessible to the average instructor, which opens new possibilities for personalized adaptive testing and automated content development.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 0 of its 10 references that are in the map. First posted on arXiv 20 Aug 2025.

Builds on

0 of 10 references.

No references here yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Infinite Problem Generator: Verifiably Scaling Physics Reasoning Data with Agentic Workflows
  2. 2025Chain of Unit-Physics: A Primitive-Centric Approach to Scientific Code Synthesis
  3. 2026Agentic Retrieval and Reinforcement Learned Equation Chains: A Controlled Generation Framework for Complex and Novel Physics Word Problems
  4. 2025SPARQ: Synthetic Problem Generation for Reasoning via Quality-Diversity Algorithms
  5. 2026TheoPhysEval: Assessing AI agents at autonomous theoretical physics problem solving
  6. 2026FormalScience: Scalable Human-in-the-Loop Autoformalisation of Science with Agentic Code Generation in Lean
  7. 2026Sci-Rho: A Multilingual Visually-Grounded Symbolic Benchmark for STEM Problems
  8. 2026Adaptive Problem Generation via Symbolic Representations