mlsanityData to 14 Oct 2026

PhyDrawGen: Physically Grounded Diagram Generation from Natural Language

arXiv 2605.30512 ↗First posted 28 May 2026cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Generating physics diagrams from text requires strict adherence to physical laws. While current generative models produce visually plausible outputs, they systematically hallucinate force vectors, ignore conservation laws, and violate geometric constraints. We present PhyDrawGen, a neuro-symbolic pipeline that decouples semantic scene understanding from physical constraint satisfaction. First, a large language model extracts a typed scene graph from the problem text. A deterministic solver then converts this graph into a Planar Straight-Line Graph (PSLG), encoding force balance, optical paths, and field topologies as exact geometric primitives. Finally, a fine-tuned Qwen-VL model implements a visually grounded propose-verify loop to iteratively correct any constraint violations. Evaluated on a benchmark of 1,449 problems spanning mechanics, optics, and electromagnetism, PhyDrawGen significantly outperforms GPT-5-image, Gemini 2.5 Flash, and Gemini 3 Pro, demonstrating robust physical accuracy even on unusual-object problems.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 40 references that are in the map. First posted on arXiv 28 May 2026.

Builds on

17 of 40 references.

References · 17

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  6. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  7. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  8. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  9. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
  10. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
  11. 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
  12. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 536
5 more
  1. 2017Scene Graph Generation by Iterative Message Passingcited by 462
  2. 2018Image Generation from Scene Graphscited by 324
  3. 2023GraphDreamer: Compositional 3D Scene Synthesis from Scene Graphscited by 97
  4. 2026Learn2Fold: Structured Origami Generation with World Model Planningcited by 5
  5. 2026Optimization of Constrained Quasiconformal Mapping for Origami Designcited by 1

Built on by

Not cited yet.