mlsanityData to 14 Oct 2026

Can AI Understand the Language of Origami?

arXiv 2603.13856 ↗First posted 14 Mar 2026cs.LG cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Building AI systems that can plan, act, and create in the physical world requires more than pattern recognition. Such systems must reason about the generative mechanisms and constraints governing physical processes, using structured representations that connect observations, actions, and their effects. Yet, many existing benchmarks study these capabilities separately, focusing either on visual recognition or on abstract symbolic or programmatic reasoning. Origami provides a natural testbed that integrates these abilities: constructing shapes through folds requires visual perception, reasoning about geometric and physical constraints, and sequential planning, while remaining sufficiently structured for systematic evaluation. We introduce OrigamiBench, a benchmark for evaluating programmatic understanding of the mechanisms underlying origami synthesis through a high-level language of physically grounded fold actions. Experiments with modern vision-language models reveal that scaling model size alone does not reliably improve reasoning about physical transformations. Moreover, models struggle to ground programmatic information in visual observations, suggesting that visual and language representations remain weakly integrated.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 16 of its 26 references that are in the map. First posted on arXiv 14 Mar 2026.

Builds on

16 of 26 references.

References · 16

  1. 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,457
  2. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 490
  3. 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 380
  4. 2021Physion: Evaluating Physical Prediction from Vision in Humans and Machinescited by 153
  5. 2023Infinite Photorealistic Worlds using Procedural Generationcited by 147
  6. 2020Bongard-LOGO: A New Benchmark for Human-Level Concept Learning and Reasoningcited by 63
  7. 2023CaptainCook4D: A Dataset for Understanding Errors in Procedural Activitiescited by 51
  8. 2023D2CSG: Unsupervised Learning of Compact CSG Trees with Dual Complements and Dropoutscited by 40
  9. 2022Are Deep Neural Networks SMARTer than Second Graders?cited by 24
  10. 2025VLMaterial: Procedural Material Generation with Large Vision-Language Modelscited by 9
  11. 2025PhyBlock: A Progressive Benchmark for Physical Understanding and Planning via 3D Block Assemblycited by 7
  12. 2025ORIGAMISPACE: Benchmarking Multimodal LLMs in Multi-Step Spatial Reasoning with Mathematical Constraintscited by 7
4 more
  1. 2025ArcPro: Architectural Programs for Structured 3D Abstraction of Sparse Pointscited by 6
  2. 2024PyTorchGeoNodes: Enabling Differentiable Shape Programs for 3D Shape Reconstructioncited by 5
  3. 2026Learn2Fold: Structured Origami Generation with World Model Planningcited by 5
  4. 2025GamiBench: Evaluating Spatial Reasoning and 2D-to-3D Planning Capabilities of MLLMs with Origami Folding Taskscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026From Perception to Action: An Interactive Benchmark for Vision Reasoning
  2. 2026Code as Worlds: Agentic Discovery of Executable World Representations for Physical Reasoning
  3. 2026Plan-Bench: Can Existing VLMs Go Well Beyond Perception to Reason and Plan in Embodied Worlds?
  4. 2025VLMgineer: Vision Language Models as Robotic Toolsmiths
  5. 2026Thinking in Text and Images: Interleaved Vision--Language Reasoning Traces for Long-Horizon Robot Manipulation
  6. 2026How Far Are Vision-Language Models from Constructing the Real World? A Benchmark for Physical Generative Reasoning
  7. 2026IMBench: A Benchmark for Intuitive Robotic Manipulation
  8. 2026Vision Language Models Cannot Reason About Physical Transformation