mlsanityData to 14 Oct 2026

Learn2Fold: Structured Origami Generation with World Model Planning

arXiv 2603.29585 ↗First posted 2 Feb 2026cs.GR cs.AIcited by 5

On the map: World models → Embodied and robot world models

Abstract (arXiv)

The ability to transform a flat sheet into a complex three-dimensional structure is a fundamental test of physical intelligence. Unlike cloth manipulation, origami is governed by strict geometric axioms and hard kinematic constraints, where a single invalid crease or collision can invalidate the entire folding sequence. As a result, origami demands long-horizon constructive reasoning that jointly satisfies precise physical laws and high-level semantic intent. Existing approaches fall into two disjoint paradigms: optimization-based methods enforce physical validity but require dense, precisely specified inputs, making them unsuitable for sparse natural language descriptions, while generative foundation models excel at semantic and perceptual synthesis yet fail to produce long-horizon, physics-consistent folding processes. Consequently, generating valid origami folding sequences directly from text remains an open challenge. To address this gap, we introduce Learn2Fold, a neuro-symbolic framework that formulates origami folding as conditional program induction over a crease-pattern graph. Our key insight is to decouple semantic proposal from physical verification. A large language model generates candidate folding programs from abstract text prompts, while a learned graph-structured world model serves as a differentiable surrogate simulator that predicts physical feasibility and failure modes before execution. Integrated within a lookahead planning loop, Learn2Fold enables robust generation of physically valid folding sequences for complex and out-of-distribution patterns, demonstrating that effective spatial intelligence arises from the synergy between symbolic reasoning and grounded physical simulation.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 30 of its 46 references that are in the map. First posted on arXiv 2 Feb 2026.

Builds on

30 of 46 references.

References · 30

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  4. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  5. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
  6. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  7. 2025OpenAI GPT-5 System Cardcited by 989
  8. 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
  9. 2024Genie: Generative Interactive Environmentscited by 747
  10. 2017Scene Graph Generation by Iterative Message Passingcited by 462
  11. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  12. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
18 more
  1. 2018Image Generation from Scene Graphscited by 324
  2. 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 213
  3. 2016Guided Open Vocabulary Image Captioning with Constrained Beam Searchcited by 105
  4. 2020Offline Reinforcement Learning from Images with Latent Space Modelscited by 95
  5. 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generationcited by 92
  6. 2025Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assetscited by 87
  7. 2023SceneDreamer: Unbounded 3D Scene Generation from 2D Image Collectionscited by 72
  8. 20223D-LDM: Neural Implicit 3D Shape Generation with Latent Diffusion Modelscited by 67
  9. 2023Direct2.5: Diverse Text-to-3D Generation via Multi-view 2.5D Diffusioncited by 50
  10. 2024AVID: Adapting Video Diffusion Models to World Modelscited by 37
  11. 2025Generating Physically Stable and Buildable Brick Structures from Textcited by 24
  12. 2015Folding Deformable Objects using Predictive Simulation and Trajectory Optimizationcited by 19
  13. 2025Diffusion Dynamics Models with Generative State Estimation for Cloth Manipulationcited by 19
  14. 2022Learning Fabric Manipulation in the Real World with Human Videoscited by 7
  15. 2025VISTAv2: World Imagination for Indoor Vision-and-Language Navigationcited by 6
  16. 2023FabricFolding: Learning Efficient Fabric Folding without Expert Demonstrationscited by 3
  17. 2025Learning a General Model: Folding Clothing with Topological Dynamicscited by 1
  18. 2025From Pixels to Predicates Structuring urban perception with scene graphscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026COrigami: An AI Pipeline for Co-Designing Flat-Foldable Visually Recognisable Origami
  2. 2025GamiBench: Evaluating Spatial Reasoning and 2D-to-3D Planning Capabilities of MLLMs with Origami Folding Tasks
  3. 2025ORIGAMISPACE: Benchmarking Multimodal LLMs in Multi-Step Spatial Reasoning with Mathematical Constraints
  4. 2025BiFold: Bimanual Cloth Folding with Language Guidance
  5. 2023Learning Neural Force Manifolds for Sim2Real Robotic Symmetrical Paper Folding
  6. 2026DeMaVLA: A Vision-Language-Action Foundation Model for Generalizable Deformable Manipulation
  7. 2023Text2Motion: From Natural Language Instructions to Feasible Plans
  8. 2026PDDL-ART: Autonomous Symbolic Abstraction From Demonstration For Long-Horizon Robotic Manipulation Using Vision-Language Models