UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Image
Not on the map. Why?
Abstract (arXiv)
Articulated 3D objects are essential for interactive environments in embodied AI, robotics, and virtual reality, but reconstructing their structure and motion from sparse observations remains challenging. Existing approaches remain largely constrained by lack of supervised data or lack the priors needed to reliably recover articulation, hidden geometry, and internal object structure. We present the first debate-driven agentic approach to articulated 3D object reconstruction from text or image inputs that both grounds articulation reasoning in concrete motion and exposes the occluded geometry revealed under articulation. High-level agents reason about object semantics and motion using knowledge from vision-language and video models, while low-level agents estimate articulation parameters and interaction points; together, they engage in a two-round structured debate that first exploits global--local disagreement and then grounds the agents in freely generated video. The same video prior, conditioned on the agreed articulation, then drives each part through its motion to expose occluded interiors and geometry that cannot be inferred from a single static view. By combining agentic reasoning with a video generative prior, our approach jointly infers articulation and reconstructs complete 3D articulated objects, producing high-fidelity geometry, internal structure, and motion-consistent states beyond directly observed surfaces.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 42 of its 45 references that are in the map. First posted on arXiv 29 Jun 2026.
Builds on
42 of 45 references.
References · 42
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 521
- 2023CoTracker: It is Better to Track Togethercited by 516
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
30 more
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
- 2025Native and Compact Structured Latents for 3D Generationcited by 157
- 2024CoTracker3: Simpler and Better Point Tracking by Pseudo-Labelling Real Videoscited by 122
- 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 115
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 113
- 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 106
- 2024SAMPart3D: Segment Any Part in 3D Objectscited by 95
- 2025PARTFIELD: Learning 3D Feature Fields for Part Segmentation and Beyondcited by 91
- 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 90
- 2024Automated Creation of Digital Cousins for Robust Policy Learningcited by 88
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 78
- 2024Neural Implicit Representation for Building Digital Twins of Unknown Articulated Objectscited by 67
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 66
- 2025OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesioncited by 60
- 2023CAGE: Controllable Articulation GEnerationcited by 50
- 2025Efficient Part-level 3D Object Generation via Dual Volume Packingcited by 47
- 2024REACTO: Reconstructing Articulated Objects from a Single Videocited by 45
- 2025X-Part: high fidelity and structure coherent shape decompositioncited by 42
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 41
- 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformerscited by 40
- 2025P3-SAM: Native 3D Part Segmentationcited by 39
- 2022Understanding 3D Object Articulation in Internet Videoscited by 36
- 2024A3VLM: Actionable Articulation-Aware Vision Language Modelcited by 33
- 2025PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Imagecited by 32
- 2025REArtGS: Reconstructing and Generating Articulated Objects via 3D Gaussian Splatting with Geometric and Motion Constraintscited by 27
- 2025DreamArt: Generating Interactable Articulated Objects from a Single Imagecited by 25
- 2026Articraft: An Agentic System for Scalable Articulated 3D Asset Generationcited by 25
- 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusioncited by 22
- 2025Particulate: Feed-Forward 3D Object Articulationcited by 20
- 2026SegviGen: Repurposing 3D Generative Model for Part Segmentationcited by 9
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026FACT: Fidelity-Aware Construction of Articulated Twinscited by 0
- 2026FACT: Fidelity-Aware Construction of Articulated Twins29 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026Articulated Object Reconstruction from Rest-State Observation
- 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstruction
- 2026Artic-O: End-to-End Articulated Object Reconstruction via Latent Geometry Learning
- 2026ArticuTable: Generating Instance-Level Interactive Rigid-Articulated 3D Tabletop Scenes from a Single Image
- 2026ArtiMo: Agent-Driven Articulated Mesh Animation
- 2026AgentSTAR: Agentic Shape Tracking and Reconstruction from Monocular Videos
- 2021Reconstructing Interactive 3D Scenes by Panoptic Mapping and CAD Model Alignments
- 2026CoDimRecon: Agentic Reconstruction of Sim-Ready 3D Scenes with Deformable Curves, Surfaces, and Volumes