ART: Articulated Reconstruction Transformer
Not on the map. Why?
Abstract (arXiv)
We introduce ART, Articulated Reconstruction Transformer -- a category-agnostic, feed-forward model that reconstructs complete 3D articulated objects from only sparse, multi-state RGB images. Previous methods for articulated object reconstruction either rely on slow optimization with fragile cross-state correspondences or use feed-forward models limited to specific object categories. In contrast, ART treats articulated objects as assemblies of rigid parts, formulating reconstruction as part-based prediction. Our newly designed transformer architecture maps sparse image inputs to a set of learnable part slots, from which ART jointly decodes unified representations for individual parts, including their 3D geometry, texture, and explicit articulation parameters. The resulting reconstructions are physically interpretable and readily exportable for simulation. Trained on a large-scale, diverse dataset with per-part supervision, and evaluated across diverse benchmarks, ART achieves significant improvements over existing baselines and establishes a new state of the art for articulated object reconstruction from image inputs.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 64 of its 72 references that are in the map. First posted on arXiv 16 Dec 2025.
Builds on
64 of 72 references.
References · 64
- 2017Attention Is All You Needcited by 59,932
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2025Qwen3 Technical Reportcited by 8,195
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2024GPT-4o System Cardcited by 4,467
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
- 2021Volume Rendering of Neural Implicit Surfacescited by 990
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
38 more
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
- 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 464
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
- 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
- 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 298
- 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 297
- 2021iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Taskscited by 191
- 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 178
- 2024Probing the 3D Awareness of Visual Foundation Modelscited by 175
- 2019Category-Level Articulated Object Pose Estimationcited by 158
- 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 152
- 2020iGibson 1.0: a Simulation Environment for Interactive Tasks in Large Realistic Scenescited by 151
- 2024BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulationcited by 140
- 2024MeshLRM: Large Reconstruction Model for High-Quality Meshescited by 138
- 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 117
- 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 115
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 113
- 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 106
- 2024Automated Creation of Digital Cousins for Robust Policy Learningcited by 88
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 78
- 2022NerfAcc: A General NeRF Acceleration Toolboxcited by 73
- 2024Neural Implicit Representation for Building Digital Twins of Unknown Articulated Objectscited by 67
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2024Meta 3D AssetGen: Text-to-Mesh Generation with High-Quality Geometry, Texture, and PBR Materialscited by 66
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 66
- 2023CARTO: Category and Joint Agnostic Reconstruction of ARTiculated Objectscited by 64
- 2024Real2Code: Reconstruct Articulated Objects via Code Generationcited by 64
- 2024Learning the 3D Fauna of the Webcited by 58
- 2024ParaHome: Parameterizing Everyday Home Activities Towards 3D Generative Modeling of Human-Object Interactionscited by 54
- 2022OPD: Single-view 3D Openable Part Detectioncited by 52
- 2023Reconstructing Animatable Categories from Videoscited by 46
- 20254DGT: Learning a 4D Gaussian Transformer Using Real-World Monocular Videoscited by 46
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 41
- 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformerscited by 40
- 2021Towards Real-World Category-level Articulation Pose Estimationcited by 39
- 2023OPDMulti: Openable Part Detection for Multiple Objectscited by 38
50 most cited of 64 All 64 (JSON)
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Controlcited by 2
- 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videoscited by 1
- 2026EgoFun3D: Modeling Interactive Objects from Egocentric Videos using Function Templatescited by 1
- 2026ArtSplat: Feed-Forward Articulated 3D Gaussian Splatting from Sparse Multi-State Uncalibrated Viewscited by 1
- 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulationcited by 1
- 2026Track, Articulate, Act: Generating Articulation from Casual Human Videoscited by 0
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observationscited by 0
- 2026AgentSTAR: Agentic Shape Tracking and Reconstruction from Monocular Videoscited by 0
- 2026ArticulateArena: A Metric for Articulated Kinematicscited by 0
- 2026ArticulateArena: A Metric for Articulated Kinematics27 Sep 2026
- 2026AgentSTAR: Agentic Shape Tracking and Reconstruction from Monocular Videos21 Sep 2026
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observations17 Sep 2026
- 2026Track, Articulate, Act: Generating Articulation from Casual Human Videos16 Sep 2026
- 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulation25 Aug 2026
- 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Control12 Jun 2026
- 2026ArtSplat: Feed-Forward Articulated 3D Gaussian Splatting from Sparse Multi-State Uncalibrated Views23 May 2026
- 2026EgoFun3D: Modeling Interactive Objects from Egocentric Videos using Function Templates13 Apr 2026
- 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videos26 Mar 2026