CAGE: Controllable Articulation GEneration
Not on the map. Why?
Abstract (arXiv)
We address the challenge of generating 3D articulated objects in a controllable fashion. Currently, modeling articulated 3D objects is either achieved through laborious manual authoring, or using methods from prior work that are hard to scale and control directly. We leverage the interplay between part shape, connectivity, and motion using a denoising diffusion-based method with attention modules designed to extract correlations between part attributes. Our method takes an object category label and a part connectivity graph as input and generates an object's geometry and motion parameters. The generated objects conform to user-specified constraints on the object category, part shape, and part articulation. Our experiments show that our method outperforms the state-of-the-art in articulated object generation, producing more realistic objects while conforming better to user constraints. Video Summary at: http://youtu.be/cH_rbKbyTpE
Key facts. Cited by 52 papers in the map (data through 14 Oct 2026). Builds on 39 of its 53 references that are in the map. First posted on arXiv 15 Dec 2023.
Builds on
39 of 53 references.
References · 39
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
27 more
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
- 2019Understanding and Improving Layer Normalizationcited by 217
- 2022Sketch-Guided Text-to-Image Diffusion Modelscited by 180
- 2019Category-Level Articulated Object Pose Estimationcited by 159
- 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 156
- 2022Diffusion-SDF: Text-to-Shape via Voxelized Diffusioncited by 128
- 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 119
- 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 118
- 2023Vox-E: Text-guided Voxel Editing of 3D Objectscited by 115
- 2019SDM-NET: Deep Generative Network for Structured Deformable Meshcited by 113
- 2022AKB-48: A Real-World Articulated Object Knowledge Basecited by 82
- 2022HouseDiffusion: Vector Floorplan Generation via a Diffusion Model with Discrete and Continuous Denoisingcited by 73
- 2023CARTO: Category and Joint Agnostic Reconstruction of ARTiculated Objectscited by 64
- 2022CLA-NeRF: Category-Level Articulated Neural Radiance Fieldcited by 56
- 2022OPD: Single-view 3D Openable Part Detectioncited by 54
- 2023Ditto in the House: Building Articulation Models of Indoor Scenes through Interactive Perceptioncited by 41
- 2023Building Rearticulable Models for Arbitrary 3D Objects from 4D Point Cloudscited by 34
- 2020Beyond Controlled Environments: 3D Camera Re-Localization in Changing Indoor Scenescited by 31
- 2023NAP: Neural 3D Articulation Priorcited by 25
Built on by
Citing papers per year: 2024: 11; 2025: 23; 2026: 18.
52 papers.
Sort:
By area:
- 2024BrepGen: A B-rep Generative Diffusion Model with Structured Latent Geometrycited by 103
- 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 96
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 69
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 43
- 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformerscited by 41
- 2024DragAPart: Learning a Part-Level Motion Prior for Articulated Objectscited by 32
- 2026Articraft: An Agentic System for Scalable Articulated 3D Asset Generationcited by 30
- 2025From One to More: Contextual Part Latents for 3D Generationcited by 26
- 2024PhysPart: Physically Plausible Part Completion for Interactable Objectscited by 25
- 2025Particulate: Feed-Forward 3D Object Articulationcited by 23
- 2024S2O: Static to Openable Enhancement for Articulated 3D Objectscited by 22
38 more
- 2024ArtFormer: Controllable Generation of Diverse 3D Articulated Objectscited by 22
- 2025DIPO: Dual-State Images Controlled Articulated Object Generation Powered by Diverse Datacited by 21
- 2025Infinite Mobility: Scalable High-Fidelity Synthesis of Articulated Objects via Procedural Generationcited by 19
- 2025VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Videocited by 15
- 2024Survey on Modeling of Human-made Articulated Objectscited by 14
- 2026SceneCode: Executable World Programs for Editable Indoor Scenes with Articulated Objectscited by 11
- 2024Articulate3D: Holistic Understanding of 3D Scenes as Universal Scene Descriptioncited by 9
- 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual Worldcited by 9
- 2025Guiding Diffusion-Based Articulated Object Generation by Partial Point Cloud Alignment and Physical Plausibility Constraintscited by 8
- 2025CUPID: Generative 3D Reconstruction via Joint Object and Pose Modelingcited by 8
- 2026ArtLLM: Generating Articulated Assets via 3D LLMcited by 8
- 2025Articulate That Object Part (ATOP): 3D Part Articulation via Text and Motion Personalizationcited by 7
- 2025Digital Twin Generation from Visual Data: A Surveycited by 7
- 2025SPARK: Sim-ready Part-level Articulated Reconstruction with VLM Knowledgecited by 7
- 2024GAPartManip: A Large-scale Part-centric Dataset for Material-Agnostic Articulated Object Manipulationcited by 5
- 2026SIMART: Decomposing Monolithic Meshes into Sim-ready Articulated Assets via MLLMcited by 5
- 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objectscited by 4
- 2025ArtiWorld: LLM-Driven Articulation of 3D Objects in Scenescited by 3
- 2026Articulat3D: Reconstructing Articulated Digital Twins From Monocular Videos with Geometric and Motion Constraintscited by 3
- 2025DYNAMO: Dependency-Aware Deep Learning Framework for Articulated Assembly Motion Predictioncited by 2
- 2025UniArt: Unified 3D Representation for Generating 3D Articulated Objects with Open-Set Articulationcited by 2
- 2025Action-guided generation of 3D functionality segmentation datacited by 2
- 2025CADKnitter: Compositional CAD Generation from Text and Geometry Guidancecited by 2
- 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twinscited by 2
- 2025Part2GS: Part-aware Modeling of Articulated Objects using 3D Gaussian Splattingcited by 1
- 2025Unifi3D: A Study on 3D Representations for Generation and Reconstruction in a Common Frameworkcited by 1
- 2025PAOLI: Pose-free Articulated Object Learning from Sparse-view Imagescited by 1
- 2025ArticFlow: Generative Simulation of Articulated Mechanismscited by 1
- 2026ArtPro: Self-Supervised Articulated Object Reconstruction with Adaptive Integration of Mobility Proposalscited by 1
- 2026UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Imagecited by 1
- 2025PRISM: Probabilistic Representation for Integrated Shape Modeling and Generationcited by 0
- 2026GeoFusion-CAD: Structure-Aware Diffusion with Geometric State Space for Parametric 3D Designcited by 0
- 2026PWM-ArtGen: Part World Model for Articulated Object Generationcited by 0
- 2026ArtLang: Structured Language-to-Kinematics Grounding for Articulated 3D Actuationcited by 0
- 2026SNAP3D: Physically Grounded 3D Parts for Assembly from a Single Imagecited by 0
- 2026KaiNinja: Extending Native 3D Generators to the Part Levelcited by 0
- 2026FACT: Fidelity-Aware Construction of Articulated Twinscited by 0
50 most cited of 52 All 52 (JSON)
- 2026ViewStruct: View-Grounded Articulation and Connectivity Inference12 Oct 2026
- 2026Towards Physically Grounded Articulated 3D Assets: A Multi-Agent Pipeline and Benchmark9 Oct 2026
- 2026FACT: Fidelity-Aware Construction of Articulated Twins29 Sep 2026
- 2026KaiNinja: Extending Native 3D Generators to the Part Level14 Sep 2026
- 2026SNAP3D: Physically Grounded 3D Parts for Assembly from a Single Image11 Sep 2026
- 2026ArtLang: Structured Language-to-Kinematics Grounding for Articulated 3D Actuation15 Aug 2026
- 2026PWM-ArtGen: Part World Model for Articulated Object Generation2 Jul 2026
- 2026UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Image29 Jun 2026
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objects23 May 2026
- 2026SceneCode: Executable World Programs for Editable Indoor Scenes with Articulated Objects19 May 2026
- 2026Articraft: An Agentic System for Scalable Articulated 3D Asset Generation14 May 2026
- 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual World6 May 2026
38 more
- 2026SIMART: Decomposing Monolithic Meshes into Sim-ready Articulated Assets via MLLM24 Mar 2026
- 2026GeoFusion-CAD: Structure-Aware Diffusion with Geometric State Space for Parametric 3D Design23 Mar 2026
- 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twins13 Mar 2026
- 2026Articulat3D: Reconstructing Articulated Digital Twins From Monocular Videos with Geometric and Motion Constraints12 Mar 2026
- 2026ArtLLM: Generating Articulated Assets via 3D LLM1 Mar 2026
- 2026ArtPro: Self-Supervised Articulated Object Reconstruction with Adaptive Integration of Mobility Proposals26 Feb 2026
- 2025Particulate: Feed-Forward 3D Object Articulation12 Dec 2025
- 2025CADKnitter: Compositional CAD Generation from Text and Geometry Guidance12 Dec 2025
- 2025SPARK: Sim-ready Part-level Articulated Reconstruction with VLM Knowledge1 Dec 2025
- 2025Action-guided generation of 3D functionality segmentation data28 Nov 2025
- 2025UniArt: Unified 3D Representation for Generating 3D Articulated Objects with Open-Set Articulation26 Nov 2025
- 2025ArticFlow: Generative Simulation of Articulated Mechanisms22 Nov 2025
- 2025ArtiWorld: LLM-Driven Articulation of 3D Objects in Scenes17 Nov 2025
- 2025CUPID: Generative 3D Reconstruction via Joint Object and Pose Modeling23 Oct 2025
- 2025Advances in 4D Representation: Geometry, Motion, and Interaction22 Oct 2025
- 2025VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Video22 Sep 2025
- 2025DYNAMO: Dependency-Aware Deep Learning Framework for Articulated Assembly Motion Prediction15 Sep 2025
- 2025PAOLI: Pose-free Articulated Object Learning from Sparse-view Images4 Sep 2025
- 2025Unifi3D: A Study on 3D Representations for Generation and Reconstruction in a Common Framework2 Sep 2025
- 2025Guiding Diffusion-Based Articulated Object Generation by Partial Point Cloud Alignment and Physical Plausibility Constraints1 Aug 2025
- 2025From One to More: Contextual Part Latents for 3D Generation11 Jul 2025
- 2025Part2GS: Part-aware Modeling of Articulated Objects using 3D Gaussian Splatting20 Jun 2025
- 2025DIPO: Dual-State Images Controlled Articulated Object Generation Powered by Diverse Data26 May 2025
- 2025Digital Twin Generation from Visual Data: A Survey17 Apr 2025
- 2025PRISM: Probabilistic Representation for Integrated Shape Modeling and Generation6 Apr 2025
- 2025Infinite Mobility: Scalable High-Fidelity Synthesis of Articulated Objects via Procedural Generation17 Mar 2025
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splatting26 Feb 2025
- 2025Articulate That Object Part (ATOP): 3D Part Articulation via Text and Motion Personalization11 Feb 2025
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modeling4 Feb 2025
- 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformers16 Dec 2024
- 2024ArtFormer: Controllable Generation of Diverse 3D Articulated Objects10 Dec 2024
- 2024Articulate3D: Holistic Understanding of 3D Scenes as Universal Scene Description2 Dec 2024
- 2024GAPartManip: A Large-scale Part-centric Dataset for Material-Agnostic Articulated Object Manipulation27 Nov 2024
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objects21 Oct 2024
- 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Model3 Oct 2024
- 2024S2O: Static to Openable Enhancement for Articulated 3D Objects27 Sep 2024
- 2024PhysPart: Physically Plausible Part Completion for Interactable Objects25 Aug 2024
- 2024DragAPart: Learning a Part-Level Motion Prior for Articulated Objects22 Mar 2024
50 newest of 52 All 52 (JSON)
- 2024BrepGen: A B-rep Generative Diffusion Model with Structured Latent Geometrycited by 103
- 2025From One to More: Contextual Part Latents for 3D Generationcited by 26
- 2025Guiding Diffusion-Based Articulated Object Generation by Partial Point Cloud Alignment and Physical Plausibility Constraintscited by 8
- 2025Articulate That Object Part (ATOP): 3D Part Articulation via Text and Motion Personalizationcited by 7
- 2025ArticFlow: Generative Simulation of Articulated Mechanismscited by 1
- 2025ArticFlow: Generative Simulation of Articulated Mechanisms22 Nov 2025
- 2025Guiding Diffusion-Based Articulated Object Generation by Partial Point Cloud Alignment and Physical Plausibility Constraints1 Aug 2025
- 2025From One to More: Contextual Part Latents for 3D Generation11 Jul 2025
- 2025Articulate That Object Part (ATOP): 3D Part Articulation via Text and Motion Personalization11 Feb 2025
- 2024BrepGen: A B-rep Generative Diffusion Model with Structured Latent Geometry28 Jan 2024
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 69
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 43
- 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformerscited by 41
- 2024DragAPart: Learning a Part-Level Motion Prior for Articulated Objectscited by 32
- 2024PhysPart: Physically Plausible Part Completion for Interactable Objectscited by 25
- 2025Particulate: Feed-Forward 3D Object Articulationcited by 23
- 2024S2O: Static to Openable Enhancement for Articulated 3D Objectscited by 22
- 2024ArtFormer: Controllable Generation of Diverse 3D Articulated Objectscited by 22
- 2025DIPO: Dual-State Images Controlled Articulated Object Generation Powered by Diverse Datacited by 21
- 2025Infinite Mobility: Scalable High-Fidelity Synthesis of Articulated Objects via Procedural Generationcited by 19
- 2025VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Videocited by 15
12 most cited of 44 All 44 (JSON)
- 2026ViewStruct: View-Grounded Articulation and Connectivity Inference12 Oct 2026
- 2026Towards Physically Grounded Articulated 3D Assets: A Multi-Agent Pipeline and Benchmark9 Oct 2026
- 2026FACT: Fidelity-Aware Construction of Articulated Twins29 Sep 2026
- 2026KaiNinja: Extending Native 3D Generators to the Part Level14 Sep 2026
- 2026SNAP3D: Physically Grounded 3D Parts for Assembly from a Single Image11 Sep 2026
- 2026ArtLang: Structured Language-to-Kinematics Grounding for Articulated 3D Actuation15 Aug 2026
- 2026UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Image29 Jun 2026
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objects23 May 2026
- 2026SceneCode: Executable World Programs for Editable Indoor Scenes with Articulated Objects19 May 2026
- 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual World6 May 2026
- 2026SIMART: Decomposing Monolithic Meshes into Sim-ready Articulated Assets via MLLM24 Mar 2026
- 2026GeoFusion-CAD: Structure-Aware Diffusion with Geometric State Space for Parametric 3D Design23 Mar 2026
12 newest of 44 All 44 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusion
- 2025DreamArt: Generating Interactable Articulated Objects from a Single Image
- 2025ArtGen: Conditional Generative Modeling of Articulated Objects in Arbitrary Part-Level States
- 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Control
- 2025ArtiLatent: Realistic Articulated 3D Object Generation via Structured Latents
- 2026Articulated Object Reconstruction from Rest-State Observation
- 2023ARTIC3D: Learning Robust Articulated 3D Shapes from Noisy Web Image Collections
- 2025Procedural Generation of Articulated Simulation-Ready Assets