DreamArt: Generating Interactable Articulated Objects from a Single Image
Not on the map. Why?
Abstract (arXiv)
Generating articulated objects, such as laptops and microwaves, is a crucial yet challenging task with extensive applications in Embodied AI and AR/VR. Current image-to-3D methods primarily focus on surface geometry and texture, neglecting part decomposition and articulation modeling. Meanwhile, neural reconstruction approaches (e.g., NeRF or Gaussian Splatting) rely on dense multi-view or interaction data, limiting their scalability. In this paper, we introduce DreamArt, a novel framework for generating high-fidelity, interactable articulated assets from single-view images. DreamArt employs a three-stage pipeline: firstly, it reconstructs part-segmented and complete 3D object meshes through a combination of image-to-3D generation, mask-prompted 3D segmentation, and part amodal completion. Second, we fine-tune a video diffusion model to capture part-level articulation priors, leveraging movable part masks as prompt and amodal images to mitigate ambiguities caused by occlusion. Finally, DreamArt optimizes the articulation motion, represented by a dual quaternion, and conducts global texture refinement and repainting to ensure coherent, high-quality textures across all parts. Experimental results demonstrate that DreamArt effectively generates high-quality articulated objects, possessing accurate part shape, high appearance fidelity, and plausible articulation, thereby providing a scalable solution for articulated asset generation. Our project page is available at https://dream-art-0.github.io/DreamArt/.
Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Builds on 92 of its 135 references that are in the map. First posted on arXiv 8 Jul 2025.
Builds on
92 of 135 references.
References · 92
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
38 more
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
- 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
- 2020Modular Primitives for High-Performance Differentiable Renderingcited by 441
- 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
- 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
- 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editingcited by 294
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2021A Survey of Embodied AI: From Simulators to Research Taskscited by 261
- 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 257
- 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 219
- 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 156
- 2024L4GM: Large 4D Gaussian Reconstruction Modelcited by 144
- 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 144
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 139
- 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 125
- 2023Animate124: Animating One Image to 4D Dynamic Scenecited by 115
- 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 112
- 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 111
- 20244Diffusion: Multi-view Video Diffusion Model for 4D Generationcited by 104
- 2024STAG4D: Spatial-Temporal Anchored Generative 4D Gaussianscited by 102
50 most cited of 92 All 92 (JSON)
Built on by
Citing papers per year: 2025: 10; 2026: 15.
25 papers.
Sort:
By area:
- 2025RELIC: Interactive Video World Model with Long-Horizon Memorycited by 96
- 2025GWM: Towards Scalable Gaussian World Models for Robotic Manipulationcited by 39
- 2025PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Imagecited by 37
- 2025NANO3D: A Training-Free Approach for Efficient 3D Editing Without Maskscited by 31
- 2025Particulate: Feed-Forward 3D Object Articulationcited by 23
- 2025GaussianArt: Unified Modeling of Geometry and Motion for Articulated Objectscited by 17
- 2025Trace3D: Consistent Segmentation Lifting via Gaussian Instance Tracingcited by 13
- 2025ArtiLatent: Realistic Articulated 3D Object Generation via Structured Latentscited by 11
- 2026PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objectscited by 11
- 2026ArtLLM: Generating Articulated Assets via 3D LLMcited by 8
- 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstructioncited by 5
- 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
13 more
- 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Controlcited by 4
- 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twinscited by 2
- 2026DreamPartGen: Semantically Grounded Part-Level 3D Generation via Collaborative Latent Denoisingcited by 2
- 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videoscited by 2
- 20263D Generation for Embodied AI and Robotic Simulation: A Surveycited by 1
- 2026ArtMesh: Part-Aware Articulated Mesh Fields with Motion-Consistent Dynamicscited by 1
- 2026UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Imagecited by 1
- 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulationcited by 1
- 2025SPAGS: Sparse-View Articulated Object Reconstruction from Single State via Planar Gaussian Splattingcited by 0
- 2026DailyArt: Discovering Articulation from Single Static Images via Latent Dynamicscited by 0
- 2026PWM-ArtGen: Part World Model for Articulated Object Generationcited by 0
- 2026ArtLang: Structured Language-to-Kinematics Grounding for Articulated 3D Actuationcited by 0
- 2026Fysiverse-3D-Vision Technical Report: Generating Executable 3D Worlds from Images through Unified Spatial Reasoningcited by 0
- 2026Fysiverse-3D-Vision Technical Report: Generating Executable 3D Worlds from Images through Unified Spatial Reasoning22 Sep 2026
- 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulation25 Aug 2026
- 2026ArtLang: Structured Language-to-Kinematics Grounding for Articulated 3D Actuation15 Aug 2026
- 2026PWM-ArtGen: Part World Model for Articulated Object Generation2 Jul 2026
- 2026UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Image29 Jun 2026
- 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Control12 Jun 2026
- 2026PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objects20 May 2026
- 2026ArtMesh: Part-Aware Articulated Mesh Fields with Motion-Consistent Dynamics15 May 2026
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey29 Apr 2026
- 2026DailyArt: Discovering Articulation from Single Static Images via Latent Dynamics9 Apr 2026
- 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videos26 Mar 2026
- 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstruction19 Mar 2026
13 more
- 2026DreamPartGen: Semantically Grounded Part-Level 3D Generation via Collaborative Latent Denoising19 Mar 2026
- 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twins13 Mar 2026
- 2026ArtLLM: Generating Articulated Assets via 3D LLM1 Mar 2026
- 2025Particulate: Feed-Forward 3D Object Articulation12 Dec 2025
- 2025RELIC: Interactive Video World Model with Long-Horizon Memory3 Dec 2025
- 2025SPAGS: Sparse-View Articulated Object Reconstruction from Single State via Planar Gaussian Splatting21 Nov 2025
- 2025PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Image17 Nov 2025
- 2025ArtiLatent: Realistic Articulated 3D Object Generation via Structured Latents24 Oct 2025
- 2025Advances in 4D Representation: Geometry, Motion, and Interaction22 Oct 2025
- 2025NANO3D: A Training-Free Approach for Efficient 3D Editing Without Masks16 Oct 2025
- 2025GWM: Towards Scalable Gaussian World Models for Robotic Manipulation25 Aug 2025
- 2025GaussianArt: Unified Modeling of Geometry and Motion for Articulated Objects20 Aug 2025
- 2025Trace3D: Consistent Segmentation Lifting via Gaussian Instance Tracing5 Aug 2025
- 2025RELIC: Interactive Video World Model with Long-Horizon Memorycited by 96
- 2025GWM: Towards Scalable Gaussian World Models for Robotic Manipulationcited by 39
- 2026DailyArt: Discovering Articulation from Single Static Images via Latent Dynamicscited by 0
- 2026PWM-ArtGen: Part World Model for Articulated Object Generationcited by 0
- 2026PWM-ArtGen: Part World Model for Articulated Object Generation2 Jul 2026
- 2026DailyArt: Discovering Articulation from Single Static Images via Latent Dynamics9 Apr 2026
- 2025RELIC: Interactive Video World Model with Long-Horizon Memory3 Dec 2025
- 2025GWM: Towards Scalable Gaussian World Models for Robotic Manipulation25 Aug 2025
- 2025PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Imagecited by 37
- 2025NANO3D: A Training-Free Approach for Efficient 3D Editing Without Maskscited by 31
- 2025Particulate: Feed-Forward 3D Object Articulationcited by 23
- 2025GaussianArt: Unified Modeling of Geometry and Motion for Articulated Objectscited by 17
- 2025Trace3D: Consistent Segmentation Lifting via Gaussian Instance Tracingcited by 13
- 2025ArtiLatent: Realistic Articulated 3D Object Generation via Structured Latentscited by 11
- 2026PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objectscited by 11
- 2026ArtLLM: Generating Articulated Assets via 3D LLMcited by 8
- 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstructioncited by 5
- 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
- 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twinscited by 2
- 2026DreamPartGen: Semantically Grounded Part-Level 3D Generation via Collaborative Latent Denoisingcited by 2
12 most cited of 19 All 19 (JSON)
- 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulation25 Aug 2026
- 2026ArtLang: Structured Language-to-Kinematics Grounding for Articulated 3D Actuation15 Aug 2026
- 2026UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Image29 Jun 2026
- 2026PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objects20 May 2026
- 2026ArtMesh: Part-Aware Articulated Mesh Fields with Motion-Consistent Dynamics15 May 2026
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey29 Apr 2026
- 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videos26 Mar 2026
- 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstruction19 Mar 2026
- 2026DreamPartGen: Semantically Grounded Part-Level 3D Generation via Collaborative Latent Denoising19 Mar 2026
- 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twins13 Mar 2026
- 2026ArtLLM: Generating Articulated Assets via 3D LLM1 Mar 2026
- 2025Particulate: Feed-Forward 3D Object Articulation12 Dec 2025
12 newest of 19 All 19 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusion
- 2026Articulated Object Reconstruction from Rest-State Observation
- 2024DreamHOI: Subject-Driven Generation of 3D Human-Object Interactions with Diffusion Priors
- 2026ArticuTable: Generating Instance-Level Interactive Rigid-Articulated 3D Tabletop Scenes from a Single Image
- 2026Track, Articulate, Act: Generating Articulation from Casual Human Videos
- 2023CAGE: Controllable Articulation GEneration
- 2025DIPO: Dual-State Images Controlled Articulated Object Generation Powered by Diverse Data
- 2026ArtHOI: Articulated Human-Object Interaction Synthesis by 4D Reconstruction from Video Priors