mlsanityData to 14 Oct 2026

DreamArt: Generating Interactable Articulated Objects from a Single Image

arXiv 2507.05763 ↗First posted 8 Jul 2025cs.CVcited by 25

Not on the map. Why?

Abstract (arXiv)

Generating articulated objects, such as laptops and microwaves, is a crucial yet challenging task with extensive applications in Embodied AI and AR/VR. Current image-to-3D methods primarily focus on surface geometry and texture, neglecting part decomposition and articulation modeling. Meanwhile, neural reconstruction approaches (e.g., NeRF or Gaussian Splatting) rely on dense multi-view or interaction data, limiting their scalability. In this paper, we introduce DreamArt, a novel framework for generating high-fidelity, interactable articulated assets from single-view images. DreamArt employs a three-stage pipeline: firstly, it reconstructs part-segmented and complete 3D object meshes through a combination of image-to-3D generation, mask-prompted 3D segmentation, and part amodal completion. Second, we fine-tune a video diffusion model to capture part-level articulation priors, leveraging movable part masks as prompt and amodal images to mitigate ambiguities caused by occlusion. Finally, DreamArt optimizes the articulation motion, represented by a dual quaternion, and conducts global texture refinement and repainting to ensure coherent, high-quality textures across all parts. Experimental results demonstrate that DreamArt effectively generates high-quality articulated objects, possessing accurate part shape, high appearance fidelity, and plausible articulation, thereby providing a scalable solution for articulated asset generation. Our project page is available at https://dream-art-0.github.io/DreamArt/.

Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Builds on 92 of its 135 references that are in the map. First posted on arXiv 8 Jul 2025.

Builds on

92 of 135 references.

References · 92

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2023Segment Anythingcited by 8,234
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  6. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  8. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  9. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  10. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  11. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  12. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
38 more
  1. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  2. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  3. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  4. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  5. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
  6. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  7. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  8. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
  9. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  10. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
  11. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
  12. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
  13. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
  14. 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
  15. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
  16. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
  17. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
  18. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
  19. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
  20. 2020Modular Primitives for High-Performance Differentiable Renderingcited by 441
  21. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
  22. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
  23. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
  24. 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editingcited by 294
  25. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
  26. 2021A Survey of Embodied AI: From Simulators to Research Taskscited by 261
  27. 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 257
  28. 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 219
  29. 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 156
  30. 2024L4GM: Large 4D Gaussian Reconstruction Modelcited by 144
  31. 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 144
  32. 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 139
  33. 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 125
  34. 2023Animate124: Animating One Image to 4D Dynamic Scenecited by 115
  35. 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 112
  36. 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 111
  37. 20244Diffusion: Multi-view Video Diffusion Model for 4D Generationcited by 104
  38. 2024STAG4D: Spatial-Temporal Anchored Generative 4D Gaussianscited by 102

50 most cited of 92 All 92 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 10; 2026: 15.

25 papers.

Sort:

By area:

  1. 2025RELIC: Interactive Video World Model with Long-Horizon Memorycited by 96
  2. 2025GWM: Towards Scalable Gaussian World Models for Robotic Manipulationcited by 39
  3. 2025PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Imagecited by 37
  4. 2025NANO3D: A Training-Free Approach for Efficient 3D Editing Without Maskscited by 31
  5. 2025Particulate: Feed-Forward 3D Object Articulationcited by 23
  6. 2025GaussianArt: Unified Modeling of Geometry and Motion for Articulated Objectscited by 17
  7. 2025Trace3D: Consistent Segmentation Lifting via Gaussian Instance Tracingcited by 13
  8. 2025ArtiLatent: Realistic Articulated 3D Object Generation via Structured Latentscited by 11
  9. 2026PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objectscited by 11
  10. 2026ArtLLM: Generating Articulated Assets via 3D LLMcited by 8
  11. 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstructioncited by 5
  12. 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
13 more
  1. 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Controlcited by 4
  2. 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twinscited by 2
  3. 2026DreamPartGen: Semantically Grounded Part-Level 3D Generation via Collaborative Latent Denoisingcited by 2
  4. 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videoscited by 2
  5. 20263D Generation for Embodied AI and Robotic Simulation: A Surveycited by 1
  6. 2026ArtMesh: Part-Aware Articulated Mesh Fields with Motion-Consistent Dynamicscited by 1
  7. 2026UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Imagecited by 1
  8. 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulationcited by 1
  9. 2025SPAGS: Sparse-View Articulated Object Reconstruction from Single State via Planar Gaussian Splattingcited by 0
  10. 2026DailyArt: Discovering Articulation from Single Static Images via Latent Dynamicscited by 0
  11. 2026PWM-ArtGen: Part World Model for Articulated Object Generationcited by 0
  12. 2026ArtLang: Structured Language-to-Kinematics Grounding for Articulated 3D Actuationcited by 0
  13. 2026Fysiverse-3D-Vision Technical Report: Generating Executable 3D Worlds from Images through Unified Spatial Reasoningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusion
  2. 2026Articulated Object Reconstruction from Rest-State Observation
  3. 2024DreamHOI: Subject-Driven Generation of 3D Human-Object Interactions with Diffusion Priors
  4. 2026ArticuTable: Generating Instance-Level Interactive Rigid-Articulated 3D Tabletop Scenes from a Single Image
  5. 2026Track, Articulate, Act: Generating Articulation from Casual Human Videos
  6. 2023CAGE: Controllable Articulation GEneration
  7. 2025DIPO: Dual-State Images Controlled Articulated Object Generation Powered by Diverse Data
  8. 2026ArtHOI: Articulated Human-Object Interaction Synthesis by 4D Reconstruction from Video Priors