mlsanityData to 7 Oct 2026

ArtFormer: Controllable Generation of Diverse 3D Articulated Objects

arXiv 2412.07237 ↗First posted 10 Dec 2024cs.CV cs.AI cs.ROcited by 21

Not on the map. Why?

Abstract (arXiv)

This paper presents a novel framework for modeling and conditional generation of 3D articulated objects. Troubled by flexibility-quality tradeoffs, existing methods are often limited to using predefined structures or retrieving shapes from static datasets. To address these challenges, we parameterize an articulated object as a tree of tokens and employ a transformer to generate both the object's high-level geometry code and its kinematic relations. Subsequently, each sub-part's geometry is further decoded using a signed-distance-function (SDF) shape prior, facilitating the synthesis of high-quality 3D shapes. Our approach enables the generation of diverse objects with high-quality geometry and varying number of parts. Comprehensive experiments on conditional generation from text descriptions demonstrate the effectiveness and flexibility of our method.

Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 49 of its 78 references that are in the map. First posted on arXiv 10 Dec 2024.

Builds on

49 of 78 references.

References · 49

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  5. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  6. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  7. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  8. 2022Scalable Diffusion Models with Transformerscited by 5,931
  9. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  10. 2016Variational Graph Auto-Encoderscited by 1,373
  11. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  12. 2022Equivariant Diffusion for Molecule Generation in 3Dcited by 666
37 more
  1. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
  2. 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 521
  3. 2022DiGress: Discrete Denoising diffusion for graph generationcited by 503
  4. 2018MolGAN: An implicit generative model for small molecular graphscited by 392
  5. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 379
  6. 2018GraphVAE: Towards Generation of Small Graphs Using Variational Autoencoderscited by 375
  7. 2022Score-based Generative Modeling of Graphs via the System of Stochastic Differential Equationscited by 273
  8. 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
  9. 2020Rethinking Positional Encoding in Language Pre-trainingcited by 197
  10. 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
  11. 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 184
  12. 2016Learning Deep Representations of Fine-grained Visual Descriptionscited by 182
  13. 2018Text2Shape: Generating Shapes from Natural Language by Learning Joint Embeddingscited by 169
  14. 2023HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusioncited by 152
  15. 2022Diffusion-SDF: Conditional Generative Modeling of Signed Distance Functionscited by 133
  16. 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 113
  17. 2017MarrNet: 3D Shape Reconstruction via 2.5D Sketchescited by 108
  18. 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 106
  19. 2019D-VAE: A Variational Autoencoder for Directed Acyclic Graphscited by 98
  20. 2024Automated Creation of Digital Cousins for Robust Policy Learningcited by 88
  21. 2020ScrewNet: Category-Independent Articulation Model Estimation From Depth Images Using Screw Theorycited by 70
  22. 2019Mol-CycleGAN - a generative model for molecular optimizationcited by 66
  23. 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 66
  24. 2023CARTO: Category and Joint Agnostic Reconstruction of ARTiculated Objectscited by 64
  25. 2022ShapeCrafter: A Recursive Text-Conditioned 3D Shape Generation Modelcited by 62
  26. 2017Learning Robust Visual-Semantic Embeddingscited by 56
  27. 2022Self-supervised Neural Articulated Shape and Appearance Modelscited by 51
  28. 2023CAGE: Controllable Articulation GEnerationcited by 50
  29. 2022GraphGDP: Generative Diffusion Processes for Permutation Invariant Graph Generationcited by 43
  30. 2023SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priorscited by 43
  31. 2014A Probabilistic Framework for Learning Kinematic Models of Articulated Objectscited by 40
  32. 2023SceneHGN: Hierarchical Graph Networks for 3D Indoor Scene Generation with Fine-Grained Geometrycited by 38
  33. 2022GenSDF: Two-Stage Learning of Generalizable Signed Distance Functionscited by 30
  34. 2024Unifying Generation and Prediction on Graphs with Latent Graph Diffusioncited by 24
  35. 2023Classifier-free graph diffusion for molecular property targetingcited by 13
  36. 20243M-Diffusion: Latent Multi-Modal Diffusion for Language-Guided Molecular Structure Generationcited by 8
  37. 2023AO-Grasp: Articulated Object Grasp Generationcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 9; 2026: 12.

21 papers.

Sort:

By area:

  1. 2026Articraft: An Agentic System for Scalable Articulated 3D Asset Generationcited by 25
  2. 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusioncited by 22
  3. 2025Particulate: Feed-Forward 3D Object Articulationcited by 20
  4. 2026ArtLLM: Generating Articulated Assets via 3D LLMcited by 8
  5. 2025Digital Twin Generation from Visual Data: A Surveycited by 7
  6. 2025Guiding Diffusion-Based Articulated Object Generation by Partial Point Cloud Alignment and Physical Plausibility Constraintscited by 7
  7. 2026PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objectscited by 7
  8. 2025SPARK: Sim-ready Part-level Articulated Reconstruction with VLM Knowledgecited by 6
  9. 2026PAct: Part-Decomposed Single-View Articulated Object Generationcited by 5
  10. 2025DragMesh: Interactive 3D Generation Made Easycited by 3
  11. 2025UniArt: Unified 3D Representation for Generating 3D Articulated Objects with Open-Set Articulationcited by 2
  12. 2025Action-guided generation of 3D functionality segmentation datacited by 2
9 more
  1. 2025GAOT: Generating Articulated Objects Through Text-Guided Diffusion Modelscited by 1
  2. 2026ArtPro: Self-Supervised Articulated Object Reconstruction with Adaptive Integration of Mobility Proposalscited by 1
  3. 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twinscited by 1
  4. 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulationcited by 1
  5. 2026ArtHOI: Articulated Human-Object Interaction Synthesis by 4D Reconstruction from Video Priorscited by 0
  6. 20263D Generation for Embodied AI and Robotic Simulation: A Surveycited by 0
  7. 2026PWM-ArtGen: Part World Model for Articulated Object Generationcited by 0
  8. 2026SNAP3D: Physically Grounded 3D Parts for Assembly from a Single Imagecited by 0
  9. 2026FACT: Fidelity-Aware Construction of Articulated Twinscited by 0