mlsanityData to 7 Oct 2026

ArtiWorld: LLM-Driven Articulation of 3D Objects in Scenes

arXiv 2511.12977 ↗First posted 17 Nov 2025cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Building interactive simulators and scalable robot-learning environments requires a large number of articulated assets. However, most existing 3D assets in simulation are rigid, and manually converting them into articulated objects is extremely labor- and cost-intensive. This raises a natural question: can we automatically identify articulable objects in a scene and convert them into articulated assets directly? In this paper, we present ArtiWorld, a scene-aware pipeline that localizes candidate articulable objects from textual scene descriptions and reconstructs executable URDF models that preserve the original geometry. At the core of this pipeline is Arti4URDF, which leverages 3D point cloud, prior knowledge of a large language model (LLM), and a URDF-oriented prompt design to rapidly convert rigid objects into interactive URDF-based articulated objects while maintaining their 3D shape. We evaluate ArtiWorld at three levels: 3D simulated objects, full 3D simulated scenes, and real-world scan scenes. Across all three settings, our method consistently outperforms existing approaches and achieves state-of-the-art performance, while preserving object geometry and correctly capturing object interactivity to produce usable URDF-based articulated models. This provides a practical path toward building interactive, robot-ready simulation environments directly from existing 3D assets. Code and data will be released.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 36 of its 42 references that are in the map. First posted on arXiv 17 Nov 2025.

Builds on

36 of 42 references.

References · 36

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2023Visual Instruction Tuningcited by 7,792
  4. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  5. 2023Qwen Technical Reportcited by 3,273
  6. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  7. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  8. 2023PaLM 2 Technical Reportcited by 1,154
  9. 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 882
  10. 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 647
  11. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
  12. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 375
24 more
  1. 2023PointLLM: Empowering Large Language Models to Understand Point Cloudscited by 326
  2. 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 257
  3. 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 152
  4. 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 117
  5. 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 116
  6. 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 106
  7. 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 90
  8. 2018Deep Part Induction from Articulated Object Pairscited by 66
  9. 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 66
  10. 2025SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agentcited by 53
  11. 2023CAGE: Controllable Articulation GEnerationcited by 50
  12. 2024MiniGPT-3D: Efficiently Aligning 3D Point Clouds with Large Language Models using 2D Priorscited by 48
  13. 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 41
  14. 2025PhysX-3D: Physical-Grounded 3D Asset Generationcited by 40
  15. 2023PartSLIP++: Enhancing Low-Shot 3D Part Segmentation via Multi-View Instance Segmentation and Maximum Likelihood Estimationcited by 37
  16. 2024LLplace: The 3D Indoor Scene Layout Generation and Editing via Large Language Modelcited by 34
  17. 2024Articulate your NeRF: Unsupervised articulated object modeling via conditional view synthesiscited by 24
  18. 2025URDF-Anything: Constructing Articulated Objects with 3D Multimodal Language Modelcited by 20
  19. 2025InternScenes: A Large-scale Simulatable Indoor Scene Dataset with Realistic Layoutscited by 18
  20. 2025Infinite Mobility: Scalable High-Fidelity Synthesis of Articulated Objects via Procedural Generationcited by 17
  21. 2025MesaTask: Towards Task-Driven Tabletop Scene Generation via 3D Spatial Reasoningcited by 15
  22. 2025OptiScene: LLM-driven Indoor Scene Layout Generation via Scaled Human-aligned Data Synthesis and Multi-Stage Preference Optimizationcited by 14
  23. 2024InfiniteWorld: A Unified Scalable Simulation Framework for General Visual-Language Robot Interactioncited by 13
  24. 2025Detection Based Part-level Articulated Object Reconstruction from Single RGBD Imagecited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.