FreeArtGS: Articulated Gaussian Splatting Under Free-moving Scenario
Not on the map. Why?
Abstract (arXiv)
The increasing demand for augmented reality and robotics is driving the need for articulated object reconstruction with high scalability. However, existing settings for reconstructing from discrete articulation states or casual monocular videos require non-trivial axis alignment or suffer from insufficient coverage, limiting their applicability. In this paper, we introduce FreeArtGS, a novel method for reconstructing articulated objects under free-moving scenario, a new setting with a simple setup and high scalability. FreeArtGS combines free-moving part segmentation with joint estimation and end-to-end optimization, taking only a monocular RGB-D video as input. By optimizing with the priors from off-the-shelf point-tracking and feature models, the free-moving part segmentation module identifies rigid parts from relative motion under unconstrained capture. The joint estimation module calibrates the unified object-to-camera poses and recovers joint type and axis robustly from part segmentation. Finally, 3DGS-based end-to-end optimization is implemented to jointly reconstruct visual textures, geometry, and joint angles of the articulated object. We conduct experiments on two benchmarks and real-world free-moving articulated objects. Experimental results demonstrate that FreeArtGS consistently excels in reconstructing free-moving articulated objects and remains highly competitive in previous reconstruction settings, proving itself a practical and effective solution for realistic asset generation. The project page is available at: https://freeartgs.github.io/
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 46 of its 48 references that are in the map. First posted on arXiv 23 Mar 2026.
Builds on
46 of 48 references.
References · 46
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2024GPT-4o System Cardcited by 4,467
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025DINOv3cited by 1,297
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 596
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
34 more
- 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 210
- 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 152
- 2023BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objectscited by 144
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 135
- 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 115
- 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 106
- 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 90
- 2025SpatialTrackerV2: 3D Point Tracking Made Easycited by 84
- 2024Align3R: Aligned Monocular Depth Estimation for Dynamic Videoscited by 79
- 2024Neural Implicit Representation for Building Digital Twins of Unknown Articulated Objectscited by 67
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2025TAPIP3D: Tracking Any Point in Persistent 3D Geometrycited by 67
- 2023CARTO: Category and Joint Agnostic Reconstruction of ARTiculated Objectscited by 64
- 2024Real2Code: Reconstruct Articulated Objects via Code Generationcited by 64
- 2024DELTA: Dense Efficient Long-range 3D Tracking for any videocited by 62
- 2025AllTracker: Efficient Dense Point Tracking at High Resolutioncited by 54
- 2024Robot See Robot Do: Imitating Articulated Object Manipulation with Monocular 4D Reconstructioncited by 51
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 41
- 2023OPDMulti: Openable Part Detection for Multiple Objectscited by 38
- 2022Understanding 3D Object Articulation in Internet Videoscited by 36
- 2025ArticulatedGS: Self-supervised Digital Twin Modeling of Articulated Objects using 3D Gaussian Splattingcited by 35
- 2025DRAWER: Digital Reconstruction and Articulation With Environment Realismcited by 29
- 2025REArtGS: Reconstructing and Generating Articulated Objects via 3D Gaussian Splatting with Geometric and Motion Constraintscited by 27
- 2025Uni4D: Unifying Visual Foundation Models for 4D Modeling from a Single Videocited by 27
- 2025iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videoscited by 18
- 2025Multi-View 3D Point Trackingcited by 17
- 2025ArtVIP: Articulated Digital Assets of Visual Realism, Modular Interaction, and Physical Fidelity for Robot Learningcited by 14
- 2025Detection Based Part-level Articulated Object Reconstruction from Single RGBD Imagecited by 13
- 2025SplArt: Articulation Estimation and Part-Level Reconstruction with 3D Gaussian Splattingcited by 13
- 2025ArtGS:3D Gaussian Splatting for Interactive Visual-Physical Modeling and Manipulation of Articulated Objectscited by 11
- 2025Predict-Optimize-Distill: A Self-Improving Cycle for 4D Object Understandingcited by 8
- 2025MonoMobility: Zero-Shot 3D Mobility Analysis from Monocular Videoscited by 6
- 2024SM3: Self-Supervised Multi-task Modeling with Multi-view 2D Images for Articulated Objectscited by 5
- 2024RPMArt: Towards Robust Perception and Manipulation for Articulated Objectscited by 5
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Track2Art: Articulated Object Model Recovery with Visual-Geometric Track Representations23 Sep 2026
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observations17 Sep 2026
- 2026Articulation in Prime: Primitive-Based Articulated Object Understanding from a Single Casual Video18 May 2026