GEAR: GEometry-motion Alternating Refinement for Articulated Object Modeling with Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
High-fidelity interactive digital assets are essential for embodied intelligence and robotic interaction, yet articulated objects remain challenging to reconstruct due to their complex structures and coupled geometry-motion relationships. Existing methods suffer from instability in geometry-motion joint optimization, while their generalization remains limited on complex multi-joint or out-of-distribution objects. To address these challenges, we propose GEAR, an EM-style alternating optimization framework that jointly models geometry and motion as interdependent components within a Gaussian Splatting representation. GEAR treats part segmentation as a latent variable and joint motion parameters as explicit variables, alternately refining them for improved convergence and geometric-motion consistency. To enhance part segmentation quality without sacrificing generalization, we leverage a vanilla 2D segmentation model to provide multi-view part priors, and employ a weakly supervised constraint to regularize the latent variable. Experiments on multiple benchmarks and our newly constructed dataset GEAR-Multi demonstrate that GEAR achieves state-of-the-art results in geometric reconstruction and motion parameters estimation, particularly on complex articulated objects with multiple movable parts.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 57 of its 63 references that are in the map. First posted on arXiv 9 Apr 2026.
Builds on
57 of 63 references.
References · 57
- 2023Segment Anythingcited by 8,195
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,170
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,706
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,150
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,070
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 756
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 735
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 644
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 588
- 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
- 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 370
38 more
- 2021A Survey of Embodied AI: From Simulators to Research Taskscited by 258
- 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 210
- 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 177
- 2019Category-Level Articulated Object Pose Estimationcited by 158
- 20243DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videoscited by 157
- 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 153
- 2023DynMF: Neural Motion Factorization for Real-time Dynamic View Synthesis with 3D Gaussian Splattingcited by 124
- 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 118
- 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 116
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 113
- 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 107
- 2023GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesiscited by 95
- 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 93
- 2024Neural Implicit Representation for Building Digital Twins of Unknown Articulated Objectscited by 67
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2018Deep Part Induction from Articulated Object Pairscited by 66
- 2024Real2Code: Reconstruct Articulated Objects via Code Generationcited by 66
- 2023CARTO: Category and Joint Agnostic Reconstruction of ARTiculated Objectscited by 64
- 2022CLA-NeRF: Category-Level Articulated Neural Radiance Fieldcited by 55
- 2022Self-supervised Neural Articulated Shape and Appearance Modelscited by 51
- 2024RoboGSim: A Real2Sim2Real Robotic Gaussian Splatting Simulatorcited by 51
- 2023SWinGS: Sliding Windows for Dynamic 3D Gaussian Splattingcited by 46
- 2023Ditto in the House: Building Articulation Models of Indoor Scenes through Interactive Perceptioncited by 40
- 2025ArticulatedGS: Self-supervised Digital Twin Modeling of Articulated Objects using 3D Gaussian Splattingcited by 35
- 2023Building Rearticulable Models for Arbitrary 3D Objects from 4D Point Cloudscited by 34
- 2024GS-Planner: A Gaussian-Splatting-based Planning Framework for Active High-Fidelity Reconstructioncited by 30
- 2025DRAWER: Digital Reconstruction and Articulation With Environment Realismcited by 29
- 2025REArtGS: Reconstructing and Generating Articulated Objects via 3D Gaussian Splatting with Geometric and Motion Constraintscited by 27
- 2024Articulate your NeRF: Unsupervised articulated object modeling via conditional view synthesiscited by 24
- 2025GaussianArt: Unified Modeling of Geometry and Motion for Articulated Objectscited by 17
- 2024LEIA: Latent View-invariant Embeddings for Implicit 3D Articulationcited by 16
- 2025PartRM: Modeling Part-Level Dynamics with Large Cross-State Reconstruction Modelcited by 15
- 2025Detection Based Part-level Articulated Object Reconstruction from Single RGBD Imagecited by 13
- 2025SplArt: Articulation Estimation and Part-Level Reconstruction with 3D Gaussian Splattingcited by 13
- 2021Unsupervised Pose-Aware Part Decomposition for 3D Articulated Objectscited by 12
- 2024HGS-Mapping: Online Dense Mapping Using Hybrid Gaussian Representation in Urban Scenescited by 11
- 2025IAAO: Interactive Affordance Learning for Articulated Objects in 3D Environmentscited by 11
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.