Articulation in Prime: Primitive-Based Articulated Object Understanding from a Single Casual Video
Not on the map. Why?
Abstract (arXiv)
Retrieving the 3D kinematics of articulated objects from monocular video is a fundamental challenge in computer vision. Existing methods rely on complex video setups or cues such as long-term point tracking or wide-baseline matching, but are frequently brittle under severe occlusions, rapid camera ego-motion, or weak local features. Learning-based methods, meanwhile, struggle to generalize beyond their training categories. We propose a category-agnostic optimization framework that treats articulated object understanding as a primitive-fitting problem. Geometric primitives serve as a proxy representation that avoids the pitfalls of unstable point tracks; a novel mechanism organizes them into coherent parts constrained by revolute and prismatic joints. Our formulation jointly optimizes part segmentation and joint parameters, recovering complex kinematics from a single casually captured video. A visibility-aware procedure handles partial observations and occlusions inherent to real-world data. We also propose the AiP-synth and AiP-real benchmarks, featuring significant camera motion and heavy occlusions, and outperform existing methods. Project page: https://aartykov.github.io/Articulation-in-Prime/
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 42 of its 50 references that are in the map. First posted on arXiv 18 May 2026.
Builds on
42 of 50 references.
References · 42
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
- 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 521
- 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 490
- 2020Modular Primitives for High-Performance Differentiable Renderingcited by 439
- 2016Learning Shape Abstractions by Assembling Volumetric Primitivescited by 181
- 2019CvxNet: Learnable Convex Decompositioncited by 173
30 more
- 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 162
- 2019Category-Level Articulated Object Pose Estimationcited by 158
- 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 152
- 2019Superquadrics Revisited: Learning 3D Shape Parsing beyond Cuboidscited by 123
- 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 115
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 113
- 2021Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networkscited by 101
- 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 90
- 2021CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Cloudscited by 83
- 2024Neural Implicit Representation for Building Digital Twins of Unknown Articulated Objectscited by 67
- 2024Robot See Robot Do: Imitating Articulated Object Manipulation with Monocular 4D Reconstructioncited by 51
- 2021Watch It Move: Unsupervised Discovery of 3D Joints for Re-Posing of Articulated Objectscited by 50
- 2024REACTO: Reconstructing Articulated Objects from a Single Videocited by 45
- 2021Unsupervised Learning for Cuboid Shape Abstraction via Joint Segmentation from Point Cloudscited by 44
- 2023Differentiable Blocks World: Qualitative 3D Decomposition by Rendering Primitivescited by 37
- 2023Building Rearticulable Models for Arbitrary 3D Objects from 4D Point Cloudscited by 34
- 2021Robust and Accurate Superquadric Recovery: a Probabilistic Approachcited by 29
- 2025REArtGS: Reconstructing and Generating Articulated Objects via 3D Gaussian Splatting with Geometric and Motion Constraintscited by 27
- 2025SuperDec: 3D Scene Decomposition with Superquadric Primitivescited by 19
- 2020Self-Supervised Learning of Part Mobility from Point Cloud Sequencecited by 18
- 2023Marching-Primitives: Shape Abstraction from Signed Distance Functioncited by 18
- 2025iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videoscited by 18
- 2025Articulated Object Estimation in the Wildcited by 18
- 2023GMSF: Global Matching Scene Flowcited by 14
- 2023Multi-body SE(3) Equivariance for Unsupervised Rigid Segmentation and Motion Estimationcited by 7
- 2026Articulation in Motion: Prior-free Part Mobility Analysis for Articulated Objects By Dynamic-Static Disentanglementcited by 6
- 2025Part Segmentation and Motion Estimation for Articulated Objects with Dynamic 3D Gaussianscited by 5
- 2025Residual Primitive Fitting of 3D Shapes with SuperFrustacited by 5
- 2022H-SAUR: Hypothesize, Simulate, Act, Update, and Repeat for Understanding Object Articulations from Interactionscited by 3
- 2026FreeArtGS: Articulated Gaussian Splatting Under Free-moving Scenariocited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.