mlsanityData to 7 Oct 2026

Understanding 3D Object Articulation in Internet Videos

arXiv 2203.16531 ↗First posted 30 Mar 2022cs.CVcited by 36

Not on the map. Why?

Abstract (arXiv)

We propose to investigate detecting and characterizing the 3D planar articulation of objects from ordinary videos. While seemingly easy for humans, this problem poses many challenges for computers. We propose to approach this problem by combining a top-down detection system that finds planes that can be articulated along with an optimization approach that solves for a 3D plane that can explain a sequence of observed articulations. We show that this system can be trained on a combination of videos and 3D scan datasets. When tested on a dataset of challenging Internet videos and the Charades dataset, our approach obtains strong performance. Project site: https://jasonqsy.github.io/Articulation3D

Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). Builds on 52 of its 73 references that are in the map. First posted on arXiv 30 Mar 2022.

Builds on

52 of 73 references.

References · 52

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  3. 2017Mask R-CNNcited by 7,259
  4. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  5. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  6. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  7. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  8. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
  9. 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 789
  10. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
  11. 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 587
  12. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
38 more
  1. 2018From Recognition to Cognition: Visual Commonsense Reasoningcited by 553
  2. 2016Hollywood in Homes: Crowdsourcing Data Collection for Activity Understandingcited by 535
  3. 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 501
  4. 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
  5. 2019PointRend: Image Segmentation as Renderingcited by 439
  6. 2017Learning from Synthetic Humanscited by 358
  7. 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 334
  8. 2020Understanding Human Hands in Contact at Internet Scalecited by 281
  9. 2017Detecting and Recognizing Human-Object Interactionscited by 199
  10. 2021Where2Act: From Pixels to Actions for Articulated 3D Objectscited by 179
  11. 2016Learning a Predictable and Generative Vector Representation for Objectscited by 173
  12. 2020Total3DUnderstanding: Joint Layout, Object Pose and Mesh Reconstruction for Indoor Scenes from a Single Imagecited by 170
  13. 2019Category-Level Articulated Object Pose Estimationcited by 158
  14. 2020Rearrangement: A Challenge for Embodied AIcited by 153
  15. 2019Shape2Motion: Joint Analysis of Motion Parts and Attributes from 3D Shapescited by 117
  16. 2020Exemplar Fine-Tuning for 3D Human Model Fitting Towards In-the-Wild 3D Human Pose Estimationcited by 113
  17. 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 113
  18. 2018PlaneRCNN: 3D Plane Detection and Reconstruction from a Single Imagecited by 105
  19. 2020Articulation-aware Canonical Surface Mappingcited by 80
  20. 2018PlaneNet: Piece-wise Planar Reconstruction from a Single RGB Imagecited by 77
  21. 2018TernausNet: U-Net with VGG11 Encoder Pre-Trained on ImageNet for Image Segmentationcited by 76
  22. 2020ScrewNet: Category-Independent Articulation Model Estimation From Depth Images Using Screw Theorycited by 70
  23. 2020OASIS: A Large-Scale Dataset for Single Image 3D in the Wildcited by 62
  24. 2014Designing Deep Networks for Surface Normal Estimationcited by 59
  25. 2019Single-Image Piece-wise Planar 3D Reconstruction via Associative Embeddingcited by 56
  26. 2019Predicting 3D Human Dynamics from Videocited by 51
  27. 2017Factoring Shape, Pose, and Layout from the 2D Image of a 3D Scenecited by 50
  28. 2017From Lifestyle Vlogs to Everyday Interactionscited by 42
  29. 2020Deep Hough Transform for Semantic Line Detectioncited by 42
  30. 2014A Probabilistic Framework for Learning Kinematic Models of Articulated Objectscited by 40
  31. 2021Planar Surface Reconstruction from Sparse Viewscited by 40
  32. 2021Towards Real-World Category-level Articulation Pose Estimationcited by 39
  33. 2021D3D-HOI: Dynamic 3D Human-Object Interactions from Videoscited by 39
  34. 2015Actions ~ Transformationscited by 30
  35. 2020Full-Body Awareness from Partial Observationscited by 29
  36. 20193D-RelNet: Joint Object and Relational Network for 3D Predictioncited by 28
  37. 2020Associative3D: Volumetric Reconstruction from Sparse Viewscited by 18
  38. 2015Learning Articulated Motions From Visual Demonstrationcited by 17

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 4; 2023: 5; 2024: 8; 2025: 12; 2026: 7.

36 papers.

Sort:

By area:

  1. 2024GenAD: Generalized Predictive Model for Autonomous Drivingcited by 150
  2. 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 106
  3. 2022Full-Body Articulated Human-Object Interactioncited by 76
  4. 2023OPDMulti: Openable Part Detection for Multiple Objectscited by 38
  5. 2023Building Rearticulable Models for Arbitrary 3D Objects from 4D Point Cloudscited by 34
  6. 2023Understanding 3D Object Interaction from a Single Imagecited by 33
  7. 2025DRAWER: Digital Reconstruction and Articulation With Environment Realismcited by 29
  8. 2024Articulate your NeRF: Unsupervised articulated object modeling via conditional view synthesiscited by 24
  9. 2024S2O: Static to Openable Enhancement for Articulated 3D Objectscited by 22
  10. 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusioncited by 22
  11. 2025GaussianArt: Unified Modeling of Geometry and Motion for Articulated Objectscited by 17
  12. 2024LEIA: Latent View-invariant Embeddings for Implicit 3D Articulationcited by 16
24 more
  1. 2024Exploring Low-Dimensional Subspaces in Diffusion Models for Controllable Image Editingcited by 15
  2. 2024Survey on Modeling of Human-made Articulated Objectscited by 14
  3. 2025LARM: A Large Articulated-Object Reconstruction Modelcited by 12
  4. 2025IAAO: Interactive Affordance Learning for Articulated Objects in 3D Environmentscited by 11
  5. 2025RAGNet: Large-scale Reasoning-based Affordance Segmentation Benchmark towards General Graspingcited by 11
  6. 2024Articulate3D: Holistic Understanding of 3D Scenes as Universal Scene Descriptioncited by 9
  7. 20252HandedAfforder: Learning Precise Actionable Bimanual Affordances from Human Videoscited by 9
  8. 2025ART: Articulated Reconstruction Transformercited by 9
  9. 2022Articulated 3D Human-Object Interactions from RGB Videos: An Empirical Analysis of Approaches and Challengescited by 8
  10. 2022Neural Shape Compiler: A Unified Framework for Transforming between Text, Point Cloud, and Programcited by 6
  11. 2023RoSI: Recovering 3D Shape Interiors from Few Articulation Imagescited by 6
  12. 2025MonoMobility: Zero-Shot 3D Mobility Analysis from Monocular Videoscited by 6
  13. 2026Articulation in Motion: Prior-free Part Mobility Analysis for Articulated Objects By Dynamic-Static Disentanglementcited by 6
  14. 2022Structure from Action: Learning Interactions for Articulated Object 3D Structure Discoverycited by 4
  15. 2026FreeArtGS: Articulated Gaussian Splatting Under Free-moving Scenariocited by 3
  16. 2025DYNAMO: Dependency-Aware Deep Learning Framework for Articulated Assembly Motion Predictioncited by 2
  17. 2025PAOLI: Pose-free Articulated Object Learning from Sparse-view Imagescited by 1
  18. 2026ArtPro: Self-Supervised Articulated Object Reconstruction with Adaptive Integration of Mobility Proposalscited by 1
  19. 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videoscited by 1
  20. 2026Improving and Evaluating Hand-Object Interaction Detectioncited by 1
  21. 2026UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Imagecited by 1
  22. 2023Local Region-to-Region Mapping-based Approach to Classify Articulated Objectscited by 0
  23. 2025ArtReg: Visuo-Tactile based Pose Tracking and Manipulation of Unseen Articulated Objectscited by 0
  24. 2026ArtHOI: Articulated Human-Object Interaction Synthesis by 4D Reconstruction from Video Priorscited by 0