mlsanityData to 7 Oct 2026

Object Agnostic 3D Lifting in Space and Time

arXiv 2412.01166 ↗First posted 2 Dec 2024cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

We present a spatio-temporal perspective on category-agnostic 3D lifting of 2D keypoints over a temporal sequence. Our approach differs from existing state-of-the-art methods that are either: (i) object-agnostic, but can only operate on individual frames, or (ii) can model space-time dependencies, but are only designed to work with a single object category. Our approach is grounded in two core principles. First, general information about similar objects can be leveraged to achieve better performance when there is little object-specific training data. Second, a temporally-proximate context window is advantageous for achieving consistency throughout a sequence. These two principles allow us to outperform current state-of-the-art methods on per-frame and per-sequence metrics for a variety of animal categories. Lastly, we release a new synthetic dataset containing 3D skeletons and motion sequences for a variety of animal categories.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 36 references that are in the map. First posted on arXiv 2 Dec 2024.

Builds on

19 of 36 references.

References · 19

  1. 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 450
  2. 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 274
  3. 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 258
  4. 2018Markerless tracking of user-defined features with deep learningcited by 203
  5. 20193D Hand Shape and Pose Estimation from a Single RGB Imagecited by 174
  6. 2023DynamicStereo: Consistent Dynamic Depth from Stereo Videoscited by 147
  7. 2019Camera Distance-aware Top-down Approach for 3D Multi-person Pose Estimation from a Single RGB Imagecited by 131
  8. 20214DComplete: Non-Rigid Motion Estimation Beyond the Observable Surfacecited by 123
  9. 2018Ordinal Depth Supervision for 3D Human Pose Estimationcited by 107
  10. 2017Exploiting temporal information for 3D pose estimationcited by 89
  11. 2019C3DPO: Canonical 3D Pose Networks for Non-Rigid Structure From Motioncited by 60
  12. 2023Animal3D: A Comprehensive Dataset of 3D Animal Pose and Shapecited by 43
7 more
  1. 2019Deep Non-Rigid Structure from Motioncited by 38
  2. 20163D Human Pose Estimation Using Convolutional Neural Networks with 2D Pose Informationcited by 28
  3. 2019PoseLifter: Absolute 3D human pose lifting network from a single noisy 2D human posecited by 10
  4. 2021PAUL: Procrustean Autoencoder for Unsupervised Liftingcited by 9
  5. 20233D-LFM: Lifting Foundation Modelcited by 8
  6. 2023Unsupervised 3D Pose Estimation with Non-Rigid Structure-from-Motion Modelingcited by 7
  7. 2023Robust Point Cloud Processing through Positional Embeddingcited by 5

Built on by

Not cited yet.