mlsanityData to 14 Oct 2026

Category-Level 3D Correspondence in Camera Space via Morphable Object Priors

arXiv 2605.28257 ↗First posted 27 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Understanding 3D objects from images is fundamental to robotics and AR/VR applications. While recent work has made progress in category-level pose estimation, current representations fail to capture the fine-grained semantics needed for reasoning about object parts, functions, and interactions. In this work, we study category-level 3D correspondence in camera space -- predicting, from a single image, 3D locations that remain consistent across instances within a category -- and show that it can emerge without explicit correspondence supervision by learning a shared morphable object prior. To enable research in this direction, we introduce HouseCorr3D, the first large-scale benchmark for monocular category-level 3D correspondence with 178k images across 50 household object categories, 280 unique instances, and 3D keypoint annotations directly on CAD models. Crucially, HouseCorr3D provides amodal correspondence labels for occluded regions and explicit symmetry annotations, addressing key limitations of existing datasets. We further propose Morpheus, a method that learns morphable category-level shape priors by disentangling canonical shape, deformation, and object pose. Through this shared canonical grounding, semantically meaningful 3D correspondences in camera space emerge implicitly. These emerging 3D correspondences set a new state of the art on HouseCorr3D, demonstrating that semantic 3D object understanding can arise without direct correspondence supervision. Data and code are publicly available at https://github.com/GenIntel/HouseCorr3D.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 48 of its 66 references that are in the map. First posted on arXiv 27 May 2026.

Builds on

48 of 66 references.

References · 48

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  5. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  6. 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
  7. 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 903
  8. 2020Implicit Geometric Regularization for Learning Shapescited by 710
  9. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
  10. 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 651
  11. 2018DensePose: Dense Human Pose Estimation In The Wildcited by 575
  12. 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
36 more
  1. 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 495
  2. 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
  3. 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 301
  4. 2014Detect What You Can: Detecting and Representing Objects using Holistic Models and Body Partscited by 232
  5. 2018Pix3D: Dataset and Methods for Single-Image 3D Shape Modelingcited by 218
  6. 2021COTR: Correspondence Transformer for Matching Across Imagescited by 183
  7. 2020Shape Prior Deformation for Categorical 6D Object Pose and Size Estimationcited by 161
  8. 20183D-CODED : 3D Correspondences by Deep Deformationcited by 160
  9. 2022Omni3D: A Large Benchmark and Model for 3D Object Detection in the Wildcited by 160
  10. 2019SPair-71k: A Large-scale Benchmark for Semantic Correspondencecited by 146
  11. 2021LASR: Learning Articulated Shape Reconstruction from a Monocular Videocited by 116
  12. 2022MagicPony: Learning Articulated 3D Animals in the Wildcited by 112
  13. 2019Neural Cages for Detail-Preserving 3D Deformationscited by 106
  14. 2020Deep Implicit Templates for 3D Shape Representationcited by 86
  15. 2018Discovery of Latent 3D Keypoints via End-to-end Geometric Reasoningcited by 79
  16. 2019Canonical Surface Mapping via Geometric Cycle Consistencycited by 63
  17. 2019C3DPO: Canonical 3D Pose Networks for Non-Rigid Structure From Motioncited by 61
  18. 2021DOVE: Learning Deformable 3D Objects by Watching Videoscited by 61
  19. 2022Category-Level 6D Object Pose Estimation in the Wild: A Semi-Supervised Learning Approach and A New Datasetcited by 59
  20. 2020KeypointNet: A Large-scale 3D Keypoint Dataset Aggregated from Numerous Human Annotationscited by 51
  21. 2021KeypointDeformer: Unsupervised 3D Keypoint Discovery for Shape Controlcited by 51
  22. 2017Proposal Flow: Semantic Correspondences from Object Proposalscited by 47
  23. 2023Animal3D: A Comprehensive Dataset of 3D Animal Pose and Shapecited by 44
  24. 2020Learning 3D Dynamic Scene Representations for Robot Manipulationcited by 39
  25. 2023Improving Semantic Correspondence with Viewpoint-Guided Spherical Mapscited by 34
  26. 2024DenseMatcher: Learning 3D Semantic Correspondence for Category-Level Manipulation from a Single Democited by 34
  27. 2021Differentiable Stereopsis: Meshes from multiple views using differentiable renderingcited by 26
  28. 2024OmniNOCS: A unified NOCS dataset and model for 3D lifting of 2D objectscited by 22
  29. 2023Diffusion Model for Dense Matchingcited by 21
  30. 2024MeshUp: Multi-Target Mesh Deformation via Blended Score Distillationcited by 17
  31. 2025Do It Yourself: Learning Semantic Correspondence from Pseudo-Labelscited by 13
  32. 2024SHIC: Shape-Image Correspondences with no Keypoint Supervisioncited by 12
  33. 2025Common3D: Self-Supervised Learning of 3D Morphable Models for Common Objects in Neural Feature Spacecited by 9
  34. 2025SemAlign3D: Semantic Correspondence between RGB-Images through Aligning 3D Object-Class Representationscited by 7
  35. 2023SimSC: A Simple Framework for Semantic Correspondence with Temperature Learningcited by 6
  36. 2021Understanding Pixel-level 2D Image Semantics with 3D Keypoint Knowledge Enginecited by 2

Built on by

Not cited yet.