CAOA -- Completion-Assisted Object-CAD Alignment
Not on the map. Why?
Abstract (arXiv)
Accurately aligning CAD models to their corresponding objects in indoor RGB-D scans is a central challenge in 3D semantic reconstruction. The task requires estimating a 9-Degree-of-Freedom (DoF) pose-position, rotation, and scale along three axes-but is hindered by noisy and incomplete scans, as well as segmentation errors that cause geometric distortions. We present Completion-Assisted Object-CAD Alignment (CAOA), a method that integrates a semantically and contextually aware point cloud completion module with a symmetry-aware relative pose estimation algorithm, enabling precise alignment of CAD models to scanned objects. Existing completion methods are typically trained and evaluated on synthetic datasets, which often fail to generalize to real-world scans. To bridge this gap, we introduce a synthetic data generation strategy tailored to indoor scenes, significantly reducing the synthetic-to-real domain gap-validated through quantitative comparisons with widely used completion datasets. In addition, we release S2C-Completion, an expert-annotated dataset of over 8,500 object-CAD pairs from Scan2CAD, created for real-world indoor single-object completion and intended as a new benchmark for this task. For object-CAD alignment, we incorporate symmetry information via a symmetry-aware loss, improving robustness to symmetric ambiguities. On the Scan2CAD benchmark, CAOA achieves a 17% accuracy improvement over state-of-the-art methods.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 43 references that are in the map. First posted on arXiv 16 Jun 2026.
Builds on
27 of 43 references.
References · 27
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 579
- 2016Semantic Scene Completion from a Single Depth Imagecited by 468
- 2018PCN: Point Completion Networkcited by 382
- 20163DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructionscited by 333
- 2021PoinTr: Diverse Point Cloud Completion with Geometry-Aware Transformerscited by 284
- 2016Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesiscited by 219
- 2018Pix3D: Dataset and Methods for Single-Image 3D Shape Modelingcited by 218
- 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
15 more
- 2022SoftGroup for 3D Instance Segmentation on Point Cloudscited by 197
- 2018Scan2CAD: Learning CAD Model Alignment in RGB-D Scanscited by 142
- 2016BundleFusion: Real-time Globally Consistent 3D Reconstruction using On-the-fly Surface Re-integrationcited by 116
- 2020SceneCAD: Predicting Object Alignments and Layouts in RGB-D Scanscited by 44
- 2021Joint Learning of 3D Shape Retrieval and Deformationcited by 41
- 2018Learning 3D Shape Completion under Weak Supervisioncited by 40
- 2019End-to-End CAD Model Retrieval and 9DoF Alignment in 3D Scanscited by 40
- 2020Deep Octree-based CNNs with Output-Guided Skip Connections for 3D Shape and Scene Completioncited by 33
- 2021RetrievalFuse: Neural 3D Scene Reconstruction with a Databasecited by 28
- 2023Spherical Mask: Coarse-to-Fine 3D Point Cloud Instance Segmentation with Spherical Representationcited by 23
- 2023U-RED: Unsupervised 3D Shape Retrieval and Deformation for Partial Point Cloudscited by 11
- 2022Automatically Annotating Indoor Images with CAD Models via RGB-D Scanscited by 9
- 2021What's Behind the Couch? Directed Ray Distance Functions (DRDF) for 3D Scene Reconstructioncited by 7
- 2024FastCAD: Real-Time CAD Retrieval and Alignment from Scans and Videoscited by 7
- 2024KP-RED: Exploiting Semantic Keypoints for Joint 3D Shape Retrieval and Deformationcited by 6
Built on by
Not cited yet.