3D-RelNet: Joint Object and Relational Network for 3D Prediction
Not on the map. Why?
Abstract (arXiv)
We propose an approach to predict the 3D shape and pose for the objects present in a scene. Existing learning based methods that pursue this goal make independent predictions per object, and do not leverage the relationships amongst them. We argue that reasoning about these relationships is crucial, and present an approach to incorporate these in a 3D prediction framework. In addition to independent per-object predictions, we predict pairwise relations in the form of relative 3D pose, and demonstrate that these can be easily incorporated to improve object level estimates. We report performance across different datasets (SUNCG, NYUv2), and show that our approach significantly improves over independent prediction approaches while also outperforming alternate implicit reasoning methods.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 10; 2023: 4; 2024: 7.
28 papers.
Sort:
By area:
- 2022Omni3D: A Large Benchmark and Model for 3D Object Detection in the Wildcited by 159
- 2021ROCA: Robust CAD Model Retrieval and Alignment from a Single Imagecited by 66
- 2024Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single Viewcited by 59
- 2022Few-View Object Reconstruction with Unknown Categories and Camera Posescited by 53
- 2022Towards High-Fidelity Single-view Holistic Reconstruction of Indoor Scenescited by 43
- 2021Planar Surface Reconstruction from Sparse Viewscited by 40
- 2021D3D-HOI: Dynamic 3D Human-Object Interactions from Videoscited by 39
- 2022Understanding 3D Object Articulation in Internet Videoscited by 36
- 2022Compositional Scene Representation Learning via Reconstruction: A Surveycited by 27
- 20213DP3: 3D Scene Perception via Probabilistic Programmingcited by 26
- 20233DiffTection: 3D Object Detection with Geometry-Aware Diffusion Featurescited by 26
- 2022Virtual Correspondence: Humans as a Cue for Extreme-View Geometrycited by 25
16 more
- 2022Bending Graphs: Hierarchical Shape Matching using Gated Optimal Transportcited by 24
- 2021Monte Carlo Scene Search for 3D Scene Understandingcited by 19
- 2024RelationField: Relate Anything in Radiance Fieldscited by 16
- 2022ARM3D: Attention-based relation module for indoor 3D object detectioncited by 11
- 2021IFR-Explore: Learning Inter-object Functional Relationships in 3D Indoor Scenescited by 9
- 2024Coherent 3D Scene Diffusion From a Single RGB Imagecited by 8
- 2021What's Behind the Couch? Directed Ray Distance Functions (DRDF) for 3D Scene Reconstructioncited by 7
- 20243DFIRES: Few Image 3D REconstruction for Scenes with Hidden Surfacecited by 6
- 2024V-MIND: Building Versatile Monocular Indoor 3D Detector with Diverse 2D Annotationscited by 4
- 2023GeoScaler: Geometry and Rendering-Aware Downsampling of 3D Mesh Texturescited by 3
- 2023Learning to Predict Scene-Level Implicit 3D from Posed RGBD Datacited by 2
- 2024CatFree3D: Category-agnostic 3D Object Detection with Diffusioncited by 2
- 20223DRM:Pair-wise relation module for 3D object detectioncited by 1
- 2022Review on 6D Object Pose Estimation with the focus on Indoor Scene Understandingcited by 0
- 2023Explicit3D: Graph Network with Spatial Inference for Single Image 3D Object Detectioncited by 0
- 2024Single-image coherent reconstruction of objects and humanscited by 0
- 2024RelationField: Relate Anything in Radiance Fields18 Dec 2024
- 2024V-MIND: Building Versatile Monocular Indoor 3D Detector with Diverse 2D Annotations16 Dec 2024
- 2024Coherent 3D Scene Diffusion From a Single RGB Image13 Dec 2024
- 2024CatFree3D: Category-agnostic 3D Object Detection with Diffusion22 Aug 2024
- 2024Single-image coherent reconstruction of objects and humans15 Aug 2024
- 2024Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single View4 Apr 2024
- 20243DFIRES: Few Image 3D REconstruction for Scenes with Hidden Surface13 Mar 2024
- 2023GeoScaler: Geometry and Rendering-Aware Downsampling of 3D Mesh Textures28 Nov 2023
- 20233DiffTection: 3D Object Detection with Geometry-Aware Diffusion Features7 Nov 2023
- 2023Learning to Predict Scene-Level Implicit 3D from Posed RGBD Data14 Jun 2023
- 2023Explicit3D: Graph Network with Spatial Inference for Single Image 3D Object Detection13 Feb 2023
- 2022Few-View Object Reconstruction with Unknown Categories and Camera Poses8 Dec 2022
16 more
- 2022Review on 6D Object Pose Estimation with the focus on Indoor Scene Understanding4 Dec 2022
- 2022Omni3D: A Large Benchmark and Model for 3D Object Detection in the Wild21 Jul 2022
- 2022Towards High-Fidelity Single-view Holistic Reconstruction of Indoor Scenes18 Jul 2022
- 2022Virtual Correspondence: Humans as a Cue for Extreme-View Geometry16 Jun 2022
- 2022Understanding 3D Object Articulation in Internet Videos30 Mar 2022
- 20223DRM:Pair-wise relation module for 3D object detection20 Feb 2022
- 2022ARM3D: Attention-based relation module for indoor 3D object detection20 Feb 2022
- 2022Compositional Scene Representation Learning via Reconstruction: A Survey15 Feb 2022
- 2022Bending Graphs: Hierarchical Shape Matching using Gated Optimal Transport3 Feb 2022
- 2021IFR-Explore: Learning Inter-object Functional Relationships in 3D Indoor Scenes10 Dec 2021
- 2021What's Behind the Couch? Directed Ray Distance Functions (DRDF) for 3D Scene Reconstruction8 Dec 2021
- 2021ROCA: Robust CAD Model Retrieval and Alignment from a Single Image3 Dec 2021
- 20213DP3: 3D Scene Perception via Probabilistic Programming30 Oct 2021
- 2021D3D-HOI: Dynamic 3D Human-Object Interactions from Videos19 Aug 2021
- 2021Planar Surface Reconstruction from Sparse Views26 Mar 2021
- 2021Monte Carlo Scene Search for 3D Scene Understanding14 Mar 2021
- 2024RelationField: Relate Anything in Radiance Fieldscited by 16
- 2024RelationField: Relate Anything in Radiance Fields18 Dec 2024
- 2022Omni3D: A Large Benchmark and Model for 3D Object Detection in the Wildcited by 159
- 2021ROCA: Robust CAD Model Retrieval and Alignment from a Single Imagecited by 66
- 2024Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single Viewcited by 59
- 2022Few-View Object Reconstruction with Unknown Categories and Camera Posescited by 53
- 2022Towards High-Fidelity Single-view Holistic Reconstruction of Indoor Scenescited by 43
- 2021Planar Surface Reconstruction from Sparse Viewscited by 40
- 2021D3D-HOI: Dynamic 3D Human-Object Interactions from Videoscited by 39
- 2022Understanding 3D Object Articulation in Internet Videoscited by 36
- 2022Compositional Scene Representation Learning via Reconstruction: A Surveycited by 27
- 20213DP3: 3D Scene Perception via Probabilistic Programmingcited by 26
- 2022Virtual Correspondence: Humans as a Cue for Extreme-View Geometrycited by 25
- 2022Bending Graphs: Hierarchical Shape Matching using Gated Optimal Transportcited by 24
12 most cited of 26 All 26 (JSON)
- 2024V-MIND: Building Versatile Monocular Indoor 3D Detector with Diverse 2D Annotations16 Dec 2024
- 2024Coherent 3D Scene Diffusion From a Single RGB Image13 Dec 2024
- 2024CatFree3D: Category-agnostic 3D Object Detection with Diffusion22 Aug 2024
- 2024Single-image coherent reconstruction of objects and humans15 Aug 2024
- 2024Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single View4 Apr 2024
- 20243DFIRES: Few Image 3D REconstruction for Scenes with Hidden Surface13 Mar 2024
- 2023GeoScaler: Geometry and Rendering-Aware Downsampling of 3D Mesh Textures28 Nov 2023
- 2023Learning to Predict Scene-Level Implicit 3D from Posed RGBD Data14 Jun 2023
- 2023Explicit3D: Graph Network with Spatial Inference for Single Image 3D Object Detection13 Feb 2023
- 2022Few-View Object Reconstruction with Unknown Categories and Camera Poses8 Dec 2022
- 2022Review on 6D Object Pose Estimation with the focus on Indoor Scene Understanding4 Dec 2022
- 2022Omni3D: A Large Benchmark and Model for 3D Object Detection in the Wild21 Jul 2022
12 newest of 26 All 26 (JSON)