FCAF3D: Fully Convolutional Anchor-Free 3D Object Detection
Not on the map. Why?
Abstract (arXiv)
Recently, promising applications in robotics and augmented reality have attracted considerable attention to 3D object detection from point clouds. In this paper, we present FCAF3D - a first-in-class fully convolutional anchor-free indoor 3D object detection method. It is a simple yet effective method that uses a voxel representation of a point cloud and processes voxels with sparse convolutions. FCAF3D can handle large-scale scenes with minimal runtime through a single fully convolutional feed-forward pass. Existing 3D object detection methods make prior assumptions on the geometry of objects, and we argue that it limits their generalization ability. To get rid of any prior assumptions, we propose a novel parametrization of oriented bounding boxes that allows obtaining better results in a purely data-driven way. The proposed method achieves state-of-the-art 3D object detection results in terms of [email protected] on ScanNet V2 (+4.5), SUN RGB-D (+3.5), and S3DIS (+20.5) datasets. The code and models are available at https://github.com/samsunglabs/fcaf3d.
Key facts. Cited by 97 papers in the map (data through 7 Oct 2026). Builds on 27 of its 38 references that are in the map. First posted on arXiv 1 Dec 2021.
Builds on
27 of 38 references.
References · 27
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,573
- 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,379
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
- 2020Center-based 3D Object Detection and Trackingcited by 1,143
- 2019Deep Hough Voting for 3D Object Detection in Point Cloudscited by 648
- 2019Bridging the Gap Between Anchor-based and Anchor-free Detection via Adaptive Training Sample Selectioncited by 539
- 2021FCOS3D: Fully Convolutional One-Stage Monocular 3D Object Detectioncited by 444
15 more
- 2021An End-to-End Transformer Model for 3D Object Detectioncited by 329
- 20183D-SIS: 3D Semantic Instance Segmentation of RGB-D Scanscited by 216
- 2021Group-Free 3D Object Detection via Transformerscited by 215
- 2020SMOKE: Single-Stage Monocular 3D Object Detection via Keypoint Estimationcited by 202
- 2021OTA: Optimal Transport Assignment for Object Detectioncited by 177
- 2021ImVoxelNet: Image to Voxels Projection for Monocular and Multi-View General-Purpose 3D Object Detectioncited by 157
- 20203D-MPA: Multi Proposal Aggregation for 3D Semantic Instance Segmentationcited by 140
- 2019IoU Loss for 2D/3D Object Detectioncited by 128
- 2020H3DNet: 3D Object Detection Using Hybrid Geometric Primitivescited by 123
- 2020ImVoteNet: Boosting 3D Object Detection in Point Clouds with Image Votescited by 119
- 2020MLCVNet: Multi-Level Context VoteNet for 3D Object Detectioncited by 80
- 2020Generative Sparse Detection Networks for 3D Single-shot Object Detectioncited by 69
- 2021Back-tracing Representative Points for Voting-based 3D Object Detection in Point Cloudscited by 67
- 20163D Fully Convolutional Network for Vehicle Detection in Point Cloudcited by 57
- 2019Frustum VoxNet for 3D object detection from RGB-D or Depth imagescited by 8
Built on by
Citing papers per year: 2022: 11; 2023: 28; 2024: 25; 2025: 18; 2026: 15.
97 papers.
Sort:
By area:
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 325
- 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 299
- 2022Masked Discrimination for Self-Supervised Learning on Point Cloudscited by 155
- 2023EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AIcited by 146
- 2023Swin3D: A Pretrained Transformer Backbone for 3D Indoor Scene Understandingcited by 111
- 2023OctFormer: Octree-based Transformers for 3D Point Cloudscited by 105
- 2023OneFormer3D: One Transformer for Unified Point Cloud Segmentationcited by 95
- 2024Voxel Mamba: Group-Free State Space Models for Point Cloud based 3D Object Detectioncited by 66
- 2025SpatialLM: Training Large Language Models for Structured Indoor Modelingcited by 63
- 2022CAGroup3D: Class-Aware Grouping for 3D Object Detection on Point Cloudscited by 58
- 2023PiMAE: Point Cloud and Image Interactive Masked Autoencoders for 3D Object Detectioncited by 53
- 2023NeRF-Det: Learning Geometry-Aware Volumetric Representation for Multi-View 3D Object Detectioncited by 51
38 more
- 2022Implicit Autoencoder for Point-Cloud Self-Supervised Representation Learningcited by 46
- 2022NeRF-RPN: A general framework for object detection in NeRFscited by 46
- 2023Mask-Attention-Free Transformer for 3D Instance Segmentationcited by 45
- 2023HEDNet: A Hierarchical Encoder-Decoder Network for 3D Object Detection in Point Cloudscited by 45
- 2024EmbodiedOcc: Embodied 3D Occupancy Prediction for Vision-based Online Scene Understandingcited by 43
- 2024Cubify Anything: Scaling Indoor 3D Object Detectioncited by 39
- 2023V-DETR: DETR with Vertex Relative Position Encoding for 3D Object Detectioncited by 34
- 2023TR3D: Towards Real-Time Indoor 3D Object Detectioncited by 32
- 2023Top-Down Beats Bottom-Up in 3D Instance Segmentationcited by 31
- 2023Uni3DETR: Unified 3D Detection Transformercited by 26
- 2023Octavius: Mitigating Task Interference in MLLMs via LoRA-MoEcited by 25
- 2024Uni3D-LLM: Unifying Point Cloud Perception, Generation and Editing with Large Language Modelscited by 24
- 2024NeRF-MAE: Masked AutoEncoders for Self-Supervised 3D Representation Learning for Neural Radiance Fieldscited by 20
- 2024OV-Uni3DETR: Towards Unified Open-Vocabulary 3D Object Detection via Cycle-Modality Propagationcited by 19
- 2025TSP3D: Text-guided Sparse Voxel Pruning for Efficient 3D Visual Groundingcited by 17
- 2023DQS3D: Densely-matched Quantization-aware Semi-supervised 3D Detectioncited by 16
- 2023ConDaFormer: Disassembled Transformer with Local Structure Enhancement for 3D Point Cloud Understandingcited by 16
- 2023Point-GCC: Universal Self-supervised 3D Scene Pre-training via Geometry-Color Contrastcited by 14
- 2023ImGeoNet: Image-induced Geometry-aware Voxel Representation for Multi-view 3D Object Detectioncited by 14
- 2023Diffusion-SS3D: Diffusion Model for Semi-supervised 3D Object Detectioncited by 14
- 20233D Feature Prediction for Masked-AutoEncoder-Based Point Cloud Pretrainingcited by 13
- 2024Memory-based Adapters for Online 3D Scene Perceptioncited by 13
- 20243DGS-DET: Empower 3D Gaussian Splatting with Boundary Guidance and Box-Focused Sampling for Indoor 3D Object Detectioncited by 13
- 2022Boosting 3D Object Detection via Object-Focused Image Fusioncited by 11
- 2022TO-Scene: A Large-scale Dataset for Understanding 3D Tabletop Scenescited by 10
- 2024BIP3D: Bridging 2D Images and 3D Perception for Embodied Intelligencecited by 10
- 2024BSNet: Box-Supervised Simulation-assisted Mean Teacher for 3D Instance Segmentationcited by 9
- 2024One for All: Multi-Domain Joint Training for Point Cloud Based 3D Object Detectioncited by 8
- 2024CN-RMA: Combined Network with Ray Marching Aggregation for 3D Indoors Object Detection from Multi-view Imagescited by 7
- 2024FastCAD: Real-Time CAD Retrieval and Alignment from Scans and Videoscited by 7
- 2024General Geometry-aware Weakly Supervised 3D Object Detectioncited by 7
- 2024MVSDet: Multi-View Indoor 3D Object Detection via Efficient Plane Sweepscited by 7
- 2025OpenM3D: Open Vocabulary Multi-view Indoor 3D Object Detection without Human Annotationscited by 7
- 2022Autoregressive Uncertainty Modeling for 3D Bounding Box Predictioncited by 6
- 2022Learning Point-Language Hierarchical Alignment for 3D Visual Groundingcited by 6
- 2023GaPro: Box-Supervised 3D Point Cloud Instance Segmentation Using Gaussian Processes as Pseudo Labelerscited by 6
- 2023Not Every Side Is Equal: Localization Uncertainty Estimation for Semi-Supervised 3D Object Detectioncited by 6
- 2024Swin3D++: Effective Multi-Source Pretraining for 3D Indoor Scene Understandingcited by 6
50 most cited of 97 All 97 (JSON)
- 2026ShelfChange3D: Object-Level 3D Change Detection for Retail Shelf Monitoring1 Oct 2026
- 2026GraphWrit3R: End-to-End 3D Scene Graph Writing25 Sep 2026
- 2026DIFTA-3D: Depth-Consistent Instance-Level Feature Transfer and Adaptation of DINOv3 for 3D Detection22 Sep 2026
- 2026GAPrompt++: Multi-Granular Geometry-Aware Point Cloud Prompt for 3D Vision Model17 Sep 2026
- 2026Map-Det3D: Metric Feed-Forward 3D Reconstruction Prior for Multi-view 3D Object Detection from Streaming Inputs12 Aug 2026
- 2026Breaking the Model Forgetting Cycle in Long-Incremental 3D Object Detection16 Jul 2026
- 2026PVCap: Towards Accurate 3D Dense Captioning via PseudoCap and VoxelCapNet7 Jul 2026
- 2026LOD-Net: Locality-Aware 3D Object Detection Using Multi-Scale Transformer Network17 Apr 2026
- 2026Learning 3D Representations for Spatial Intelligence from Unposed Multi-View Images12 Apr 2026
- 2026Few-Shot Incremental 3D Object Detection in Dynamic Indoor Environments9 Apr 2026
- 2026Boxer: Robust Lifting of Open-World 2D Bounding Boxes to 3D6 Apr 2026
- 2026Group3D: MLLM-Driven Semantic Grouping for Open-Vocabulary 3D Object Detection23 Mar 2026
38 more
- 2026On the Feasibility and Opportunity of Autoregressive 3D Object Detection9 Mar 2026
- 2026VGGT-Det: Mining VGGT Internal Priors for Sensor-Geometry-Free Multi-View Indoor 3D Object Detection1 Mar 2026
- 2026UniGeo: A Unified 3D Indoor Object Detection Framework Integrating Geometry-Aware Learning and Dynamic Channel Gating30 Jan 2026
- 2025GraphFusion3D: Dynamic Graph Attention Convolution with Adaptive Cross-Modal Transformer for 3D Object Detection2 Dec 2025
- 2025Gaussian Swaying: Surface-Based Framework for Aerodynamic Simulation with 3D Gaussians1 Dec 2025
- 2025Zoo3D: Zero-Shot 3D Object Detection at Scene Level25 Nov 2025
- 2025Towards 3D Objectness Learning in an Open World20 Oct 2025
- 2025TUN3D: Towards Real-World Scene Understanding from Unposed Images23 Sep 2025
- 2025OpenM3D: Open Vocabulary Multi-view Indoor 3D Object Detection without Human Annotations27 Aug 2025
- 2025Boosting Multi-View Indoor 3D Object Detection via Adaptive 3D Volume Construction24 Jul 2025
- 2025BoxFusion: Reconstruction-Free Open-Vocabulary 3D Object Detection via Real-Time Multi-View Box Fusion18 Jun 2025
- 20253DGeoDet: General-purpose Geometry-aware Image-based 3D Object Detection11 Jun 2025
- 2025SpatialLM: Training Large Language Models for Structured Indoor Modeling9 Jun 2025
- 2025DEGround: An Effective Baseline for Ego-centric 3D Visual Grounding with a Homogeneous Framework5 Jun 2025
- 2025Rooms from Motion: Un-posed Indoor 3D Object Detection as Localization and Mapping29 May 2025
- 2025Sketchy Bounding-box Supervision for 3D Instance Segmentation22 May 2025
- 2025GO-N3RDet: Geometry Optimized NeRF-enhanced 3D Object Detector19 Mar 2025
- 2025State Space Model Meets Transformer: A New Paradigm for 3D Object Detection18 Mar 2025
- 2025HexPlane Representation for 3D Semantic Scene Understanding7 Mar 2025
- 2025PointSplit: Towards On-device 3D Object Detection with Heterogeneous Low-power Accelerators4 Mar 2025
- 2025TSP3D: Text-guided Sparse Voxel Pruning for Efficient 3D Visual Grounding14 Feb 2025
- 2024Cubify Anything: Scaling Indoor 3D Object Detection5 Dec 2024
- 2024EmbodiedOcc: Embodied 3D Occupancy Prediction for Vision-based Online Scene Understanding5 Dec 2024
- 2024BIP3D: Bridging 2D Images and 3D Perception for Embodied Intelligence22 Nov 2024
- 2024One for All: Multi-Domain Joint Training for Point Cloud Based 3D Object Detection3 Nov 2024
- 2024MVSDet: Multi-View Indoor 3D Object Detection via Efficient Plane Sweeps28 Oct 2024
- 20243DGS-DET: Empower 3D Gaussian Splatting with Boundary Guidance and Box-Focused Sampling for Indoor 3D Object Detection2 Oct 2024
- 2024Gaussian-Det: Learning Closed-Surface Gaussians for 3D Object Detection2 Oct 2024
- 2024MV-DETR: Multi-modality indoor object detection by Multi-View DEtecton TRansformers13 Aug 2024
- 2024General Geometry-aware Weakly Supervised 3D Object Detection18 Jul 2024
- 2024DM3D: Distortion-Minimized Weight Pruning for Lossless 3D Object Detection2 Jul 2024
- 2024Voxel Mamba: Group-Free State Space Models for Point Cloud based 3D Object Detection15 Jun 2024
- 2024NeRF-DetS: Enhanced Adaptive Spatial-wise Sampling and View-wise Fusion Strategies for NeRF-based Indoor Multi-view 3D Object Detection22 Apr 2024
- 2024Object Dynamics Modeling with Hierarchical Point Cloud-based Representations9 Apr 2024
- 2024NeRF-MAE: Masked AutoEncoders for Self-Supervised 3D Representation Learning for Neural Radiance Fields1 Apr 2024
- 2024Accurate Cutting-point Estimation for Robotic Lychee Harvesting through Geometry-aware Learning30 Mar 2024
- 2024OV-Uni3DETR: Towards Unified Open-Vocabulary 3D Object Detection via Cycle-Modality Propagation28 Mar 2024
- 2024FastCAD: Real-Time CAD Retrieval and Alignment from Scans and Videos22 Mar 2024
50 newest of 97 All 97 (JSON)
- 2023Octavius: Mitigating Task Interference in MLLMs via LoRA-MoEcited by 25
- 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 299
- 2022Masked Discrimination for Self-Supervised Learning on Point Cloudscited by 155
- 2023EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AIcited by 146
- 2023Swin3D: A Pretrained Transformer Backbone for 3D Indoor Scene Understandingcited by 111
- 2023OctFormer: Octree-based Transformers for 3D Point Cloudscited by 105
- 2023OneFormer3D: One Transformer for Unified Point Cloud Segmentationcited by 95
- 2025SpatialLM: Training Large Language Models for Structured Indoor Modelingcited by 63
- 2022CAGroup3D: Class-Aware Grouping for 3D Object Detection on Point Cloudscited by 58
- 2023PiMAE: Point Cloud and Image Interactive Masked Autoencoders for 3D Object Detectioncited by 53
- 2023NeRF-Det: Learning Geometry-Aware Volumetric Representation for Multi-View 3D Object Detectioncited by 51
- 2022Implicit Autoencoder for Point-Cloud Self-Supervised Representation Learningcited by 46
- 2022NeRF-RPN: A general framework for object detection in NeRFscited by 46
12 most cited of 93 All 93 (JSON)
- 2026ShelfChange3D: Object-Level 3D Change Detection for Retail Shelf Monitoring1 Oct 2026
- 2026GraphWrit3R: End-to-End 3D Scene Graph Writing25 Sep 2026
- 2026DIFTA-3D: Depth-Consistent Instance-Level Feature Transfer and Adaptation of DINOv3 for 3D Detection22 Sep 2026
- 2026GAPrompt++: Multi-Granular Geometry-Aware Point Cloud Prompt for 3D Vision Model17 Sep 2026
- 2026Map-Det3D: Metric Feed-Forward 3D Reconstruction Prior for Multi-view 3D Object Detection from Streaming Inputs12 Aug 2026
- 2026Breaking the Model Forgetting Cycle in Long-Incremental 3D Object Detection16 Jul 2026
- 2026PVCap: Towards Accurate 3D Dense Captioning via PseudoCap and VoxelCapNet7 Jul 2026
- 2026LOD-Net: Locality-Aware 3D Object Detection Using Multi-Scale Transformer Network17 Apr 2026
- 2026Learning 3D Representations for Spatial Intelligence from Unposed Multi-View Images12 Apr 2026
- 2026Few-Shot Incremental 3D Object Detection in Dynamic Indoor Environments9 Apr 2026
- 2026Boxer: Robust Lifting of Open-World 2D Bounding Boxes to 3D6 Apr 2026
- 2026Group3D: MLLM-Driven Semantic Grouping for Open-Vocabulary 3D Object Detection23 Mar 2026
12 newest of 93 All 93 (JSON)