Lightweight 3D Object Detection via Mamba-Based Knowledge Distillation
On the map: State-space sequence models (S4, Mamba) → Point clouds, detection and remote sensing
Abstract (arXiv)
3D object detection using light detection and ranging (LiDAR) sensors requires a balance between accuracy and computational efficiency for onboard perception in autonomous driving and robotic navigation. Many existing LiDAR-based detection methods employ complex architectures to extract features, integrating large amounts of contextual information to enhance accuracy. This often results in significant computational costs, leading to suboptimal performance on resource-constrained embedded devices. In this study, we propose a knowledge distillation framework that transfers object-level voxel representations from a strong teacher model to lightweight student models through selective voxel-space feature alignment. Taking advantage of the linear-time sequence model with selective state spaces (Mamba), we design a multi-branch Mamba teacher backbone and a box-aware feature transfer mechanism that aligns spatially corresponding voxel features between teacher and student networks through a Mamba-based projection module. Experimental results on both a public dataset and real-world data show that our approach significantly reduces computational load while maintaining competitive accuracy compared with state-of-the-art methods.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Point clouds, detection and remote sensing, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 25 of its 29 references that are in the map. First posted on arXiv 4 Aug 2026.
Builds on
25 of 29 references.
Closest ancestors · 2
Same direction, newest first
- 2024LION: Linear Group RNN for 3D Object Detection in Point Clouds25 Jul
- 2024Voxel Mamba: Group-Free State Space Models for Point Cloud based 3D Object Detection15 Jun
Other references · 23
- 2017Attention Is All You Needcited by 59,932
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 2014FitNets: Hints for Thin Deep Netscited by 1,619
- 2020Center-based 3D Object Detection and Trackingcited by 1,143
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,051
- 2024VMamba: Visual State Space Modelcited by 955
- 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 890
11 more
- 2017Frustum PointNets for 3D Object Detection from RGB-D Datacited by 640
- 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 607
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 464
- 2022On the Parameterization and Initialization of Diagonal State Space Modelscited by 418
- 2022Diagonal State Spaces are as Effective as Structured State Spacescited by 350
- 2023VoxelNeXt: Fully Sparse VoxelNet for 3D Object Detection and Trackingcited by 221
- 2019Distilling Object Detectors with Fine-grained Feature Imitationcited by 188
- 2023DSVT: Dynamic Sparse Voxel Transformer with Rotated Setscited by 122
- 2022PointDistiller: Structured Knowledge Distillation Towards Efficient and Compact 3D Detectioncited by 33
- 2022Towards Efficient 3D Object Detection with Knowledge Distillationcited by 29
- 2022itKD: Interchange Transfer-based Knowledge Distillation for 3D Object Detectioncited by 14
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Unleashing the Potential of Mamba: Boosting a LiDAR 3D Sparse Detector by Using Cross-Model Knowledge Distillation
- 2025WinMamba: Multi-Scale Shifted Windows in State Space Model for 3D Object Detection
- 2025UniMamba: Unified Spatial-Channel Representation Learning with Group-Efficient Mamba for LiDAR-based 3D Object Detection
- 2026RayMamba: Ray-Aligned Serialization for Long-Range 3D Object Detection
- 2026MambaFusion: Adaptive State-Space Fusion for Multimodal 3D Object Detection
- 2025MambaFusion: Height-Fidelity Dense Global Fusion for Multi-modal 3D Object Detection
- 2024MambaBEV: An EV-based 3D detection model with Mamba2
- 2025DA-Mamba: Domain Adaptive Hybrid Mamba-Transformer Based One-Stage Object Detection