DLRMamba: Distilling Low-Rank Mamba for Edge Multispectral Fusion Object Detection
On the map: State-space sequence models (S4, Mamba) → Point clouds, detection and remote sensing
Abstract (arXiv)
Multispectral fusion object detection is a critical task for edge-based maritime surveillance and remote sensing, demanding both high inference efficiency and robust feature representation for high-resolution inputs. However, current State Space Models (SSMs) like Mamba suffer from significant parameter redundancy in their standard 2D Selective Scan (SS2D) blocks, which hinders deployment on resource-constrained hardware and leads to the loss of fine-grained structural information during conventional compression. To address these challenges, we propose the Low-Rank Two-Dimensional Selective Structured State Space Model (Low-Rank SS2D), which reformulates state transitions via matrix factorization to exploit intrinsic feature sparsity. Furthermore, we introduce a Structure-Aware Distillation strategy that aligns the internal latent state dynamics of the student with a full-rank teacher model to compensate for potential representation degradation. This approach substantially reduces computational complexity and memory footprint while preserving the high-fidelity spatial modeling required for object recognition. Extensive experiments on five benchmark datasets and real-world edge platforms, such as Raspberry Pi 5, demonstrate that our method achieves a superior efficiency-accuracy trade-off, significantly outperforming existing lightweight architectures in practical deployment scenarios.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Point clouds, detection and remote sensing, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 26 of its 65 references that are in the map. First posted on arXiv 6 Mar 2026.
Builds on
26 of 65 references.
Closest ancestors · 2
Same direction, newest first
- 2025Selective Structured State Space for Multispectral-fused Small Target Detection20 May
- 2024DMM: Disparity-guided Multispectral Mamba for Oriented Object Detection in Remote Sensing11 Jul
Other references · 24
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,051
- 2024VMamba: Visual State Space Modelcited by 955
- 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 313
- 2021LLVIP: A Visible-infrared Paired Dataset for Low-light Visioncited by 229
- 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 222
- 2022Language model compression with weighted low-rank factorizationcited by 192
- 2020Align Deep Features for Oriented Object Detectioncited by 186
- 2020Drone-based RGB-Infrared Cross-Modality Vehicle Detection via Uncertainty-Aware Learningcited by 150
- 2021The Low-Rank Simplicity Bias in Deep Networkscited by 150
12 more
- 2023LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximationcited by 103
- 2020Multispectral Fusion for Object Detection with Cyclic Fuse-and-Refine Blockscited by 85
- 2020Improving Multispectral Pedestrian Detection by Addressing Modality Imbalance Problemscited by 82
- 2023ICAFusion: Iterative Cross-Attention Guided Feature Fusion for Multispectral Object Detectioncited by 76
- 2023C2Former: Calibrated and Complementary Transformer for RGB-Infrared Object Detectioncited by 57
- 2023Multi-modal Gated Mixture of Local-to-Global Experts for Dynamic Image Fusioncited by 54
- 2022Translation, Scale and Rotation: Cross-Modal Alignment Meets RGB-Infrared Vehicle Detectioncited by 49
- 2022Rank Diminishing in Deep Neural Networkscited by 47
- 2022SuperYOLO: Super Resolution Assisted Object Detection in Multimodal Remote Sensing Imagerycited by 46
- 2021Cross-Modality Attentive Feature Fusion for Object Detection in Multispectral Remote Sensing Imagerycited by 44
- 2022Weakly Aligned Feature Fusion for Multimodal Object Detectioncited by 26
- 2024Optimizing YOLOv5s Object Detection through Knowledge Distillation algorithmcited by 11
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Increasing the Efficiency of DETR for Maritime High-Resolution Images
- 2024FusionMamba: Efficient Remote Sensing Image Fusion with State Space Model
- 2026SPLG-Mamba: Structure-Preserving Local-Global Mamba Network for Salient Object Detection in Optical Remote Sensing Images
- 2026MambaPSA: A Mamba-based Replacement for C2PSA in YOLO26
- 2024MSFMamba: Multi-Scale Feature Fusion State Space Model for Multi-Source Remote Sensing Image Classification
- 2025MambaNeXt-YOLO: A Hybrid State Space Model for Real-time Object Detection
- 2026MambaFusion: Adaptive State-Space Fusion for Multimodal 3D Object Detection
- 2025MambaFusion: Height-Fidelity Dense Global Fusion for Multi-modal 3D Object Detection