mlsanityData to 14 Oct 2026

Compass: Degradation-Simulated Reciprocal Learning with Lightweight Needle RWKV for Multimodal Crack Segmentation under Missing Modalities

arXiv 2608.03559 ↗First posted 4 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

In multimodal crack segmentation for industrial facilities, the key challenge is preventing missing modalities from degrading pixel-level performance while maintaining low computational cost. Existing methods struggle to address semantic degradation caused by missing modalities. We propose Compass, a lightweight network for robust crack segmentation under arbitrary missing modalities. Compass comprises Degradation Simulation Distillation (DSD), Needle Block, and Evidential Topology-Preserving Fusion (ETPF). DSD constructs a degradation simulation stream that mimics more severe missing conditions and performs reciprocal distillation with the original stream, decoupling complete perception from degradation adaptation. Within DSD, Feature-Aware Prototype Transmitter (FAPT) performs modality agnostic prototype-guided feature completion to maintain semantic integrity under incomplete modality conditions. As a lightweight backbone, Needle injects crack-direction cues into WKV modulation and combines connectivity-aware gating with anisotropic context probing for structure-aware modeling. ETPF fuses multimodal features via Dempster-Shafer evidential combination with uncertainty-gated decoding, preserving crack topology while suppressing unreliable features. Experiments on three datasets demonstrate state-of-the-art (SOTA) performance under diverse missing modality scenarios. Even with 90% depth modality missing on CrackDepth, Compass achieves F1 of 0.8216 and mIoU of 0.8434 with only 2.58M parameters. The code is available at https://github.com/Karl1109/Compass.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 62 references that are in the map. First posted on arXiv 4 Aug 2026.

Builds on

31 of 62 references.

References · 31

  1. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  3. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  4. 2023RWKV: Reinventing RNNs for the Transformer Eracited by 827
  5. 2024LocalMamba: Visual State Space Model with Windowed Selective Scancited by 236
  6. 2022CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformerscited by 231
  7. 2023Multi-modal Learning with Missing Modality via Shared-Specific Feature Modellingcited by 163
  8. 2024EfficientVMamba: Atrous Selective Scan for Light Weight Visual Mambacited by 146
  9. 2024MambaOut: Do We Really Need Mamba for Vision?cited by 143
  10. 2024PlainMamba: Improving Non-Hierarchical Mamba in Visual Recognitioncited by 141
  11. 2022Multimodal Token Fusion for Vision Transformerscited by 136
  12. 2023Multimodal Prompting with Missing Modalities for Visual Recognitioncited by 121
19 more
  1. 2023Delivering Arbitrary-Modal Semantic Segmentationcited by 117
  2. 2024Sigma: Siamese Mamba Network for Multi-Modal Semantic Segmentationcited by 71
  3. 2024Frequency-aware Feature Fusion for Dense Image Predictioncited by 48
  4. 2024GeminiFusion: Efficient Pixel-wise Multimodal Fusion for Vision Transformercited by 44
  5. 2024StitchFusion: Weaving Any Visual Modalities to Enhance Multimodal Semantic Segmentationcited by 39
  6. 2024Restore-RWKV: Efficient and Effective Medical Image Restoration with RWKVcited by 36
  7. 2022Efficient Multi-Task RGB-D Scene Analysis for Indoor Environmentscited by 33
  8. 2025DFormerv2: Geometry Self-Attention for RGBD Semantic Segmentationcited by 31
  9. 2025SCSegamba: Lightweight Structure-Aware Vision Mamba for Crack Segmentation in Structurescited by 16
  10. 2025URWKV: Unified RWKV Model with Multi-state Perspective for Low-light Image Restorationcited by 15
  11. 2023Designing a Hybrid Neural System to Learn Real-world Crack Segmentation from Fractal-based Simulationcited by 10
  12. 2024MMP: Towards Robust Multi-Modal Learning with Masked Modality Projectioncited by 10
  13. 2025Knowledge Bridger: Towards Training-free Missing Modality Completioncited by 9
  14. 2024L3TC: Leveraging RWKV for Learned Lossless Low-Complexity Text Compressioncited by 7
  15. 2025MCMoE: Completing Missing Modalities with Mixture of Experts for Incomplete Multimodal Action Quality Assessmentcited by 7
  16. 2024Part-Whole Relational Fusion Towards Multi-Modal Scene Understandingcited by 6
  17. 2025LIDAR: Lightweight Adaptive Cue-Aware Fusion Vision Mamba for Multimodal Segmentation of Structural Crackscited by 3
  18. 2025RWKV-PCSSC: Exploring RWKV Model for Point Cloud Semantic Scene Completioncited by 1
  19. 2025CCSD: Cross-Modal Compositional Self-Distillation for Robust Brain Tumor Segmentation with Missing Modalitiescited by 1

Built on by

Not cited yet.