mlsanityData to 14 Oct 2026

DualSwinFusionSeg: Multimodal Martian Landslide Segmentation via Dual Swin Transformer with Multi-Scale Fusion and UNet++

arXiv 2603.14132 ↗First posted 14 Mar 2026cs.CV cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Automated segmentation of Martian landslides, particularly in tectonically active regions such as Valles Marineris,is important for planetary geology, hazard assessment, and future robotic exploration. However, detecting landslides from planetary imagery is challenging due to the heterogeneous nature of available sensing modalities and the limited number of labeled samples. Each observation combines RGB imagery with geophysical measurements such as digital elevation models, slope maps, thermal inertia, and contextual grayscale imagery, which differ significantly in resolution and statistical properties. To address these challenges, we propose DualSwinFusionSeg, a multimodal segmentation architecture that separates modality-specific feature extraction and performs multi-scale cross-modal fusion. The model employs two parallel Swin Transformer V2 encoders to independently process RGB and auxiliary geophysical inputs, producing hierarchical feature representations. Corresponding features from the two streams are fused at multiple scales and decoded using a UNet++ decoder with dense nested skip connections to preserve fine boundary details. Extensive ablation studies evaluate modality contributions, loss functions, decoder architectures, and fusion strategies. Experiments on the MMLSv2 dataset from the PBVS 2026 Mars-LS Challenge show that modality-specific encoders and simple concatenation-based fusion improve segmentation accuracy under limited training data. The final model achieves 0.867 mIoU and 0.905 F1 on the development benchmark and 0.783 mIoU on the held-out test set, demonstrating strong performance for multimodal planetary surface segmentation.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 17 of its 27 references that are in the map. First posted on arXiv 14 Mar 2026.

Builds on

17 of 27 references.

References · 17

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  3. 2016Feature Pyramid Networks for Object Detectioncited by 5,036
  4. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
  5. 2017Squeeze-and-Excitation Networkscited by 4,789
  6. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
  7. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  8. 2018CBAM: Convolutional Block Attention Modulecited by 2,477
  9. 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,525
  10. 2018Unified Perceptual Parsing for Scene Understandingcited by 1,271
  11. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,228
  12. 2018Albumentations: fast and flexible image augmentationscited by 560
5 more
  1. 2017Tversky loss function for image segmentation using 3D fully convolutional deep networkscited by 228
  2. 2022Landslide4Sense: Reference Benchmark Data and Deep Learning Models for Landslide Detectioncited by 26
  3. 2023MMSFormer: Multimodal Transformer for Material and Semantic Segmentationcited by 12
  4. 2024TransLandSeg: A Transfer Learning Approach for Landslide Semantic Segmentation Based on Vision Foundation Modelcited by 2
  5. 2026MMLSv2: A Multimodal Dataset for Martian Landslide Detection in Remote Sensing Imagerycited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.