mlsanityData to 7 Oct 2026

ISWSST: Index-space-wave State Superposition Transformers for Multispectral Remotely Sensed Imagery Semantic Segmentation

arXiv 2407.03033 ↗First posted 3 Jul 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Currently the semantic segmentation task of multispectral remotely sensed imagery (MSRSI) faces the following problems: 1) Usually, only single domain feature (i.e., space domain or frequency domain) is considered; 2) downsampling operation in encoder generally leads to the accuracy loss of edge extraction; 3) multichannel features of MSRSI are not fully considered; and 4) prior knowledge of remote sensing is not fully utilized. To solve the aforementioned issues, an index-space-wave state superposition Transformer (ISWSST) is the first to be proposed for MSRSI semantic segmentation by the inspiration from quantum mechanics, whose superiority is as follows: 1) index, space and wave states are superposed or fused to simulate quantum superposition by adaptively voting decision (i.e., ensemble learning idea) for being a stronger classifier and improving the segmentation accuracy; 2) a lossless wavelet pyramid encoder-decoder module is designed to losslessly reconstruct image and simulate quantum entanglement based on wavelet transform and inverse wavelet transform for avoiding the edge extraction loss; 3) combining multispectral features (i.e. remote sensing index and channel attention mechanism) is proposed to accurately extract ground objects from original resolution images; and 4) quantum mechanics are introduced to interpret the underlying superiority of ISWSST. Experiments show that ISWSST is validated and superior to the state-of-the-art architectures for the MSRSI segmentation task, which improves the segmentation and edge extraction accuracy effectively. Codes will be available publicly after our paper is accepted.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 40 references that are in the map. First posted on arXiv 3 Jul 2024.

Builds on

27 of 40 references.

References · 27

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2017Squeeze-and-Excitation Networkscited by 4,763
  5. 2020Longformer: The Long-Document Transformercited by 3,362
  6. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
  7. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  8. 2016Pyramid Scene Parsing Networkcited by 2,472
  9. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
  10. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
  11. 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,417
  12. 2018Unified Perceptual Parsing for Scene Understandingcited by 1,265
15 more
  1. 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,148
  2. 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,096
  3. 2021Segmenter: Transformer for Semantic Segmentationcited by 855
  4. 2021Transformer in Transformercited by 632
  5. 2019Segmentation Transformer: Object-Contextual Representations for Semantic Segmentationcited by 573
  6. 2022Vision Transformer Adapter for Dense Predictionscited by 564
  7. 2021CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windowscited by 526
  8. 2021UCTransNet: Rethinking the Skip Connections in U-Net from a Channel-wise Perspective with Transformercited by 197
  9. 2021UNetFormer: A UNet-like Transformer for Efficient Semantic Segmentation of Remote Sensing Urban Scene Imagerycited by 166
  10. 2021The Devil is in the Margin: Margin-based Label Smoothing for Network Calibrationcited by 91
  11. 2022Wave-ViT: Unifying Wavelet and Transformers for Visual Representation Learningcited by 78
  12. 2021Hire-MLP: Vision MLP via Hierarchical Rearrangementcited by 66
  13. 2021An Image Patch is a Wave: Phase-Aware Vision MLPcited by 61
  14. 2022Attribute Surrogates Learning and Spectral Tokens Pooling in Transformers for Few-shot Learningcited by 27
  15. 2021NomMer: Nominate Synergistic Context in Vision Transformer for Visual Recognitioncited by 12

Built on by

Not cited yet.