Graph Information Bottleneck for Remote Sensing Segmentation
Not on the map. Why?
Abstract (arXiv)
Remote sensing segmentation has a wide range of applications in environmental protection, and urban change detection, etc. Despite the success of deep learning-based remote sensing segmentation methods (e.g., CNN and Transformer), they are not flexible enough to model irregular objects. In addition, existing graph contrastive learning methods usually adopt the way of maximizing mutual information to keep the node representations consistent between different graph views, which may cause the model to learn task-independent redundant information. To tackle the above problems, this paper treats images as graph structures and introduces a simple contrastive vision GNN (SC-ViG) architecture for remote sensing segmentation. Specifically, we construct a node-masked and edge-masked graph view to obtain an optimal graph structure representation, which can adaptively learn whether to mask nodes and edges. Furthermore, this paper innovatively introduces information bottleneck theory into graph contrastive learning to maximize task-related information while minimizing task-independent redundant information. Finally, we replace the convolutional module in UNet with the SC-ViG module to complete the segmentation and classification tasks of remote sensing images. Extensive experiments on publicly available real datasets demonstrate that our method outperforms state-of-the-art remote sensing image segmentation methods.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 34 of its 54 references that are in the map. First posted on arXiv 5 Dec 2023.
Builds on
34 of 54 references.
References · 34
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,518
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,417
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
22 more
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2018Deep Graph Infomaxcited by 1,101
- 2018Dual Attention Network for Scene Segmentationcited by 1,001
- 2021Segmenter: Transformer for Semantic Segmentationcited by 855
- 2020Contrastive Multi-View Representation Learning on Graphscited by 651
- 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
- 2014Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFscited by 552
- 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
- 2021Bottleneck Transformers for Visual Recognitioncited by 364
- 2020Point-GNN: Graph Neural Network for 3D Object Detection in a Point Cloudcited by 335
- 2021Co-Scale Conv-Attentional Image Transformerscited by 224
- 2022Vision GNN: An Image is Worth Graph of Nodescited by 185
- 2020Graph Information Bottleneckcited by 168
- 2021UNetFormer: A UNet-like Transformer for Efficient Semantic Segmentation of Remote Sensing Urban Scene Imagerycited by 166
- 2020Multi-Attention-Network for Semantic Segmentation of Fine Resolution Remote Sensing Imagescited by 59
- 2022TREND: TempoRal Event and Node Dynamics for Graph Representation Learningcited by 50
- 2023CoCo: A Coupled Contrastive Framework for Unsupervised Domain Adaptive Graph Classificationcited by 46
- 2020LandCover.ai: Dataset for Automatic Mapping of Buildings, Woodlands, Water and Roads from Aerial Imagerycited by 40
- 2021Transformer Meets Convolution: A Bilateral Awareness Network for Semantic Segmentation of Very Fine Resolution Urban Scene Imagescited by 28
- 2021Looking Outside the Window: Wide-Context Transformer for the Semantic Segmentation of High-Resolution Remote Sensing Imagescited by 27
- 2021ABCNet: Attentive Bilateral Contextual Network for Efficient Semantic Segmentation of Fine-Resolution Remote Sensing Imagescited by 22
- 2019SCAttNet: Semantic Segmentation Network with Spatial and Channel Attention Mechanism for High-Resolution Remote Sensing Imagescited by 21
Built on by
Citing papers per year: 2023: 4; 2024: 13; 2025: 4; 2026: 3.
24 papers.
Sort:
By area:
- 2023Deep Imbalanced Learning for Multimodal Emotion Recognition in Conversationscited by 47
- 2023A Comprehensive Survey on Multi-modal Conversational Emotion Recognition with Deep Learningcited by 32
- 2023DER-GCN: Dialogue and Event Relation-Aware Graph Convolutional Neural Network for Multimodal Dialogue Emotion Recognitioncited by 23
- 2024Contrastive Graph Representation Learning with Adversarial Cross-view Reconstruction and Information Bottleneckcited by 21
- 2024SpeGCL: Self-supervised Graph Spectrum Contrastive Learning without Positive Samplescited by 20
- 2024Graph Domain Adaptation with Dual-branch Encoder and Two-level Alignment for Whole Slide Image-based Survival Predictioncited by 20
- 2024Masked Graph Learning with Recurrent Alignment for Multimodal Emotion Recognition in Conversationcited by 19
- 2023Adversarial Representation with Intra-Modal and Inter-Modal Graph Contrastive Learning for Multimodal Emotion Recognitioncited by 12
- 2024MCSFF: Multi-modal Consistency and Specificity Fusion Framework for Entity Alignmentcited by 8
- 2024Graph Contrastive Learning via Cluster-refined Negative Sampling for Semi-supervised Text Classificationcited by 8
- 2024A Multi-view Mask Contrastive Learning Graph Convolutional Neural Network for Age Estimationcited by 7
- 2026The Paradigm Shift: A Comprehensive Survey on Large Vision Language Models for Multimodal Fake News Detectioncited by 6
12 more
- 2024Contrastive Multi-graph Learning with Neighbor Hierarchical Sifting for Semi-supervised Text Classificationcited by 5
- 2024SEG:Seeds-Enhanced Iterative Refinement Graph Neural Network for Entity Alignmentcited by 4
- 2024Dynamic Graph Neural ODE Network for Multi-modal Emotion Recognition in Conversationcited by 3
- 2024GroupFace: Imbalanced Age Estimation Based on Multi-hop Attention Graph Convolutional Network and Group-aware Margin Optimizationcited by 3
- 2024SE-GCL: An Event-Based Simple and Effective Graph Contrastive Learning for Text Representationcited by 1
- 2025LRA-GNN: Latent Relation-Aware Graph Neural Network with Initial and Dynamic Residual for Facial Age Estimationcited by 1
- 2025A Flow Model with Low-Rank Transformers for Incomplete Multimodal Survival Analysiscited by 1
- 2024An Effective Index for Truss-based Community Search on Large Directed Graphscited by 0
- 2025i-WiViG: Interpretable Window Vision GNNcited by 0
- 2025SE-GNN: Seed Expanded-Aware Graph Neural Network with Iterative Optimization for Semi-supervised Entity Alignmentcited by 0
- 2026TimeGNN-Augmented Hybrid-Action MARL for Fine-Grained Task Partitioning and Energy-Aware Offloading in MECcited by 0
- 2026IB-HFN: Information Bottleneck-Driven SAR-Optical Fusion Network for High-Fidelity Cloud Removalcited by 0
- 2026IB-HFN: Information Bottleneck-Driven SAR-Optical Fusion Network for High-Fidelity Cloud Removal8 Jun 2026
- 2026The Paradigm Shift: A Comprehensive Survey on Large Vision Language Models for Multimodal Fake News Detection16 Jan 2026
- 2026TimeGNN-Augmented Hybrid-Action MARL for Fine-Grained Task Partitioning and Energy-Aware Offloading in MEC8 Jan 2026
- 2025A Flow Model with Low-Rank Transformers for Incomplete Multimodal Survival Analysis22 Oct 2025
- 2025SE-GNN: Seed Expanded-Aware Graph Neural Network with Iterative Optimization for Semi-supervised Entity Alignment24 Mar 2025
- 2025i-WiViG: Interpretable Window Vision GNN11 Mar 2025
- 2025LRA-GNN: Latent Relation-Aware Graph Neural Network with Initial and Dynamic Residual for Facial Age Estimation8 Feb 2025
- 2024SE-GCL: An Event-Based Simple and Effective Graph Contrastive Learning for Text Representation16 Dec 2024
- 2024GroupFace: Imbalanced Age Estimation Based on Multi-hop Attention Graph Convolutional Network and Group-aware Margin Optimization16 Dec 2024
- 2024Dynamic Graph Neural ODE Network for Multi-modal Emotion Recognition in Conversation4 Dec 2024
- 2024Contrastive Multi-graph Learning with Neighbor Hierarchical Sifting for Semi-supervised Text Classification25 Nov 2024
- 2024Graph Domain Adaptation with Dual-branch Encoder and Two-level Alignment for Whole Slide Image-based Survival Prediction21 Nov 2024
12 more
- 2024SEG:Seeds-Enhanced Iterative Refinement Graph Neural Network for Entity Alignment28 Oct 2024
- 2024Graph Contrastive Learning via Cluster-refined Negative Sampling for Semi-supervised Text Classification18 Oct 2024
- 2024MCSFF: Multi-modal Consistency and Specificity Fusion Framework for Entity Alignment18 Oct 2024
- 2024SpeGCL: Self-supervised Graph Spectrum Contrastive Learning without Positive Samples14 Oct 2024
- 2024Contrastive Graph Representation Learning with Adversarial Cross-view Reconstruction and Information Bottleneck1 Aug 2024
- 2024Masked Graph Learning with Recurrent Alignment for Multimodal Emotion Recognition in Conversation23 Jul 2024
- 2024A Multi-view Mask Contrastive Learning Graph Convolutional Neural Network for Age Estimation23 Jul 2024
- 2024An Effective Index for Truss-based Community Search on Large Directed Graphs19 Jan 2024
- 2023Adversarial Representation with Intra-Modal and Inter-Modal Graph Contrastive Learning for Multimodal Emotion Recognition28 Dec 2023
- 2023DER-GCN: Dialogue and Event Relation-Aware Graph Convolutional Neural Network for Multimodal Dialogue Emotion Recognition17 Dec 2023
- 2023Deep Imbalanced Learning for Multimodal Emotion Recognition in Conversations11 Dec 2023
- 2023A Comprehensive Survey on Multi-modal Conversational Emotion Recognition with Deep Learning10 Dec 2023
- 2023Deep Imbalanced Learning for Multimodal Emotion Recognition in Conversationscited by 47
- 2023A Comprehensive Survey on Multi-modal Conversational Emotion Recognition with Deep Learningcited by 32
- 2023DER-GCN: Dialogue and Event Relation-Aware Graph Convolutional Neural Network for Multimodal Dialogue Emotion Recognitioncited by 23
- 2024Contrastive Graph Representation Learning with Adversarial Cross-view Reconstruction and Information Bottleneckcited by 21
- 2024SpeGCL: Self-supervised Graph Spectrum Contrastive Learning without Positive Samplescited by 20
- 2024Graph Domain Adaptation with Dual-branch Encoder and Two-level Alignment for Whole Slide Image-based Survival Predictioncited by 20
- 2024Masked Graph Learning with Recurrent Alignment for Multimodal Emotion Recognition in Conversationcited by 19
- 2023Adversarial Representation with Intra-Modal and Inter-Modal Graph Contrastive Learning for Multimodal Emotion Recognitioncited by 12
- 2024MCSFF: Multi-modal Consistency and Specificity Fusion Framework for Entity Alignmentcited by 8
- 2024Graph Contrastive Learning via Cluster-refined Negative Sampling for Semi-supervised Text Classificationcited by 8
- 2024A Multi-view Mask Contrastive Learning Graph Convolutional Neural Network for Age Estimationcited by 7
- 2024Contrastive Multi-graph Learning with Neighbor Hierarchical Sifting for Semi-supervised Text Classificationcited by 5
12 most cited of 23 All 23 (JSON)
- 2026IB-HFN: Information Bottleneck-Driven SAR-Optical Fusion Network for High-Fidelity Cloud Removal8 Jun 2026
- 2026TimeGNN-Augmented Hybrid-Action MARL for Fine-Grained Task Partitioning and Energy-Aware Offloading in MEC8 Jan 2026
- 2025A Flow Model with Low-Rank Transformers for Incomplete Multimodal Survival Analysis22 Oct 2025
- 2025SE-GNN: Seed Expanded-Aware Graph Neural Network with Iterative Optimization for Semi-supervised Entity Alignment24 Mar 2025
- 2025i-WiViG: Interpretable Window Vision GNN11 Mar 2025
- 2025LRA-GNN: Latent Relation-Aware Graph Neural Network with Initial and Dynamic Residual for Facial Age Estimation8 Feb 2025
- 2024SE-GCL: An Event-Based Simple and Effective Graph Contrastive Learning for Text Representation16 Dec 2024
- 2024GroupFace: Imbalanced Age Estimation Based on Multi-hop Attention Graph Convolutional Network and Group-aware Margin Optimization16 Dec 2024
- 2024Dynamic Graph Neural ODE Network for Multi-modal Emotion Recognition in Conversation4 Dec 2024
- 2024Contrastive Multi-graph Learning with Neighbor Hierarchical Sifting for Semi-supervised Text Classification25 Nov 2024
- 2024Graph Domain Adaptation with Dual-branch Encoder and Two-level Alignment for Whole Slide Image-based Survival Prediction21 Nov 2024
- 2024SEG:Seeds-Enhanced Iterative Refinement Graph Neural Network for Entity Alignment28 Oct 2024
12 newest of 23 All 23 (JSON)