mlsanityData to 14 Oct 2026

Unsupervised Image Semantic Segmentation through Superpixels and Graph Neural Networks

arXiv 2210.11810 ↗First posted 21 Oct 2022cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Unsupervised image segmentation is an important task in many real-world scenarios where labelled data is of scarce availability. In this paper we propose a novel approach that harnesses recent advances in unsupervised learning using a combination of Mutual Information Maximization (MIM), Neural Superpixel Segmentation and Graph Neural Networks (GNNs) in an end-to-end manner, an approach that has not been explored yet. We take advantage of the compact representation of superpixels and combine it with GNNs in order to learn strong and semantically meaningful representations of images. Specifically, we show that our GNN based approach allows to model interactions between distant pixels in the image and serves as a strong prior to existing CNNs for an improved accuracy. Our experiments reveal both the qualitative and quantitative advantages of our approach compared to current state-of-the-art methods over four popular datasets.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 67 references that are in the map. First posted on arXiv 21 Oct 2022.

Builds on

41 of 67 references.

References · 41

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  5. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  6. 2017Graph Attention Networkscited by 8,923
  7. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  8. 2017Inductive Representation Learning on Large Graphscited by 6,320
  9. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  10. 2018How Powerful are Graph Neural Networks?cited by 4,393
  11. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  12. 2016Pyramid Scene Parsing Networkcited by 2,479
29 more
  1. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
  2. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
  3. 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
  4. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
  5. 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
  6. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,273
  7. 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,167
  8. 2018Deep Graph Infomaxcited by 1,106
  9. 2013Spectral Networks and Locally Connected Networks on Graphscited by 1,102
  10. 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,066
  11. 2018Dual Attention Network for Scene Segmentationcited by 1,003
  12. 2016COCO-Stuff: Thing and Stuff Classes in Contextcited by 864
  13. 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 820
  14. 2020Image Segmentation Using Deep Learning: A Surveycited by 660
  15. 2016RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentationcited by 465
  16. 2018Invariant Information Clustering for Unsupervised Image Classification and Segmentationcited by 455
  17. 2022Unsupervised Semantic Segmentation by Distilling Feature Correspondencescited by 241
  18. 2021PiCIE: Unsupervised Semantic Segmentation using Invariance and Equivariance in Clusteringcited by 163
  19. 2018Superpixel Sampling Networkscited by 79
  20. 2013SEEDS: Superpixels Extracted via Energy-Driven Samplingcited by 75
  21. 2020Autoregressive Unsupervised Image Segmentationcited by 60
  22. 2015Learning visual groups from co-occurrences in space and timecited by 42
  23. 2022Unsupervised Hierarchical Semantic Segmentation with Multiview Cosegmentation and Clustering Transformerscited by 39
  24. 2019IMEXnet: A Forward Stable Deep Neural Networkcited by 22
  25. 2020DiffGCN: Graph Convolutional Networks via Differential Operators and Algebraic Multigrid Poolingcited by 17
  26. 2021Unsupervised Image Segmentation by Mutual Information Maximization and Adversarial Regularizationcited by 13
  27. 2021InfoSeg: Unsupervised Semantic Image Segmentation with Mutual Information Maximizationcited by 11
  28. 2020Superpixel Segmentation via Convolutional Neural Networks with Regularized Information Maximizationcited by 10
  29. 2022Rethinking Unsupervised Neural Superpixel Segmentationcited by 3

Built on by

Not cited yet.