mlsanityData to 7 Oct 2026

Generative Zero-Shot Learning for Semantic Segmentation of 3D Point Clouds

arXiv 2108.06230 ↗First posted 13 Aug 2021cs.CVcited by 55

Not on the map. Why?

Abstract (arXiv)

While there has been a number of studies on Zero-Shot Learning (ZSL) for 2D images, its application to 3D data is still recent and scarce, with just a few methods limited to classification. We present the first generative approach for both ZSL and Generalized ZSL (GZSL) on 3D data, that can handle both classification and, for the first time, semantic segmentation. We show that it reaches or outperforms the state of the art on ModelNet40 classification for both inductive ZSL and inductive GZSL. For semantic segmentation, we created three benchmarks for evaluating this new ZSL task, using S3DIS, ScanNet and SemanticKITTI. Our experiments show that our method outperforms strong baselines, which we additionally propose for this task.

Key facts. Cited by 55 papers in the map (data through 7 Oct 2026). Builds on 61 of its 86 references that are in the map. First posted on arXiv 13 Aug 2021.

Builds on

61 of 86 references.

References · 61

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  6. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  7. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
  8. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  9. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  10. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  11. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  12. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
38 more
  1. 2017Improved Training of Wasserstein GANscited by 2,223
  2. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
  3. 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,202
  4. 2013Spectral Networks and Locally Connected Networks on Graphscited by 1,097
  5. 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
  6. 2015Gated Graph Sequence Neural Networkscited by 792
  7. 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 746
  8. 2018PointConv: Deep Convolutional Networks on 3D Point Cloudscited by 656
  9. 2015Multi-view Convolutional Neural Networks for 3D Shape Recognitioncited by 564
  10. 2016Conditional Image Synthesis With Auxiliary Classifier GANscited by 562
  11. 2017Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Uglycited by 536
  12. 2017Large-scale Point Cloud Semantic Segmentation with Superpoint Graphscited by 384
  13. 2015Adversarial Autoencoderscited by 359
  14. 2019Relation-Shape Convolutional Neural Network for Point Cloud Analysiscited by 346
  15. 2016OctNet: Learning Deep 3D Representations at High Resolutionscited by 340
  16. 2018SpiderCNN: Deep Learning on Point Sets with Parameterized Convolutional Filterscited by 261
  17. 2017Feature Generating Networks for Zero-Shot Learningcited by 257
  18. 2015Generative Moment Matching Networkscited by 252
  19. 2019Zero-Shot Semantic Segmentationcited by 245
  20. 2016Volumetric and Multi-View CNNs for Object Classification on 3D Datacited by 240
  21. 2013Zero-Shot Learning Through Cross-Modal Transfercited by 237
  22. 2018SO-Net: Self-Organizing Network for Point Cloud Analysiscited by 210
  23. 2018Generalized Zero- and Few-Shot Learning via Aligned Variational Autoencoderscited by 206
  24. 2018Tangent Convolutions for Dense Prediction in 3Dcited by 173
  25. 2019f-VAEGAN-D2: A Feature Generating Framework for Any-Shot Learningcited by 164
  26. 2021Deep Parametric Continuous Convolutional Neural Networkscited by 161
  27. 2016Learning a Deep Embedding Model for Zero-Shot Learningcited by 153
  28. 2016An Empirical Study and Analysis of Generalized Zero-Shot Learning for Object Recognition in the Wildcited by 146
  29. 2013Zero-Shot Learning by Convex Combination of Semantic Embeddingscited by 135
  30. 2016Latent Embeddings for Zero-shot Classificationcited by 129
  31. 2017Pointwise Convolutional Neural Networkscited by 126
  32. 2014Learning Rich Features from RGB-D Images for Object Detection and Segmentationcited by 124
  33. 2017Generalized Zero-Shot Learning via Synthesized Examplescited by 114
  34. 2013Generalized Denoising Auto-Encoders as Generative Modelscited by 113
  35. 2020Context-aware Feature Generation for Zero-shot Semantic Segmentationcited by 94
  36. 2017Deep Projective 3D Semantic Segmentationcited by 81
  37. 2017Open Vocabulary Scene Parsingcited by 76
  38. 2019ConvPoint: Continuous Convolutions for Point Cloud Processingcited by 62

50 most cited of 61 All 61 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 13; 2023: 23; 2024: 6; 2025: 10; 2026: 2.

55 papers.

Sort:

By area:

  1. 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 556
  2. 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 370
  3. 2022Language-Grounded Indoor 3D Semantic Segmentation in the Wildcited by 243
  4. 2022PointCLIP V2: Prompting CLIP and GPT for Powerful 3D Open-world Learningcited by 186
  5. 2023CLIP2Scene: Towards Label-efficient 3D Scene Understanding by CLIPcited by 178
  6. 2022PLA: Language-Driven Open-Vocabulary 3D Scene Understandingcited by 176
  7. 2023Segment Any Point Cloud Sequences by Distilling Vision Foundation Modelscited by 123
  8. 2023RegionPLC: Regional Point-Language Contrastive Learning for Open-World 3D Scene Understandingcited by 93
  9. 2023CLIP-FO3D: Learning Free Open-world 3D Scene Representations from 2D Dense CLIPcited by 89
  10. 2023OpenIns3D: Snap and Lookup for 3D Open-vocabulary Instance Segmentationcited by 82
  11. 2023SATR: Zero-Shot Semantic Segmentation of 3D Shapescited by 62
  12. 2023A Survey on Open-Vocabulary Detection and Segmentation: Past, Present, and Futurecited by 59
38 more
  1. 2023Towards Label-free Scene Understanding by Vision Foundation Modelscited by 54
  2. 2023SAMPro3D: Locating SAM Prompts in 3D for Zero-Shot Instance Segmentationcited by 44
  3. 2023Open-Vocabulary Affordance Detection in 3D Point Cloudscited by 41
  4. 2023Lowis3D: Language-Driven Open-World Instance-Level 3D Scene Understandingcited by 38
  5. 2024Segment Any Meshcited by 37
  6. 2022LidarCLIP or: How I Learned to Talk to Point Cloudscited by 33
  7. 2023Zero-Shot 3D Shape Correspondencecited by 33
  8. 20253D-AffordanceLLM: Harnessing Large Language Models for Open-Vocabulary Affordance Detection in 3D Worldscited by 29
  9. 2023Prototype Adaption and Projection for Few- and Zero-shot 3D Point Cloud Semantic Segmentationcited by 26
  10. 2022Open-Vocabulary 3D Detection via Image-level Class and Debiased Cross-modal Contrastive Learningcited by 23
  11. 2023OpenSight: A Simple Open-Vocabulary Framework for LiDAR-Based Object Detectioncited by 22
  12. 2024MeshSegmenter: Zero-Shot Mesh Semantic Segmentation via Texture Synthesiscited by 22
  13. 2023See More and Know More: Zero-shot Point Cloud Segmentation via Multi-modal Visual Datacited by 21
  14. 2023A Survey of Label-Efficient Deep Learning for 3D Point Cloudscited by 20
  15. 20213D Compositional Zero-shot Learning with DeCompositional Consensuscited by 16
  16. 2022Visual Semantic Segmentation Based on Few/Zero-Shot Learning: An Overviewcited by 16
  17. 2024UniM-OV3D: Uni-Modality Open-Vocabulary 3D Scene Understanding with Fine-Grained Feature Representationcited by 15
  18. 2024Open-Vocabulary 3D Semantic Segmentation with Text-to-Image Diffusion Modelscited by 12
  19. 2025LargeAD: Large-Scale Cross-Sensor Data Pretraining for Autonomous Drivingcited by 11
  20. 2022Zero-shot point cloud segmentation by transferring geometric primitivescited by 9
  21. 2023DAE-Net: Deforming Auto-Encoder for fine-grained shape co-segmentationcited by 7
  22. 2022Towards 3D Scene Understanding by Referring Synthetic Modelscited by 6
  23. 2023Uni-Fusion: Universal Continuous Mappingcited by 5
  24. 2022SupeRGB-D: Zero-shot Instance Segmentation in Cluttered Indoor Environmentscited by 4
  25. 2023Open-Pose 3D Zero-Shot Learning: Benchmark and Challengescited by 4
  26. 2023Model2Scene: Learning 3D Scene Representation via Contrastive Language-CAD Models Pre-trainingcited by 3
  27. 2024UniPLV: Towards Label-Efficient Open-World 3D Scene Understanding by Regional Visual Language Supervisioncited by 3
  28. 2024PanoSLAM: Panoptic 3D Scene Reconstruction via Gaussian SLAMcited by 3
  29. 2025PGOV3D: Open-Vocabulary 3D Semantic Segmentation with Partial-to-Global Curriculumcited by 3
  30. 2022Prompt-guided Scene Generation for 3D Zero-Shot Learningcited by 2
  31. 2025Point Linguist Model: Segment Any Object via Bridged Large 3D-Language Modelcited by 2
  32. 2025Generalized Zero-Shot Learning for Point Cloud Segmentation with Evidence-Based Dynamic Calibrationcited by 2
  33. 2022Text2Model: Text-based Model Induction for Zero-shot Image Classificationcited by 1
  34. 2023ChatGPT-guided Semantics for Zero-shot Learningcited by 1
  35. 2023Generalized Robot 3D Vision-Language Model with Fast Rendering and Pre-Training Vision-Language Alignmentcited by 1
  36. 2025EPSegFZ: Efficient Point Cloud Semantic Segmentation for Few- and Zero-Shot Scenarios with Language Guidancecited by 1
  37. 2023Testing the Segment Anything Model on radiology datacited by 0
  38. 20253D-PointZshotS: Geometry-Aware 3D Point Cloud Zero-Shot Semantic Segmentation Narrowing the Visual-Semantic Gapcited by 0

50 most cited of 55 All 55 (JSON)