3rd Place Solution for PVUW2023 VSS Track: A Large Model for Semantic Segmentation on VSPW
Not on the map. Why?
Abstract (arXiv)
In this paper, we introduce 3rd place solution for PVUW2023 VSS track. Semantic segmentation is a fundamental task in computer vision with numerous real-world applications. We have explored various image-level visual backbones and segmentation heads to tackle the problem of video semantic segmentation. Through our experimentation, we find that InternImage-H as the backbone and Mask2former as the segmentation head achieves the best performance. In addition, we explore two post-precessing methods: CascadePSP and Segment Anything Model (SAM). Ultimately, our approach obtains 62.60% and 64.84% mIoU on the VSPW test set1 and final test set, respectively, securing the third position in the PVUW2023 VSS track.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 23 references that are in the map. First posted on arXiv 4 Jun 2023.
Builds on
19 of 23 references.
References · 19
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2023Segment Anythingcited by 8,158
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2022A ConvNet for the 2020scited by 3,545
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
- 2018Unified Perceptual Parsing for Scene Understandingcited by 1,265
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
- 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,063
- 2016COCO-Stuff: Thing and Stuff Classes in Contextcited by 858
- 2022Vision Transformer Adapter for Dense Predictionscited by 564
7 more
- 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 479
- 2022BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervisioncited by 302
- 2021Uni-Perceiver: Pre-training Unified Architecture for Generic Perception for Zero-shot and Few-shot Taskscited by 124
- 2020CascadePSP: Toward Class-Agnostic and Very High-Resolution Segmentation via Global and Local Refinementcited by 113
- 2022Uni-Perceiver-MoE: Learning Sparse Generalist Models with Conditional MoEscited by 58
- 2022Uni-Perceiver v2: A Generalist Model for Large-Scale Vision and Vision-Language Taskscited by 57
- 2022Towards All-in-one Pre-training via Maximizing Multi-modal Mutual Informationcited by 31
Built on by
Citing papers per year: 2024: 1.
1 paper.
- 2024Segment Anything for Videos: A Systematic Surveycited by 5
- 2024Segment Anything for Videos: A Systematic Survey31 Jul 2024