Semi-supervised Video Semantic Segmentation Using Unreliable Pseudo Labels for PVUW2024
Not on the map. Why?
Abstract (arXiv)
Pixel-level Scene Understanding is one of the fundamental problems in computer vision, which aims at recognizing object classes, masks and semantics of each pixel in the given image. Compared with image scene parsing, video scene parsing introduces temporal information, which can effectively improve the consistency and accuracy of prediction,because the real-world is actually video-based rather than a static state. In this paper, we adopt semi-supervised video semantic segmentation method based on unreliable pseudo labels. Then, We ensemble the teacher network model with the student network model to generate pseudo labels and retrain the student network. Our method achieves the mIoU scores of 63.71% and 67.83% on development test and final test respectively. Finally, we obtain the 1st place in the Video Scene Parsing in the Wild Challenge at CVPR 2024.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 21 references that are in the map. First posted on arXiv 2 Jun 2024.
Builds on
16 of 21 references.
References · 16
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2022Vision Transformer Adapter for Dense Predictionscited by 564
- 2022Semi-Supervised Semantic Segmentation Using Unreliable Pseudo-Labelscited by 218
- 2016Deep Feature Flow for Video Recognitioncited by 186
- 2023ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalitiescited by 117
- 2023DVIS: Decoupled Video Instance Segmentation Frameworkcited by 77
- 2020Efficient Semantic Video Segmentation with Per-frame Inferencecited by 63
- 2018Low-Latency Video Semantic Segmentationcited by 61
- 2021Temporal Memory Attention for Video Semantic Segmentationcited by 49
4 more
- 2022Mining Relations among Cross-Frame Affinities for Video Semantic Segmentationcited by 25
- 2024Zero-Shot Video Semantic Segmentation based on Pre-Trained Diffusion Modelscited by 12
- 2023Agronav: Autonomous Navigation Framework for Agricultural Robots and Vehicles using Semantic Segmentation and Semantic Line Detectioncited by 9
- 2023Semantic Segmentation on VSPW Dataset through Contrastive Loss and Multi-dataset Training Approachcited by 1
Built on by
Not cited yet.