mlsanityData to 14 Oct 2026

2nd Place Solution for PVUW Challenge 2024: Video Panoptic Segmentation

arXiv 2406.00500 ↗First posted 1 Jun 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Video Panoptic Segmentation (VPS) is a challenging task that is extends from image panoptic segmentation.VPS aims to simultaneously classify, track, segment all objects in a video, including both things and stuff. Due to its wide application in many downstream tasks such as video understanding, video editing, and autonomous driving. In order to deal with the task of video panoptic segmentation in the wild, we propose a robust integrated video panoptic segmentation solution. We use DVIS++ framework as our baseline to generate the initial masks. Then,we add an additional image semantic segmentation model to further improve the performance of semantic classes.Finally, our method achieves state-of-the-art performance with a VPQ score of 56.36 and 57.12 in the development and test phases, respectively, and ultimately ranked 2nd in the VPS track of the PVUW Challenge at CVPR2024.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 23 references that are in the map. First posted on arXiv 1 Jun 2024.

Builds on

21 of 23 references.

References · 21

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
  4. 2018Panoptic Segmentationcited by 802
  5. 2019Panoptic Feature Pyramid Networkscited by 645
  6. 2022Vision Transformer Adapter for Dense Predictionscited by 565
  7. 2019Panoptic-DeepLabcited by 363
  8. 2020MaX-DeepLab: End-to-End Panoptic Segmentation with Mask Transformerscited by 355
  9. 2019UPSNet: A Unified Panoptic Segmentation Networkcited by 175
  10. 2020Video Panoptic Segmentationcited by 142
  11. 2020ViP-DeepLab: Learning Visual Perception with Depth-aware Video Panoptic Segmentationcited by 96
  12. 2023DVIS: Decoupled Video Instance Segmentation Frameworkcited by 77
9 more
  1. 2021STEP: Segmenting and Tracking Every Pixelcited by 73
  2. 2018Attention-guided Unified Network for Panoptic Segmentationcited by 71
  3. 2019An End-to-End Network for Panoptic Segmentationcited by 46
  4. 2023DVIS++: Improved Decoupled Framework for Universal Video Segmentationcited by 46
  5. 2021Slot-VPS: Object-centric Representation Learning for Video Panoptic Segmentationcited by 24
  6. 2023Video-kMaX: A Simple Unified Approach for Online and Near-Online Video Panoptic Segmentationcited by 24
  7. 2023ReMaX: Relaxing for Better Training on Efficient Panoptic Segmentationcited by 18
  8. 20231st Place Solution for PVUW Challenge 2023: Video Panoptic Segmentationcited by 7
  9. 2023A Simple Video Segmenter by Tracking Objects Along Axial Trajectoriescited by 3

Built on by

Not cited yet.