PReMVOS: Proposal-generation, Refinement and Merging for Video Object Segmentation
Not on the map. Why?
Abstract (arXiv)
We address semi-supervised video object segmentation, the task of automatically generating accurate and consistent pixel masks for objects in a video sequence, given the first-frame ground truth annotations. Towards this goal, we present the PReMVOS algorithm (Proposal-generation, Refinement and Merging for Video Object Segmentation). Our method separates this problem into two steps, first generating a set of accurate object segmentation mask proposals for each video frame and then selecting and merging these proposals into accurate and temporally consistent pixel-wise object tracks over a video sequence in a way which is designed to specifically tackle the difficult challenges involved with segmenting multiple objects across a video sequence. Our approach surpasses all previous state-of-the-art results on the DAVIS 2017 video object segmentation benchmark with a J & F mean score of 71.6 on the test-dev dataset, and achieves first place in both the DAVIS 2018 Video Object Segmentation Challenge and the YouTube-VOS 1st Large-scale Video Object Segmentation Challenge.
Key facts. Cited by 81 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Jul 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 32; 2022: 23; 2023: 13; 2024: 7; 2025: 2; 2026: 4.
81 papers.
Sort:
By area:
- 2021Conditional Object-Centric Learning from Videocited by 247
- 2021Associating Objects with Transformers for Video Object Segmentationcited by 225
- 2021Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentationcited by 200
- 2022Decoupling Features in Hierarchical Propagation for Video Object Segmentationcited by 146
- 2021Modular Interactive Video Object Segmentation: Interaction-to-Mask, Propagation and Difference-Aware Fusioncited by 129
- 2021SSTVOS: Sparse Spatiotemporal Transformers for Video Object Segmentationcited by 106
- 2021STEP: Segmenting and Tracking Every Pixelcited by 72
- 2021Hierarchical Memory Matching Network for Video Object Segmentationcited by 72
- 2021MOTSynth: How Can Synthetic Data Help Pedestrian Detection and Tracking?cited by 68
- 2021SwiftNet: Real-time Video Object Segmentationcited by 67
- 20214D Panoptic LiDAR Segmentationcited by 64
- 2021Learning Position and Target Consistency for Memory-based Video Object Segmentationcited by 63
38 more
- 2021Joint Inductive and Transductive Learning for Video Object Segmentationcited by 61
- 2022Recurrent Dynamic Embedding for Video Object Segmentationcited by 52
- 2021Opening up Open-World Trackingcited by 50
- 2023Self-supervised Object-Centric Learning for Videoscited by 49
- 2022Breaking the "Object" in Video Object Segmentationcited by 48
- 2022Per-Clip Video Object Segmentationcited by 40
- 2021Reliable Propagation-Correction Modulation for Video Object Segmentationcited by 36
- 2022Learning Quality-aware Dynamic Memory for Video Object Segmentationcited by 35
- 2023Scalable Video Object Segmentation with Simplified Frameworkcited by 29
- 2021Dense Unsupervised Learning for Video Segmentationcited by 26
- 2022Locality-Aware Inter-and Intra-Video Reconstruction for Self-Supervised Correspondence Learningcited by 26
- 2022SWEM: Towards Real-Time Video Object Segmentation with Sequential Weighted Expectation-Maximizationcited by 26
- 2022Global Spectral Filter Memory Network for Video Object Segmentationcited by 22
- 2021HODOR: High-level Object Descriptors for Object Re-segmentation in Video Learned from Static Imagescited by 21
- 2021D^2Conv3D: Dynamic Dilated Convolutions for Object Segmentation in Videoscited by 20
- 2022Scalable Video Object Segmentation with Identification Mechanismcited by 18
- 2022Region Aware Video Object Segmentation with Deep Motion Modelingcited by 18
- 2023PanoVOS: Bridging Non-panoramic and Panoramic Views with Transformer for Video Segmentationcited by 18
- 2023MobileVOS: Real-Time Video Object Segmentation Contrastive Learning meets Knowledge Distillationcited by 16
- 2021TransVOS: Video Object Segmentation with Transformerscited by 15
- 2023Tracking through Containers and Occluders in the Wildcited by 15
- 2024Temporally Consistent Referring Video Object Segmentation with Hybrid Memorycited by 14
- 2021Self-Supervised Video Object Segmentation by Motion-Aware Mask Propagationcited by 11
- 2021Pixel-Level Bijective Matching for Video Object Segmentationcited by 11
- 2021Siamese Network with Interactive Transformer for Video Object Segmentationcited by 11
- 2022Siamese Object Tracking for Unmanned Aerial Vehicle: A Review and Comprehensive Analysiscited by 11
- 2022Towards Robust Video Object Segmentation with Adaptive Object Calibrationcited by 11
- 2021Accelerating Video Object Segmentation with Compressed Videocited by 10
- 2021Generating Masks from Boxes by Mining Spatio-Temporal Consistencies in Videoscited by 8
- 2022Resolving label uncertainty with implicit posterior modelscited by 8
- 2021MUNet: Motion Uncertainty-aware Semi-supervised Video Object Segmentationcited by 7
- 2023Two-shot Video Object Segmentationcited by 7
- 2024Learning Spatial-Semantic Features for Robust Video Object Segmentationcited by 7
- 2021MSN: Efficient Online Mask Selection Network for Video Instance Segmentationcited by 6
- 2022DirectTracker: 3D Multi-Object Tracking Using Direct Image Alignment and Photometric Bundle Adjustmentcited by 6
- 2022Learning to Learn Better for Video Object Segmentationcited by 6
- 2021Breaking Shortcut: Exploring Fully Convolutional Cycle-Consistency for Video Correspondence Learningcited by 5
- 2022Transfer of Representations to Video Label Propagation: Implementation Factors Mattercited by 5
50 most cited of 81 All 81 (JSON)
- 2026FiVOS: A Fish Segmentation Algorithm Based on Interactive Video Object Segmentation and Filter Enhancement1 Oct 2026
- 2026SWT: Self-Supervised Video Object Segmentation via Sliding, Wavelet and Transportation22 Sep 2026
- 2026UW-VOS: A Large-Scale Dataset for Underwater Video Object Segmentation25 Mar 2026
- 2026M2P: Improving Visual Foundation Models with Mask-to-Point Weakly-Supervised Learning for Dense Point Tracking18 Mar 2026
- 2025A Comprehensive Survey on Video Scene Parsing:Advances, Challenges, and Prospects16 Jun 2025
- 2025MoSAM: Motion-Guided Segment Anything Model with Spatial-Temporal Memory Selection30 Apr 2025
- 2024Learning Spatial-Semantic Features for Robust Video Object Segmentation10 Jul 2024
- 2024Dynamic in Static: Hybrid Visual Correspondence for Self-Supervised Video Object Segmentation21 Apr 2024
- 2024Spatial-Temporal Multi-level Association for Video Object Segmentation9 Apr 2024
- 2024Temporally Consistent Referring Video Object Segmentation with Hybrid Memory28 Mar 2024
- 2024Efficient Video Object Segmentation via Modulated Cross-Attention Memory26 Mar 2024
- 2024Video Object Segmentation with Dynamic Query Modulation18 Mar 2024
38 more
- 2024IDPro: Flexible Interactive Video Object Segmentation by ID-queried Concurrent Propagation23 Jan 2024
- 2023SpVOS: Efficient Video Object Segmentation with Triple Sparse Convolution23 Oct 2023
- 2023Self-supervised Object-Centric Learning for Videos10 Oct 2023
- 2023PanoVOS: Bridging Non-panoramic and Panoramic Views with Transformer for Video Segmentation21 Sep 2023
- 2023Joint Modeling of Feature, Correspondence, and a Compressed Memory for Video Object Segmentation25 Aug 2023
- 2023Integrating Boxes and Masks: A Multi-Object Framework for Unified Visual Tracking and Segmentation25 Aug 2023
- 2023Scalable Video Object Segmentation with Simplified Framework19 Aug 2023
- 2023Hierarchical Spatiotemporal Transformers for Video Object Segmentation17 Jul 2023
- 2023TrickVOS: A Bag of Tricks for Video Object Segmentation27 Jun 2023
- 2023Tracking through Containers and Occluders in the Wild4 May 2023
- 2023Two-shot Video Object Segmentation21 Mar 2023
- 2023InstMove: Instance Motion for Object-centric Video Segmentation14 Mar 2023
- 2023MobileVOS: Real-Time Video Object Segmentation Contrastive Learning meets Knowledge Distillation14 Mar 2023
- 2023Flow-guided Semi-supervised Video Object Segmentation25 Jan 2023
- 2022Learning a Fast 3D Spectral Approach to Object Segmentation and Tracking over Space and Time15 Dec 2022
- 2022Breaking the "Object" in Video Object Segmentation12 Dec 2022
- 2022Learning to Learn Better for Video Object Segmentation5 Dec 2022
- 2022Decoupling Features in Hierarchical Propagation for Video Object Segmentation18 Oct 2022
- 2022Global Spectral Filter Memory Network for Video Object Segmentation11 Oct 2022
- 2022Time-Space Transformers for Video Panoptic Segmentation7 Oct 2022
- 2022DirectTracker: 3D Multi-Object Tracking Using Direct Image Alignment and Photometric Bundle Adjustment29 Sep 2022
- 2022Pixel-Level Equalized Matching for Video Object Segmentation4 Sep 2022
- 2022SWEM: Towards Real-Time Video Object Segmentation with Sequential Weighted Expectation-Maximization22 Aug 2022
- 2022Two-Stream Networks for Object Segmentation in Videos8 Aug 2022
- 2022Per-Clip Video Object Segmentation3 Aug 2022
- 2022Region Aware Video Object Segmentation with Deep Motion Modeling21 Jul 2022
- 2022Learning Quality-aware Dynamic Memory for Video Object Segmentation16 Jul 2022
- 2022Towards Robust Video Object Segmentation with Adaptive Object Calibration2 Jul 2022
- 2022Siamese Object Tracking for Unmanned Aerial Vehicle: A Review and Comprehensive Analysis9 May 2022
- 2022Recurrent Dynamic Embedding for Video Object Segmentation8 May 2022
- 2022Self-Supervised Video Object Segmentation via Cutout Prediction and Tagging22 Apr 2022
- 2022Adaptive Memory Management for Video Object Segmentation13 Apr 2022
- 2022Locality-Aware Inter-and Intra-Video Reconstruction for Self-Supervised Correspondence Learning27 Mar 2022
- 2022Scalable Video Object Segmentation with Identification Mechanism22 Mar 2022
- 2022Transfer of Representations to Video Label Propagation: Implementation Factors Matter10 Mar 2022
- 2022Resolving label uncertainty with implicit posterior models28 Feb 2022
- 2022Box Supervised Video Segmentation Proposal Network14 Feb 2022
- 2021Siamese Network with Interactive Transformer for Video Object Segmentation28 Dec 2021
50 newest of 81 All 81 (JSON)
- 2021Conditional Object-Centric Learning from Videocited by 247
- 2021Conditional Object-Centric Learning from Video24 Nov 2021
- 2021Associating Objects with Transformers for Video Object Segmentationcited by 225
- 2021Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentationcited by 200
- 2022Decoupling Features in Hierarchical Propagation for Video Object Segmentationcited by 146
- 2021Modular Interactive Video Object Segmentation: Interaction-to-Mask, Propagation and Difference-Aware Fusioncited by 129
- 2021SSTVOS: Sparse Spatiotemporal Transformers for Video Object Segmentationcited by 106
- 2021STEP: Segmenting and Tracking Every Pixelcited by 72
- 2021Hierarchical Memory Matching Network for Video Object Segmentationcited by 72
- 2021MOTSynth: How Can Synthetic Data Help Pedestrian Detection and Tracking?cited by 68
- 2021SwiftNet: Real-time Video Object Segmentationcited by 67
- 20214D Panoptic LiDAR Segmentationcited by 64
- 2021Learning Position and Target Consistency for Memory-based Video Object Segmentationcited by 63
- 2021Joint Inductive and Transductive Learning for Video Object Segmentationcited by 61
12 most cited of 80 All 80 (JSON)
- 2026FiVOS: A Fish Segmentation Algorithm Based on Interactive Video Object Segmentation and Filter Enhancement1 Oct 2026
- 2026SWT: Self-Supervised Video Object Segmentation via Sliding, Wavelet and Transportation22 Sep 2026
- 2026UW-VOS: A Large-Scale Dataset for Underwater Video Object Segmentation25 Mar 2026
- 2026M2P: Improving Visual Foundation Models with Mask-to-Point Weakly-Supervised Learning for Dense Point Tracking18 Mar 2026
- 2025A Comprehensive Survey on Video Scene Parsing:Advances, Challenges, and Prospects16 Jun 2025
- 2025MoSAM: Motion-Guided Segment Anything Model with Spatial-Temporal Memory Selection30 Apr 2025
- 2024Learning Spatial-Semantic Features for Robust Video Object Segmentation10 Jul 2024
- 2024Dynamic in Static: Hybrid Visual Correspondence for Self-Supervised Video Object Segmentation21 Apr 2024
- 2024Spatial-Temporal Multi-level Association for Video Object Segmentation9 Apr 2024
- 2024Temporally Consistent Referring Video Object Segmentation with Hybrid Memory28 Mar 2024
- 2024Efficient Video Object Segmentation via Modulated Cross-Attention Memory26 Mar 2024
- 2024Video Object Segmentation with Dynamic Query Modulation18 Mar 2024
12 newest of 80 All 80 (JSON)