One-Shot Video Object Segmentation
Not on the map. Why?
Abstract (arXiv)
This paper tackles the task of semi-supervised video object segmentation, i.e., the separation of an object from the background in a video, given the mask of the first frame. We present One-Shot Video Object Segmentation (OSVOS), based on a fully-convolutional neural network architecture that is able to successively transfer generic semantic information, learned on ImageNet, to the task of foreground segmentation, and finally to learning the appearance of a single annotated object of the test sequence (hence one-shot). Although all frames are processed independently, the results are temporally coherent and stable. We perform experiments on two annotated video segmentation databases, which show that OSVOS is fast and improves the state of the art by a significant margin (79.8% vs 68.0%).
Key facts. Cited by 235 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 Nov 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 56; 2022: 53; 2023: 49; 2024: 33; 2025: 28; 2026: 16.
235 papers.
Sort:
By area:
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 439
- 2021Conditional Object-Centric Learning from Videocited by 248
- 2023MOSE: A New Dataset for Video Object Segmentation in Complex Scenescited by 234
- 2021Associating Objects with Transformers for Video Object Segmentationcited by 226
- 2021A Survey of Human-in-the-loop for Machine Learningcited by 215
- 2021Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentationcited by 203
- 2023Putting the Object Back into Video Object Segmentationcited by 188
- 2022Decoupling Features in Hierarchical Propagation for Video Object Segmentationcited by 148
- 2021Self-supervised Video Object Segmentation by Motion Groupingcited by 147
- 2021A Survey on Deep Learning Technique for Video Segmentationcited by 132
- 2021Modular Interactive Video Object Segmentation: Interaction-to-Mask, Propagation and Difference-Aware Fusioncited by 129
38 more
- 2021SSTVOS: Sparse Spatiotemporal Transformers for Video Object Segmentationcited by 106
- 2021Repurposing GANs for One-shot Semantic Part Segmentationcited by 88
- 2021Efficient Regional Memory Network for Video Object Segmentationcited by 86
- 2023Neural Point Catacaustics for Novel-View Synthesis of Reflectionscited by 82
- 2021Rethinking Self-supervised Correspondence Learning: A Video Frame-level Similarity Perspectivecited by 81
- 2022OSOP: A Multi-Stage One Shot Object Pose Estimation Frameworkcited by 81
- 2024SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Treecited by 80
- 2021Full-Duplex Strategy for Video Object Segmentationcited by 78
- 2022LVOS: A Benchmark for Long-term Video Object Segmentationcited by 77
- 2023Audio-Visual Segmentation with Semanticscited by 75
- 2021Video Instance Segmentation with a Propose-Reduce Paradigmcited by 74
- 2023Sensitivity-Aware Visual Parameter-Efficient Fine-Tuningcited by 74
- 2021Hierarchical Memory Matching Network for Video Object Segmentationcited by 72
- 2023General Object Foundation Model for Images and Videos at Scalecited by 71
- 2021SwiftNet: Real-time Video Object Segmentationcited by 67
- 20223D Object Detection from Images for Autonomous Driving: A Surveycited by 66
- 2021Learning Position and Target Consistency for Memory-based Video Object Segmentationcited by 63
- 2022Segmenting Moving Objects via an Object-Centric Layered Representationcited by 63
- 2025MOSEv2: A More Challenging Dataset for Video Object Segmentation in Complex Scenescited by 62
- 2021Joint Inductive and Transductive Learning for Video Object Segmentationcited by 61
- 2022Feature-Proxy Transformer for Few-Shot Segmentationcited by 58
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2023XMem++: Production-level Video Segmentation From Few Annotated Framescited by 53
- 2022Breaking the "Object" in Video Object Segmentationcited by 49
- 2023Self-supervised Object-Centric Learning for Videoscited by 49
- 2023Spectrum-guided Multi-granularity Referring Video Object Segmentationcited by 48
- 2024LVOS: A Benchmark for Large-scale Long-term Video Object Segmentationcited by 44
- 2021Prototypical Cross-Attention Networks for Multiple Object Tracking and Segmentationcited by 43
- 2022Guess What Moves: Unsupervised Video and Image Segmentation by Anticipating Motioncited by 42
- 2022Local-Global Context Aware Transformer for Language-Guided Video Segmentationcited by 41
- 2021Active Boundary Loss for Semantic Segmentationcited by 40
- 2022Per-Clip Video Object Segmentationcited by 40
- 2022Robust Visual Tracking by Segmentationcited by 38
- 2021Reliable Propagation-Correction Modulation for Video Object Segmentationcited by 36
- 2022EDTER: Edge Detection with Transformercited by 36
- 2022Learning Quality-aware Dynamic Memory for Video Object Segmentationcited by 35
- 2022Look Before You Match: Instance Understanding Matters in Video Object Segmentationcited by 34
- 2023CLIP-S4: Language-Guided Self-Supervised Semantic Segmentationcited by 34
50 most cited of 235 All 235 (JSON)
- 2026Shadow Feature Refinement Network: Progressive Feature Refinement based on Knowledge Distillation for Effective Shadow Removal4 Oct 2026
- 2026When Predicting Nothing Beats SAM 3: Revisiting Evaluation in Video Object Segmentation2 Oct 2026
- 2026FiVOS: A Fish Segmentation Algorithm Based on Interactive Video Object Segmentation and Filter Enhancement1 Oct 2026
- 2026SWT: Self-Supervised Video Object Segmentation via Sliding, Wavelet and Transportation22 Sep 2026
- 2026RS3-Prune: Read-Sparse, Store-Sparse Token Pruning for Video Object Segmentation23 Aug 2026
- 2026Efficient Tracking and Understanding Object Transformations22 Jul 2026
- 2026`Attention-Guided Cross-Temporal Clustering for Self-Supervised Video Object Segmentation8 Jul 2026
- 2026Inference-Time Temporal Probability Smoothing for Stable Video Segmentation with SAM2 under Weak Prompts18 Apr 2026
- 2026SynMulti: Synthetic-to-Real Learning for Multimodal Video Understanding14 Apr 2026
- 2026VIRST: Video-Instructed Reasoning Assistant for SpatioTemporal Segmentation28 Mar 2026
- 2026Live Interactive Training for Video Segmentation27 Mar 2026
- 2026UW-VOS: A Large-Scale Dataset for Underwater Video Object Segmentation25 Mar 2026
38 more
- 20263rd Place of MeViS-Audio Track of the 5th PVUW: VIRST-Audio24 Mar 2026
- 2026M2P: Improving Visual Foundation Models with Mask-to-Point Weakly-Supervised Learning for Dense Point Tracking18 Mar 2026
- 20263AM: 3egment Anything with Geometric Consistency in Videos13 Jan 2026
- 2026Few-Shot Video Object Segmentation in X-Ray Angiography Using Local Matching and Spatio-Temporal Consistency Loss2 Jan 2026
- 2025Backdoor Attacks on Prompt-Driven Video Segmentation Foundation Models26 Dec 2025
- 2025Fast SAM2 with Text-Driven Token Pruning24 Dec 2025
- 2025RobotSeg: A Model and Dataset for Segmenting Robots in Image and Video28 Nov 2025
- 2025Segment Anything Across Shots: A Method and Benchmark17 Nov 2025
- 2025Tracking and Understanding Object Transformations6 Nov 2025
- 2025Kernelized Sparse Fine-Tuning with Bi-level Parameter Competition for Vision Models28 Oct 2025
- 2025Is This Tracker On? A Benchmark Protocol for Dynamic Tracking22 Oct 2025
- 2025Robust Ego-Exo Correspondence with Long-Term Memory13 Oct 2025
- 2025The 1st Solution for MOSEv1 Challenge on LSVOS 2025: CGFSeg30 Sep 2025
- 2025Segment-to-Act: Label-Noise-Robust Action-Prompted Video Segmentation Towards Embodied Intelligence20 Sep 2025
- 2025Enriched Feature Representation and Motion Prediction Module for MOSEv2 Track of 7th LSVOS Challenge: 3rd Place Solution19 Sep 2025
- 2025MOSEv2: A More Challenging Dataset for Video Object Segmentation in Complex Scenes7 Aug 2025
- 2025MOVE: Motion-Guided Few-Shot Video Object Segmentation29 Jul 2025
- 2025SAMITE: Position Prompted SAM2 with Calibrated Memory for Visual Object Tracking29 Jul 2025
- 2025Customizable ROI-Based Deep Image Compression1 Jul 2025
- 2025BrokenVideos: A Benchmark Dataset for Fine-Grained Artifact Localization in AI-Generated Videos25 Jun 2025
- 2025A Comprehensive Survey on Video Scene Parsing:Advances, Challenges, and Prospects16 Jun 2025
- 2025THU-Warwick Submission for EPIC-KITCHEN Challenge 2025: Semi-Supervised Video Object Segmentation7 Jun 2025
- 2025SAM-I2V: Upgrading SAM to Support Promptable Video Segmentation with Less than 0.2% Training Cost2 Jun 2025
- 2025CoT-RVS: Zero-Shot Chain-of-Thought Reasoning Segmentation for Videos24 May 2025
- 2025MoSAM: Motion-Guided Segment Anything Model with Spatial-Temporal Memory Selection30 Apr 2025
- 2025RGB-D Video Object Segmentation via Enhanced Multi-store Feature Memory23 Apr 2025
- 2025Studying Image Diffusion Features for Zero-Shot Video Object Segmentation7 Apr 2025
- 2025GISE-TTT:A Framework for Global InformationSegmentation and Enhancement1 Apr 2025
- 2025Leveraging Motion Information for Better Self-Supervised Video Correspondence Learning15 Mar 2025
- 2025Learning segmentation from point trajectories21 Jan 2025
- 2025Few-shot Structure-Informed Machinery Part Segmentation with Foundation Models and Graph Neural Networks17 Jan 2025
- 2025EdgeTAM: On-Device Track Anything Model13 Jan 2025
- 2024LiVOS: Light Video Object Segmentation with Gated Linear Matching5 Nov 2024
- 2024Expanding Sparse Tuning for Low Memory Usage4 Nov 2024
- 2024Continuous Spatio-Temporal Memory Networks for 4D Cardiac Cine MRI Segmentation30 Oct 2024
- 2024SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Tree21 Oct 2024
- 2024Configurable Embodied Data Generation for Class-Agnostic RGB-D Video Segmentation16 Oct 2024
- 2024X-Prompt: Multi-modal Visual Prompt for Video Object Segmentation28 Sep 2024
50 newest of 235 All 235 (JSON)
- 2022Decomposed Knowledge Distillation for Class-Incremental Semantic Segmentationcited by 28
- 2023MobileVOS: Real-Time Video Object Segmentation Contrastive Learning meets Knowledge Distillationcited by 16
- 2026Shadow Feature Refinement Network: Progressive Feature Refinement based on Knowledge Distillation for Effective Shadow Removalcited by 0
- 2026Shadow Feature Refinement Network: Progressive Feature Refinement based on Knowledge Distillation for Effective Shadow Removal4 Oct 2026
- 2023MobileVOS: Real-Time Video Object Segmentation Contrastive Learning meets Knowledge Distillation14 Mar 2023
- 2022Decomposed Knowledge Distillation for Class-Incremental Semantic Segmentation12 Oct 2022
- 2026RS3-Prune: Read-Sparse, Store-Sparse Token Pruning for Video Object Segmentation23 Aug 2026
- 2025Fast SAM2 with Text-Driven Token Pruning24 Dec 2025
- 2024Video Relationship Detection Using Mixture of Expertscited by 1
- 2025Robust Ego-Exo Correspondence with Long-Term Memorycited by 1
- 2025Robust Ego-Exo Correspondence with Long-Term Memory13 Oct 2025
- 2024Video Relationship Detection Using Mixture of Experts6 Mar 2024
- 2021Conditional Object-Centric Learning from Videocited by 248
- 2021Conditional Object-Centric Learning from Video24 Nov 2021
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 439
- 2023MOSE: A New Dataset for Video Object Segmentation in Complex Scenescited by 234
- 2021Associating Objects with Transformers for Video Object Segmentationcited by 226
- 2021A Survey of Human-in-the-loop for Machine Learningcited by 215
- 2021Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentationcited by 203
- 2023Putting the Object Back into Video Object Segmentationcited by 188
- 2022Decoupling Features in Hierarchical Propagation for Video Object Segmentationcited by 148
- 2021Self-supervised Video Object Segmentation by Motion Groupingcited by 147
- 2021A Survey on Deep Learning Technique for Video Segmentationcited by 132
- 2021Modular Interactive Video Object Segmentation: Interaction-to-Mask, Propagation and Difference-Aware Fusioncited by 129
- 2021SSTVOS: Sparse Spatiotemporal Transformers for Video Object Segmentationcited by 106
12 most cited of 221 All 221 (JSON)
- 2026When Predicting Nothing Beats SAM 3: Revisiting Evaluation in Video Object Segmentation2 Oct 2026
- 2026FiVOS: A Fish Segmentation Algorithm Based on Interactive Video Object Segmentation and Filter Enhancement1 Oct 2026
- 2026SWT: Self-Supervised Video Object Segmentation via Sliding, Wavelet and Transportation22 Sep 2026
- 2026Efficient Tracking and Understanding Object Transformations22 Jul 2026
- 2026`Attention-Guided Cross-Temporal Clustering for Self-Supervised Video Object Segmentation8 Jul 2026
- 2026Inference-Time Temporal Probability Smoothing for Stable Video Segmentation with SAM2 under Weak Prompts18 Apr 2026
- 2026Live Interactive Training for Video Segmentation27 Mar 2026
- 2026UW-VOS: A Large-Scale Dataset for Underwater Video Object Segmentation25 Mar 2026
- 20263rd Place of MeViS-Audio Track of the 5th PVUW: VIRST-Audio24 Mar 2026
- 2026M2P: Improving Visual Foundation Models with Mask-to-Point Weakly-Supervised Learning for Dense Point Tracking18 Mar 2026
- 20263AM: 3egment Anything with Geometric Consistency in Videos13 Jan 2026
- 2026Few-Shot Video Object Segmentation in X-Ray Angiography Using Local Matching and Spatio-Temporal Consistency Loss2 Jan 2026
12 newest of 221 All 221 (JSON)