mlsanityData to 7 Oct 2026

YouTube-VOS: A Large-Scale Video Object Segmentation Benchmark

arXiv 1809.03327 ↗First posted 6 Sep 2018cs.CV cs.AIcited by 381

Not on the map. Why?

Abstract (arXiv)

Learning long-term spatial-temporal features are critical for many video analysis tasks. However, existing video segmentation methods predominantly rely on static image segmentation techniques, and methods capturing temporal dependency for segmentation have to depend on pretrained optical flow models, leading to suboptimal solutions for the problem. End-to-end sequential learning to explore spatialtemporal features for video segmentation is largely limited by the scale of available video segmentation datasets, i.e., even the largest video segmentation dataset only contains 90 short video clips. To solve this problem, we build a new large-scale video object segmentation dataset called YouTube Video Object Segmentation dataset (YouTube-VOS). Our dataset contains 4,453 YouTube video clips and 94 object categories. This is by far the largest video object segmentation dataset to our knowledge and has been released at http://youtube-vos.org. We further evaluate several existing state-of-the-art video object segmentation algorithms on this dataset which aims to establish baselines for the development of new algorithms in the future.

Key facts. Cited by 381 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Sep 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 38; 2022: 52; 2023: 88; 2024: 80; 2025: 75; 2026: 48.

381 papers.

Sort:

By area:

  1. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  2. 2023Segment Everything Everywhere All at Oncecited by 546
  3. 2023Emergent Correspondence from Image Diffusioncited by 437
  4. 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 436
  5. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
  6. 2022Generalized Decoding for Pixel, Image, and Languagecited by 292
  7. 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 258
  8. 2021Associating Objects with Transformers for Video Object Segmentationcited by 225
  9. 2023MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressionscited by 225
  10. 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 213
  11. 2023Sequential Modeling Enables Scalable Learning for Large Vision Modelscited by 212
  12. 2023Video Understanding with Large Language Models: A Surveycited by 203
38 more
  1. 2021Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentationcited by 200
  2. 2023Tracking Anything with Decoupled Video Segmentationcited by 197
  3. 2023SegGPT: Segmenting Everything In Contextcited by 193
  4. 2023Universal Instance Perception as Object Discovery and Retrievalcited by 190
  5. 2023Putting the Object Back into Video Object Segmentationcited by 182
  6. 2022Language as Queries for Referring Video Object Segmentationcited by 180
  7. 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 169
  8. 2021Occluded Video Instance Segmentation: A Benchmarkcited by 154
  9. 2021Self-supervised Video Object Segmentation by Motion Groupingcited by 147
  10. 2022Decoupling Features in Hierarchical Propagation for Video Object Segmentationcited by 146
  11. 2022EPIC-KITCHENS VISOR Benchmark: VIdeo Segmentations and Object Relationscited by 139
  12. 2021Unidentified Video Objects: A Benchmark for Dense, Open-World Segmentationcited by 133
  13. 2021A Survey on Deep Learning Technique for Video Segmentationcited by 132
  14. 2021Modular Interactive Video Object Segmentation: Interaction-to-Mask, Propagation and Difference-Aware Fusioncited by 129
  15. 2023Transformer-Based Visual Segmentation: A Surveycited by 124
  16. 2023FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimationcited by 114
  17. 2022SimpleClick: Interactive Image Segmentation with Simple Vision Transformerscited by 109
  18. 2021SSTVOS: Sparse Spatiotemporal Transformers for Video Object Segmentationcited by 106
  19. 2021Cross-Modal Progressive Comprehension for Referring Segmentationcited by 102
  20. 2022FocalClick: Towards Practical Interactive Image Segmentationcited by 101
  21. 2025HD-EPIC: A Highly-Detailed Egocentric Video Datasetcited by 101
  22. 2024Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videoscited by 96
  23. 2021FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpaintingcited by 94
  24. 2022MinVIS: A Minimal Video Instance Segmentation Framework without Video-based Trainingcited by 94
  25. 2022Towards Grand Unification of Object Trackingcited by 93
  26. 2024SAMURAI: Adapting Segment Anything Model for Zero-Shot Visual Tracking with Motion-Aware Memorycited by 91
  27. 2021BundleTrack: 6D Pose Tracking for Novel Objects without Instance or Category-Level 3D Modelscited by 87
  28. 2023VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimationcited by 82
  29. 2023Segment Anything Meets Point Trackingcited by 81
  30. 2024SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Treecited by 77
  31. 2023General Object Foundation Model for Images and Videos at Scalecited by 71
  32. 2022BURST: A Benchmark for Unifying Object Recognition, Segmentation and Tracking in Videocited by 66
  33. 2022Segmenting Moving Objects via an Object-Centric Layered Representationcited by 63
  34. 2024Embodied Understanding of Driving Scenarioscited by 63
  35. 2024A Distractor-Aware Memory for Visual Object Tracking with SAM2cited by 63
  36. 2021The Multi-Temporal Urban Development SpaceNet Datasetcited by 62
  37. 2025InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset Constructioncited by 62
  38. 2021Joint Inductive and Transductive Learning for Video Object Segmentationcited by 61

50 most cited of 381 All 381 (JSON)