mlsanityData to 7 Oct 2026

LSVOS Challenge Report: Large-scale Complex and Long Video Object Segmentation

arXiv 2409.05847 ↗First posted 9 Sep 2024cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

Despite the promising performance of current video segmentation models on existing benchmarks, these models still struggle with complex scenes. In this paper, we introduce the 6th Large-scale Video Object Segmentation (LSVOS) challenge in conjunction with ECCV 2024 workshop. This year's challenge includes two tasks: Video Object Segmentation (VOS) and Referring Video Object Segmentation (RVOS). In this year, we replace the classic YouTube-VOS and YouTube-RVOS benchmark with latest datasets MOSE, LVOS, and MeViS to assess VOS under more challenging complex environments. This year's challenge attracted 129 registered teams from more than 20 institutes across over 8 countries. This report include the challenge and dataset introduction, and the methods used by top 7 teams in two tracks. More details can be found in our homepage https://lsvos.github.io/.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 38 of its 50 references that are in the map. First posted on arXiv 9 Sep 2024.

Builds on

38 of 50 references.

References · 38

  1. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  2. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  3. 2019Video Instance Segmentationcited by 391
  4. 2018YouTube-VOS: A Large-Scale Video Object Segmentation Benchmarkcited by 381
  5. 2023Segment Anything in High Qualitycited by 373
  6. 2023GRES: Generalized Referring Expression Segmentationcited by 252
  7. 2021Vision-Language Transformer and Query Generation for Referring Segmentationcited by 239
  8. 2023MOSE: A New Dataset for Video Object Segmentation in Complex Scenescited by 232
  9. 2018YouTube-VOS: Sequence-to-Sequence Video Object Segmentationcited by 228
  10. 2023MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressionscited by 225
  11. 2023Universal Instance Perception as Object Discovery and Retrievalcited by 190
  12. 2023Putting the Object Back into Video Object Segmentationcited by 182
26 more
  1. 2023Towards Open Vocabulary Learning: A Surveycited by 165
  2. 2018Video Object Segmentation with Language Referring Expressionscited by 161
  3. 2016Learning Video Object Segmentation from Static Imagescited by 151
  4. 2023Transformer-Based Visual Segmentation: A Surveycited by 124
  5. 2018Multilingual Constituency Parsing with Self-Attention and Pre-Trainingcited by 117
  6. 2022VLT: Vision-Language Transformer and Query Generation for Referring Segmentationcited by 110
  7. 2023DVIS: Decoupled Video Instance Segmentation Frameworkcited by 77
  8. 2022LVOS: A Benchmark for Long-term Video Object Segmentationcited by 76
  9. 2018Fast and Accurate Online Video Object Segmentation via Tracking Partscited by 57
  10. 2024Decoupling Static and Hierarchical Motion Perception for Referring Video Segmentationcited by 55
  11. 2020State-Aware Tracker for Real-Time Video Object Segmentationcited by 54
  12. 2023Referred by Multi-Modality: A Unified Temporal Transformer for Video Object Segmentationcited by 54
  13. 2016Video Propagation Networkscited by 45
  14. 2022Instance-Specific Feature Propagation for Referring Segmentationcited by 45
  15. 2024LVOS: A Benchmark for Large-scale Long-term Video Object Segmentationcited by 41
  16. 2023GREC: Generalized Referring Expression Comprehensioncited by 39
  17. 2020Fast Video Object Segmentation With Temporal Aggregation Network and Dynamic Template Matchingcited by 37
  18. 2023Multi-Modal Mutual Attention and Iterative Interaction for Referring Image Segmentationcited by 36
  19. 2021Referring Segmentation in Images and Videos with Cross-Modal Self-Attention Networkcited by 28
  20. 2022Video Mask Transfiner for High-Quality Video Instance Segmentationcited by 28
  21. 2019MHP-VOS: Multiple Hypotheses Propagation for Video Object Segmentationcited by 20
  22. 2024PVUW 2024 Challenge on Complex Video Understanding: Methods and Resultscited by 12
  23. 2024Learning Spatial-Semantic Features for Robust Video Object Segmentationcited by 7
  24. 20221st Place Solution for YouTubeVOS Challenge 2022: Referring Video Object Segmentationcited by 5
  25. 2022The Second Place Solution for The 4th Large-scale Video Object Segmentation Challenge--Track 3: Referring Video Object Segmentationcited by 3
  26. 20241st Place Solution for 5th LSVOS Challenge: Referring Video Object Segmentationcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 6; 2026: 2.

8 papers.

  1. 2025MOSEv2: A More Challenging Dataset for Video Object Segmentation in Complex Scenescited by 59
  2. 2025PVUW 2025 Challenge Report: Advances in Pixel-level Understanding of Complex Videos in the Wildcited by 5
  3. 2025LSVOS 2025 Challenge Report: Recent Advances in Complex Video Object Segmentationcited by 4
  4. 2025The 1st Solution for 4th PVUW MeViS Challenge: Unleashing the Potential of Large Multimodal Models for Referring Video Segmentationcited by 3
  5. 2026Report of the 5th PVUW Challenge: Towards More Diverse Modalities in Pixel-Level Understandingcited by 1
  6. 2025Planner-Refiner: Dynamic Space-Time Refinement for Vision-Language Alignment in Videoscited by 0
  7. 2025Enriched Feature Representation and Motion Prediction Module for MOSEv2 Track of 7th LSVOS Challenge: 3rd Place Solutioncited by 0
  8. 2026Motion-Aware Reasoning from Speech to Mask Tracks: Runner-up Solution for the MeViS-Audio Track of the 8th LSVOS Challenge 2026cited by 0