VVitCutLER: Towards Unsupervised Object Detection and Segmentation in Videos
Not on the map. Why?
Abstract (arXiv)
Unsupervised pixel-level video understanding remains challenging in real-world scenarios, where motion blur, occlusion, and fast object dynamics often cause temporal drift and flickering pseudo-labels.We propose VVitCutLER, an unsupervised framework for video object detection and instance segmentation, which improves the quality of pseudo-labels through temporal consistency. Our core contribution is VitCut, a temporarily stable pseudo-label generator that reduces error accumulation during field degradation through cross-frame region consistency. Meanwhile, VitCut uses a distillation decoder to achieve effective instance mask prediction. Then, based on VitCut, VVitCutLER further integrates cross-frame feature aggregation to enhance video-level robustness. Extensive experiments on standard video benchmarks demonstrate that VVitCutLER significantly improves detection and segmentation performance while reducing temporal instability. These results highlight the importance of temporally consistent supervision for robust pixel-level video understanding.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 43 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
36 of 43 references.
References · 36
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,162
- 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
- 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,276
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
- 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 910
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
24 more
- 2021Localizing Objects with Self-Supervised Transformers and no Labelscited by 230
- 2023MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressionscited by 228
- 2023Cut and Learn for Unsupervised Object Detection and Instance Segmentationcited by 187
- 2017Flow-Guided Feature Aggregation for Video Object Detectioncited by 177
- 2021Self-supervised Video Object Segmentation by Motion Groupingcited by 147
- 2021TCLR: Temporal Contrastive Learning for Video Representationcited by 136
- 2019Sequence Level Semantics Aggregation for Video Object Detectioncited by 87
- 2019Unsupervised Moving Object Detection via Contextual Information Separationcited by 72
- 2019Motion Guided Attention for Video Salient Object Detectioncited by 72
- 2020TubeTK: Adopting Tubes to Track Multi-Object in a One-Step Training Modelcited by 70
- 2016Seq-NMS for Video Object Detectioncited by 68
- 2016T-CNN: Tubelets with Convolutional Neural Networks for Object Detection from Videoscited by 67
- 2022Segmenting Moving Objects via an Object-Centric Layered Representationcited by 63
- 2023VideoCutLER: Surprisingly Simple Unsupervised Video Instance Segmentationcited by 37
- 2025MeViS: A Multi-Modal Dataset for Referring Motion Expression Video Segmentationcited by 35
- 2022YOLOV: Making Still Image Object Detectors Great at Video Object Detectioncited by 18
- 2024CuVLER: Enhanced Unsupervised Object Discoveries through Exhaustive Self-Supervised Transformerscited by 16
- 2022Solve the Puzzle of Instance Segmentation in Videos: A Weakly Supervised Framework with Spatio-Temporal Collaborationcited by 11
- 2017Unsupervised object segmentation in video by efficient selection of highly probable positive featurescited by 8
- 20211st Place Solution for YouTubeVOS Challenge 2021:Video Instance Segmentationcited by 6
- 2024Practical Video Object Detection via Feature Selection and Aggregationcited by 5
- 2024Distributed Intelligent Video Surveillance for Early Armed Robbery Detection based on Deep Learningcited by 2
- 2025FlowCut: Unsupervised Video Instance Segmentation via Temporal Mask Matchingcited by 2
- 2024Learning Temporal Cues by Predicting Objects Move for Multi-camera 3D Object Detectioncited by 1
Built on by
Not cited yet.