Video Object Segmentation with Adaptive Feature Bank and Uncertain-Region Refinement
Not on the map. Why?
Abstract (arXiv)
We propose a new matching-based framework for semi-supervised video object segmentation (VOS). Recently, state-of-the-art VOS performance has been achieved by matching-based algorithms, in which feature banks are created to store features for region matching and classification. However, how to effectively organize information in the continuously growing feature bank remains under-explored, and this leads to inefficient design of the bank. We introduce an adaptive feature bank update scheme to dynamically absorb new features and discard obsolete features. We also design a new confidence loss and a fine-grained segmentation module to enhance the segmentation accuracy in uncertain regions. On public benchmarks, our algorithm outperforms existing state-of-the-arts.
Key facts. Cited by 101 papers in the map (data through 14 Oct 2026). First posted on arXiv 15 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 22; 2023: 29; 2024: 20; 2025: 14; 2026: 3.
101 papers.
Sort:
By area:
- 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 439
- 2023Personalize Segment Anything Model with One Shotcited by 250
- 2021Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentationcited by 203
- 2023SegGPT: Segmenting Everything In Contextcited by 194
- 2023Putting the Object Back into Video Object Segmentationcited by 188
- 2023Matcher: Segment Anything with One Shot Using All-Purpose Feature Matchingcited by 142
- 2021A Survey on Deep Learning Technique for Video Segmentationcited by 132
- 2023Segment Anything Meets Point Trackingcited by 81
- 2024SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Treecited by 80
- 2022LVOS: A Benchmark for Long-term Video Object Segmentationcited by 77
- 2021Hierarchical Memory Matching Network for Video Object Segmentationcited by 72
- 2021Learning Position and Target Consistency for Memory-based Video Object Segmentationcited by 63
38 more
- 2022Correlation-Aware Deep Trackingcited by 62
- 2023XMem++: Production-level Video Segmentation From Few Annotated Framescited by 53
- 2022Recurrent Dynamic Embedding for Video Object Segmentationcited by 52
- 2024Vivim: a Video Vision Mamba for Medical Video Segmentationcited by 52
- 2022Breaking the "Object" in Video Object Segmentationcited by 49
- 2024LVOS: A Benchmark for Large-scale Long-term Video Object Segmentationcited by 44
- 2022Per-Clip Video Object Segmentationcited by 40
- 2022Hierarchical Feature Alignment Network for Unsupervised Video Object Segmentationcited by 37
- 2021Reliable Propagation-Correction Modulation for Video Object Segmentationcited by 36
- 2022Learning Quality-aware Dynamic Memory for Video Object Segmentationcited by 35
- 2022Look Before You Match: Instance Understanding Matters in Video Object Segmentationcited by 34
- 2023Scalable Video Object Segmentation with Simplified Frameworkcited by 29
- 2022Locality-Aware Inter-and Intra-Video Reconstruction for Self-Supervised Correspondence Learningcited by 26
- 2022SWEM: Towards Real-Time Video Object Segmentation with Sequential Weighted Expectation-Maximizationcited by 26
- 2025Advancing Complex Video Object Segmentation via Progressive Concept Constructioncited by 26
- 2022Global Spectral Filter Memory Network for Video Object Segmentationcited by 22
- 2023UniRef++: Segment Every Reference Object in Spatial and Temporal Spacescited by 22
- 2024RMem: Restricted Memory Banks Improve Video Object Segmentationcited by 22
- 2021VIL-100: A New Dataset and A Baseline Model for Video Instance Lane Detectioncited by 21
- 2021HODOR: High-level Object Descriptors for Object Re-segmentation in Video Learned from Static Imagescited by 21
- 2023Boosting Video Object Segmentation via Space-time Correspondence Learningcited by 21
- 2025EdgeTAM: On-Device Track Anything Modelcited by 21
- 2022Region Aware Video Object Segmentation with Deep Motion Modelingcited by 19
- 2024A Simple Image Segmentation Framework via In-Context Examplescited by 19
- 2022Scalable Video Object Segmentation with Identification Mechanismcited by 18
- 2023PanoVOS: Bridging Non-panoramic and Panoramic Views with Transformer for Video Segmentationcited by 18
- 2022Tackling Background Distraction in Video Object Segmentationcited by 16
- 2022Visual Semantic Segmentation Based on Few/Zero-Shot Learning: An Overviewcited by 16
- 2023MobileVOS: Real-Time Video Object Segmentation Contrastive Learning meets Knowledge Distillationcited by 16
- 2023Unified Mask Embedding and Correspondence Learning for Self-Supervised Video Segmentationcited by 16
- 2023Shifting More Attention to Breast Lesion Segmentation in Ultrasound Videoscited by 16
- 2021TransVOS: Video Object Segmentation with Transformerscited by 15
- 2022BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentationcited by 14
- 2023ADNet: Lane Shape Prediction via Anchor Decompositioncited by 14
- 2024Temporally Consistent Referring Video Object Segmentation with Hybrid Memorycited by 14
- 2024Biomedical SAM 2: Segment Anything in Biomedical Images and Videoscited by 14
- 2023ARKitTrack: A New Diverse Dataset for Tracking Using Mobile RGB-D Datacited by 12
- 2021Self-Supervised Video Object Segmentation by Motion-Aware Mask Propagationcited by 11
50 most cited of 101 All 101 (JSON)
- 2026CMTM: Cross-Modal Token Modulation for Unsupervised Video Object Segmentation16 Apr 2026
- 2026PanoSAM2: Lightweight Distortion- and Memory-aware Adaptions of SAM2 for 360 Video Object Segmentation9 Apr 2026
- 2026Show Me When and Where: Towards Referring Video Object Segmentation in the Wild15 Mar 2026
- 2025Nav-R2 Dual-Relation Reasoning for Generalizable Open-Vocabulary Object-Goal Navigation2 Dec 2025
- 2025Image Diffusion Models Exhibit Emergent Temporal Propagation in Videos25 Nov 2025
- 2025Tracking and Understanding Object Transformations6 Nov 2025
- 2025Track-On2: Enhancing Online Point Tracking with Memory23 Sep 2025
- 2025DepthFlow: Exploiting Depth-Flow Structural Correlations for Unsupervised Video Object Segmentation26 Jul 2025
- 2025HQ-SMem: Video Segmentation and Tracking Using Memory Efficient Object Embedding With Selective Update and Self-Supervised Distillation Feedback25 Jul 2025
- 2025Advancing Complex Video Object Segmentation via Progressive Concept Construction21 Jul 2025
- 2025THU-Warwick Submission for EPIC-KITCHEN Challenge 2025: Semi-Supervised Video Object Segmentation7 Jun 2025
- 2025Enhancing Self-Supervised Fine-Grained Video Object Tracking with Dynamic Memory Prediction30 Apr 2025
38 more
- 2025GISE-TTT:A Framework for Global InformationSegmentation and Enhancement1 Apr 2025
- 2025One-Shot Medical Video Object Segmentation via Temporal Contrastive Memory Networks19 Mar 2025
- 2025Leveraging Motion Information for Better Self-Supervised Video Correspondence Learning15 Mar 2025
- 2025Learning Motion and Temporal Cues for Unsupervised Video Object Segmentation14 Jan 2025
- 2025EdgeTAM: On-Device Track Anything Model13 Jan 2025
- 2024SMITE: Segment Me In TimE24 Oct 2024
- 2024SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Tree21 Oct 2024
- 2024A Simple Image Segmentation Framework via In-Context Examples7 Oct 2024
- 2024Continual Learning of Conjugated Visual Representations through Higher-order Motion Flows16 Sep 2024
- 2024Timeline and Boundary Guided Diffusion Network for Video Shadow Detection21 Aug 2024
- 2024Biomedical SAM 2: Segment Anything in Biomedical Images and Videos6 Aug 2024
- 2024Strike the Balance: On-the-Fly Uncertainty based User Interactions for Long-Term Video Object Segmentation31 Jul 2024
- 2024Improving Unsupervised Video Object Segmentation via Fake Flow Generation16 Jul 2024
- 2024Learning Spatial-Semantic Features for Robust Video Object Segmentation10 Jul 2024
- 2024RMem: Restricted Memory Banks Improve Video Object Segmentation12 Jun 2024
- 2024Training-Free Robust Interactive Video Object Segmentation8 Jun 2024
- 2024DeVOS: Flow-Guided Deformable Transformer for Video Object Segmentation11 May 2024
- 2024Deep video representation learning: a survey10 May 2024
- 2024LVOS: A Benchmark for Large-scale Long-term Video Object Segmentation30 Apr 2024
- 2024360VOTS: Visual Object Tracking and Segmentation in Omnidirectional Videos22 Apr 2024
- 2024Spatial-Temporal Multi-level Association for Video Object Segmentation9 Apr 2024
- 2024Temporally Consistent Referring Video Object Segmentation with Hybrid Memory28 Mar 2024
- 2024Efficient Video Object Segmentation via Modulated Cross-Attention Memory26 Mar 2024
- 2024A Spatial-Temporal Progressive Fusion Network for Breast Lesion Segmentation in Ultrasound Videos18 Mar 2024
- 2024Vivim: a Video Vision Mamba for Medical Video Segmentation25 Jan 2024
- 2023UniRef++: Segment Every Reference Object in Spatial and Temporal Spaces25 Dec 2023
- 2023Hierarchical Graph Pattern Understanding for Zero-Shot VOS15 Dec 2023
- 2023TAM-VT: Transformation-Aware Multi-scale Video Transformer for Segmentation and Tracking13 Dec 2023
- 2023SpVOS: Efficient Video Object Segmentation with Triple Sparse Convolution23 Oct 2023
- 2023Putting the Object Back into Video Object Segmentation19 Oct 2023
- 2023Shifting More Attention to Breast Lesion Segmentation in Ultrasound Videos3 Oct 2023
- 2023Memory-Efficient Continual Learning Object Segmentation for Long Video26 Sep 2023
- 2023Treating Motion as Option with Output Selection for Unsupervised Video Object Segmentation26 Sep 2023
- 2023PanoVOS: Bridging Non-panoramic and Panoramic Views with Transformer for Video Segmentation21 Sep 2023
- 2023Joint Modeling of Feature, Correspondence, and a Compressed Memory for Video Object Segmentation25 Aug 2023
- 2023Integrating Boxes and Masks: A Multi-Object Framework for Unified Visual Tracking and Segmentation25 Aug 2023
- 2023ADNet: Lane Shape Prediction via Anchor Decomposition21 Aug 2023
- 2023Scalable Video Object Segmentation with Simplified Framework19 Aug 2023
50 newest of 101 All 101 (JSON)
- 2024Vivim: a Video Vision Mamba for Medical Video Segmentationcited by 52
- 2024Vivim: a Video Vision Mamba for Medical Video Segmentation25 Jan 2024
- 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 439
- 2023Personalize Segment Anything Model with One Shotcited by 250
- 2021Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentationcited by 203
- 2023SegGPT: Segmenting Everything In Contextcited by 194
- 2023Putting the Object Back into Video Object Segmentationcited by 188
- 2023Matcher: Segment Anything with One Shot Using All-Purpose Feature Matchingcited by 142
- 2021A Survey on Deep Learning Technique for Video Segmentationcited by 132
- 2023Segment Anything Meets Point Trackingcited by 81
- 2024SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Treecited by 80
- 2022LVOS: A Benchmark for Long-term Video Object Segmentationcited by 77
- 2021Hierarchical Memory Matching Network for Video Object Segmentationcited by 72
- 2021Learning Position and Target Consistency for Memory-based Video Object Segmentationcited by 63
12 most cited of 97 All 97 (JSON)
- 2026CMTM: Cross-Modal Token Modulation for Unsupervised Video Object Segmentation16 Apr 2026
- 2026PanoSAM2: Lightweight Distortion- and Memory-aware Adaptions of SAM2 for 360 Video Object Segmentation9 Apr 2026
- 2026Show Me When and Where: Towards Referring Video Object Segmentation in the Wild15 Mar 2026
- 2025Nav-R2 Dual-Relation Reasoning for Generalizable Open-Vocabulary Object-Goal Navigation2 Dec 2025
- 2025Tracking and Understanding Object Transformations6 Nov 2025
- 2025Track-On2: Enhancing Online Point Tracking with Memory23 Sep 2025
- 2025DepthFlow: Exploiting Depth-Flow Structural Correlations for Unsupervised Video Object Segmentation26 Jul 2025
- 2025HQ-SMem: Video Segmentation and Tracking Using Memory Efficient Object Embedding With Selective Update and Self-Supervised Distillation Feedback25 Jul 2025
- 2025Advancing Complex Video Object Segmentation via Progressive Concept Construction21 Jul 2025
- 2025THU-Warwick Submission for EPIC-KITCHEN Challenge 2025: Semi-Supervised Video Object Segmentation7 Jun 2025
- 2025Enhancing Self-Supervised Fine-Grained Video Object Tracking with Dynamic Memory Prediction30 Apr 2025
- 2025GISE-TTT:A Framework for Global InformationSegmentation and Enhancement1 Apr 2025
12 newest of 97 All 97 (JSON)