MaskRNN: Instance Level Video Object Segmentation
Not on the map. Why?
Abstract (arXiv)
Instance level video object segmentation is an important technique for video editing and compression. To capture the temporal coherence, in this paper, we develop MaskRNN, a recurrent neural net approach which fuses in each frame the output of two deep nets for each object instance -- a binary segmentation net providing a mask and a localization net providing a bounding box. Due to the recurrent component and the localization component, our method is able to take advantage of long-term temporal structures of the video data as well as rejecting outliers. We validate the proposed algorithm on three challenging benchmark datasets, the DAVIS-2016 dataset, the DAVIS-2017 dataset, and the Segtrack v2 dataset, achieving state-of-the-art performance on all of them.
Key facts. Cited by 48 papers in the map (data through 14 Oct 2026). First posted on arXiv 29 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 11; 2023: 7; 2024: 7; 2025: 7; 2026: 1.
48 papers.
Sort:
By area:
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 439
- 2021Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentationcited by 203
- 2023Putting the Object Back into Video Object Segmentationcited by 188
- 2021Modular Interactive Video Object Segmentation: Interaction-to-Mask, Propagation and Difference-Aware Fusioncited by 129
- 2021SSTVOS: Sparse Spatiotemporal Transformers for Video Object Segmentationcited by 106
- 2021Efficient Regional Memory Network for Video Object Segmentationcited by 86
- 2022LVOS: A Benchmark for Long-term Video Object Segmentationcited by 77
- 2023Audio-Visual Segmentation with Semanticscited by 75
- 2021Hierarchical Memory Matching Network for Video Object Segmentationcited by 72
- 2021SwiftNet: Real-time Video Object Segmentationcited by 67
- 2021Learning Position and Target Consistency for Memory-based Video Object Segmentationcited by 63
36 more
- 2024LVOS: A Benchmark for Large-scale Long-term Video Object Segmentationcited by 44
- 2021Active Boundary Loss for Semantic Segmentationcited by 40
- 2021Reliable Propagation-Correction Modulation for Video Object Segmentationcited by 36
- 2022Learning Quality-aware Dynamic Memory for Video Object Segmentationcited by 35
- 2022Look Before You Match: Instance Understanding Matters in Video Object Segmentationcited by 34
- 2025MatAnyone: Stable Video Matting with Consistent Memory Propagationcited by 24
- 2022Global Spectral Filter Memory Network for Video Object Segmentationcited by 22
- 2021Target-Aware Object Discovery and Association for Unsupervised Video Multi-Object Segmentationcited by 21
- 2023Boosting Video Object Segmentation via Space-time Correspondence Learningcited by 21
- 2025EdgeTAM: On-Device Track Anything Modelcited by 21
- 2023MobileVOS: Real-Time Video Object Segmentation Contrastive Learning meets Knowledge Distillationcited by 16
- 2022Deep learning for table detection and structure recognition: A surveycited by 15
- 2022Motion-inductive Self-supervised Object Discovery in Videoscited by 14
- 2021VideoClick: Video Object Segmentation with a Single Clickcited by 8
- 2024Learning Spatial-Semantic Features for Robust Video Object Segmentationcited by 7
- 2021Self-Gated Memory Recurrent Network for Efficient Scalable HDR Deghostingcited by 5
- 2025MoSAM: Motion-Guided Segment Anything Model with Spatial-Temporal Memory Selectioncited by 5
- 2025Understanding while Exploring: Semantics-driven Active Mappingcited by 5
- 2024Efficient Video Object Segmentation via Modulated Cross-Attention Memorycited by 3
- 2024Continuous Spatio-Temporal Memory Networks for 4D Cardiac Cine MRI Segmentationcited by 2
- 2021Fast Pixel-Matching for Video Object Segmentationcited by 1
- 2021Space Time Recurrent Memory Networkcited by 1
- 2021SiamPolar: Semi-supervised Realtime Video Object Segmentation with Polar Representationcited by 1
- 2023Hierarchical Spatiotemporal Transformers for Video Object Segmentationcited by 1
- 2024Spatial-Temporal Multi-level Association for Video Object Segmentationcited by 1
- 2025VIP: Video Inpainting Pipeline for Real World Human Removalcited by 1
- 2025Robust Ego-Exo Correspondence with Long-Term Memorycited by 1
- 2026Few-Shot Video Object Segmentation in X-Ray Angiography Using Local Matching and Spatio-Temporal Consistency Losscited by 1
- 2022Attention based Memory video portrait mattingcited by 0
- 2022Human Instance Segmentation and Tracking via Data Association and Single-stage Detectorcited by 0
- 2022Adaptive Memory Management for Video Object Segmentationcited by 0
- 2022Two-Stream Networks for Object Segmentation in Videoscited by 0
- 2023Reliability-Hierarchical Memory Network for Scribble-Supervised Video Object Segmentationcited by 0
- 2023Memory-Efficient Continual Learning Object Segmentation for Long Videocited by 0
- 2024GrabDAE: An Innovative Framework for Unsupervised Domain Adaptation Utilizing Grab-Mask and Denoise Auto-Encodercited by 0
- 2025GISE-TTT:A Framework for Global InformationSegmentation and Enhancementcited by 0
- 2026Few-Shot Video Object Segmentation in X-Ray Angiography Using Local Matching and Spatio-Temporal Consistency Loss2 Jan 2026
- 2025Robust Ego-Exo Correspondence with Long-Term Memory13 Oct 2025
- 2025Understanding while Exploring: Semantics-driven Active Mapping30 May 2025
- 2025MoSAM: Motion-Guided Segment Anything Model with Spatial-Temporal Memory Selection30 Apr 2025
- 2025VIP: Video Inpainting Pipeline for Real World Human Removal3 Apr 2025
- 2025GISE-TTT:A Framework for Global InformationSegmentation and Enhancement1 Apr 2025
- 2025MatAnyone: Stable Video Matting with Consistent Memory Propagation24 Jan 2025
- 2025EdgeTAM: On-Device Track Anything Model13 Jan 2025
- 2024Continuous Spatio-Temporal Memory Networks for 4D Cardiac Cine MRI Segmentation30 Oct 2024
- 2024GrabDAE: An Innovative Framework for Unsupervised Domain Adaptation Utilizing Grab-Mask and Denoise Auto-Encoder10 Oct 2024
- 2024SAM 2: Segment Anything in Images and Videos1 Aug 2024
- 2024Learning Spatial-Semantic Features for Robust Video Object Segmentation10 Jul 2024
36 more
- 2024LVOS: A Benchmark for Large-scale Long-term Video Object Segmentation30 Apr 2024
- 2024Spatial-Temporal Multi-level Association for Video Object Segmentation9 Apr 2024
- 2024Efficient Video Object Segmentation via Modulated Cross-Attention Memory26 Mar 2024
- 2023Putting the Object Back into Video Object Segmentation19 Oct 2023
- 2023Memory-Efficient Continual Learning Object Segmentation for Long Video26 Sep 2023
- 2023Hierarchical Spatiotemporal Transformers for Video Object Segmentation17 Jul 2023
- 2023Boosting Video Object Segmentation via Space-time Correspondence Learning13 Apr 2023
- 2023Reliability-Hierarchical Memory Network for Scribble-Supervised Video Object Segmentation25 Mar 2023
- 2023MobileVOS: Real-Time Video Object Segmentation Contrastive Learning meets Knowledge Distillation14 Mar 2023
- 2023Audio-Visual Segmentation with Semantics30 Jan 2023
- 2022Look Before You Match: Instance Understanding Matters in Video Object Segmentation13 Dec 2022
- 2022LVOS: A Benchmark for Long-term Video Object Segmentation18 Nov 2022
- 2022Deep learning for table detection and structure recognition: A survey15 Nov 2022
- 2022Global Spectral Filter Memory Network for Video Object Segmentation11 Oct 2022
- 2022Motion-inductive Self-supervised Object Discovery in Videos1 Oct 2022
- 2022Two-Stream Networks for Object Segmentation in Videos8 Aug 2022
- 2022Learning Quality-aware Dynamic Memory for Video Object Segmentation16 Jul 2022
- 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model14 Jul 2022
- 2022Adaptive Memory Management for Video Object Segmentation13 Apr 2022
- 2022Human Instance Segmentation and Tracking via Data Association and Single-stage Detector31 Mar 2022
- 2022Attention based Memory video portrait matting14 Mar 2022
- 2021Self-Gated Memory Recurrent Network for Efficient Scalable HDR Deghosting24 Dec 2021
- 2021Reliable Propagation-Correction Modulation for Video Object Segmentation6 Dec 2021
- 2021SiamPolar: Semi-supervised Realtime Video Object Segmentation with Polar Representation27 Oct 2021
- 2021Hierarchical Memory Matching Network for Video Object Segmentation23 Sep 2021
- 2021Space Time Recurrent Memory Network14 Sep 2021
- 2021Fast Pixel-Matching for Video Object Segmentation9 Jul 2021
- 2021Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentation9 Jun 2021
- 2021Target-Aware Object Discovery and Association for Unsupervised Video Multi-Object Segmentation10 Apr 2021
- 2021Learning Position and Target Consistency for Memory-based Video Object Segmentation9 Apr 2021
- 2021Efficient Regional Memory Network for Video Object Segmentation24 Mar 2021
- 2021Modular Interactive Video Object Segmentation: Interaction-to-Mask, Propagation and Difference-Aware Fusion14 Mar 2021
- 2021SwiftNet: Real-time Video Object Segmentation9 Feb 2021
- 2021Active Boundary Loss for Semantic Segmentation4 Feb 2021
- 2021SSTVOS: Sparse Spatiotemporal Transformers for Video Object Segmentation21 Jan 2021
- 2021VideoClick: Video Object Segmentation with a Single Click16 Jan 2021
- 2025Robust Ego-Exo Correspondence with Long-Term Memorycited by 1
- 2025Robust Ego-Exo Correspondence with Long-Term Memory13 Oct 2025
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 439
- 2021Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentationcited by 203
- 2023Putting the Object Back into Video Object Segmentationcited by 188
- 2021Modular Interactive Video Object Segmentation: Interaction-to-Mask, Propagation and Difference-Aware Fusioncited by 129
- 2021SSTVOS: Sparse Spatiotemporal Transformers for Video Object Segmentationcited by 106
- 2021Efficient Regional Memory Network for Video Object Segmentationcited by 86
- 2022LVOS: A Benchmark for Long-term Video Object Segmentationcited by 77
- 2023Audio-Visual Segmentation with Semanticscited by 75
- 2021Hierarchical Memory Matching Network for Video Object Segmentationcited by 72
- 2021SwiftNet: Real-time Video Object Segmentationcited by 67
- 2021Learning Position and Target Consistency for Memory-based Video Object Segmentationcited by 63
12 most cited of 46 All 46 (JSON)
- 2026Few-Shot Video Object Segmentation in X-Ray Angiography Using Local Matching and Spatio-Temporal Consistency Loss2 Jan 2026
- 2025Understanding while Exploring: Semantics-driven Active Mapping30 May 2025
- 2025MoSAM: Motion-Guided Segment Anything Model with Spatial-Temporal Memory Selection30 Apr 2025
- 2025VIP: Video Inpainting Pipeline for Real World Human Removal3 Apr 2025
- 2025GISE-TTT:A Framework for Global InformationSegmentation and Enhancement1 Apr 2025
- 2025MatAnyone: Stable Video Matting with Consistent Memory Propagation24 Jan 2025
- 2025EdgeTAM: On-Device Track Anything Model13 Jan 2025
- 2024Continuous Spatio-Temporal Memory Networks for 4D Cardiac Cine MRI Segmentation30 Oct 2024
- 2024GrabDAE: An Innovative Framework for Unsupervised Domain Adaptation Utilizing Grab-Mask and Denoise Auto-Encoder10 Oct 2024
- 2024SAM 2: Segment Anything in Images and Videos1 Aug 2024
- 2024Learning Spatial-Semantic Features for Robust Video Object Segmentation10 Jul 2024
- 2024LVOS: A Benchmark for Large-scale Long-term Video Object Segmentation30 Apr 2024
12 newest of 46 All 46 (JSON)