MOVE: Motion-Guided Few-Shot Video Object Segmentation
Not on the map. Why?
Abstract (arXiv)
This work addresses motion-guided few-shot video object segmentation (FSVOS), which aims to segment dynamic objects in videos based on a few annotated examples with the same motion patterns. Existing FSVOS datasets and methods typically focus on object categories, which are static attributes that ignore the rich temporal dynamics in videos, limiting their application in scenarios requiring motion understanding. To fill this gap, we introduce MOVE, a large-scale dataset specifically designed for motion-guided FSVOS. Based on MOVE, we comprehensively evaluate 6 state-of-the-art methods from 3 different related tasks across 2 experimental settings. Our results reveal that current methods struggle to address motion-guided FSVOS, prompting us to analyze the associated challenges and propose a baseline method, Decoupled Motion Appearance Network (DMA). Experiments demonstrate that our approach achieves superior performance in few shot motion understanding, establishing a solid foundation for future research in this direction.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 46 of its 72 references that are in the map. First posted on arXiv 29 Jul 2025.
Builds on
46 of 72 references.
References · 46
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2023Segment Anythingcited by 8,234
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2017The Kinetics Human Action Video Datasetcited by 1,909
- 2021Video Swin Transformercited by 1,091
- 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 485
- 2019PANet: Few-Shot Image Semantic Segmentation with Prototype Alignmentcited by 449
- 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 439
- 2019Video Object Segmentation using Space-Time Memory Networkscited by 438
- 2019Video Instance Segmentationcited by 393
- 2023GRES: Generalized Referring Expression Segmentationcited by 254
34 more
- 2016One-Shot Video Object Segmentationcited by 235
- 2023MOSE: A New Dataset for Video Object Segmentation in Complex Scenescited by 234
- 2023MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressionscited by 228
- 2021Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentationcited by 203
- 2024MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGIcited by 193
- 2023Putting the Object Back into Video Object Segmentationcited by 188
- 2021Few-Shot Segmentation via Cycle-Consistent Transformercited by 133
- 2021A Survey on Deep Learning Technique for Video Segmentationcited by 132
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 130
- 2020Video Self-Stitching Graph Network for Temporal Action Localizationcited by 104
- 2018Efficient Video Object Segmentation via Network Modulationcited by 98
- 2020Actor-Context-Actor Relation Network for Spatio-Temporal Action Localizationcited by 91
- 2020Learning What to Learn for Video Object Segmentationcited by 89
- 2021MultiSports: A Multi-Person Video Dataset of Spatio-Temporally Localized Sports Actionscited by 84
- 2022LVOS: A Benchmark for Long-term Video Object Segmentationcited by 77
- 2020Revisiting Anchor Mechanisms for Temporal Action Localizationcited by 75
- 2025MotionBench: Benchmarking and Improving Fine-grained Video Motion Understanding for Vision Language Modelscited by 70
- 2019You Only Watch Once: A Unified CNN Architecture for Real-Time Spatiotemporal Action Localizationcited by 59
- 2024Decoupling Static and Hierarchical Motion Perception for Referring Video Segmentationcited by 55
- 2023Referred by Multi-Modality: A Unified Temporal Transformer for Video Object Segmentationcited by 54
- 2023CTVIS: Consistent Training for Online Video Instance Segmentationcited by 51
- 2024LVOS: A Benchmark for Large-scale Long-term Video Object Segmentationcited by 44
- 2020HAA500: Human-Centric Atomic Action Dataset with Curated Videoscited by 39
- 2023MammalNet: A Large-scale Video Benchmark for Mammal Recognition and Behavior Understandingcited by 36
- 2023Self-Calibrated Cross Attention Network for Few-Shot Segmentationcited by 32
- 2023Efficient Video Action Detection with Token Dropout and Context Refinementcited by 20
- 2024Mask-Adapter: The Devil is in the Masks for Open-Vocabulary Segmentationcited by 20
- 2024Eliminating Feature Ambiguity for Few-Shot Segmentationcited by 19
- 2024IDD-X: A Multi-View Dataset for Ego-relative Important Object Localization and Explanation in Dense and Unstructured Trafficcited by 13
- 2021Few-Shot Video Object Detectioncited by 7
- 2022Temporal Transductive Inference for Few-Shot Video Object Segmentationcited by 6
- 2022ISDA: Position-Aware Instance Segmentation with Deformable Attentioncited by 5
- 2023Multi-grained Temporal Prototype Learning for Few-shot Video Object Segmentationcited by 3
- 2024Referring Video Object Segmentation via Language-aligned Track Selectioncited by 3
Built on by
Citing papers per year: 2025: 3; 2026: 3.
6 papers.
- 2025MOSEv2: A More Challenging Dataset for Video Object Segmentation in Complex Scenescited by 62
- 2025Multimodal Referring Segmentation: A Surveycited by 22
- 2025Towards Omnimodal Expressions and Reasoning in Referring Audio-Visual Segmentationcited by 11
- 2026Geometry-Guided Camera Motion Understanding in VideoLLMscited by 3
- 2026FeVOS: Foresight Expression Video Object Segmentationcited by 0
- 2026VastMAT: A Large-Scale Multi-Category Benchmark for Multi-Animal Trackingcited by 0
- 2026VastMAT: A Large-Scale Multi-Category Benchmark for Multi-Animal Tracking28 Sep 2026
- 2026FeVOS: Foresight Expression Video Object Segmentation24 Jun 2026
- 2026Geometry-Guided Camera Motion Understanding in VideoLLMs13 Mar 2026
- 2025MOSEv2: A More Challenging Dataset for Video Object Segmentation in Complex Scenes7 Aug 2025
- 2025Multimodal Referring Segmentation: A Survey1 Aug 2025
- 2025Towards Omnimodal Expressions and Reasoning in Referring Audio-Visual Segmentation30 Jul 2025