Unlocking Motion in Expressions: Temporal Calibration for Referring Video Object Segmentation
Not on the map. Why?
Abstract (arXiv)
Referring Video Object Segmentation (RVOS) aims to segment referred objects at the pixel level in video sequences based on natural language descriptions. Existing methods typically introduce motion information within a unified cross-modal temporal modeling framework, where language cues are used for target localization and segmentation. However, the dependency of expressions on motion semantics is not explicitly modeled, making it difficult to adaptively adjust the use of motion information according to different semantic requirements. To address these issues, we propose an Expression-driven Motion Calibration (EMC) framework for RVOS that explicitly unlocks and leverages the motion semantics within expressions. The proposed method extracts interpretable motion control signals from expressions via a Motion Signal Processing (MSP) module, and employs a Motion Influence Calibration (MIC) module to adjust the contribution of motion cues during temporal decision making. In addition, a Semantic Temporal Stage Construction (STSC) module is introduced to build expression-relevant temporal stages, providing a compact temporal candidate space for motion calibration. Through extensive evaluation on six standard benchmarks, including Ref-YouTubeVOS, Ref-DAVIS17, MeViS (valid/validu), A2D-Sentences, and JHMDB-Sentences, the superiority of our method is validated. We will release the code on https://github.com/Jeven7/EMC.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 32 references that are in the map. First posted on arXiv 17 Aug 2026.
Builds on
13 of 32 references.
References · 13
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
- 2023MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressionscited by 228
- 2023Alpha-CLIP: A CLIP Model Focusing on Wherever You Wantcited by 151
- 2018Actor and Action Video Segmentation from a Sentencecited by 106
- 2024Decoupling Static and Hierarchical Motion Perception for Referring Video Segmentationcited by 55
- 2024SAMWISE: Infusing Wisdom in SAM2 for Text-Driven Video Segmentationcited by 44
- 2025Segment Any Motion in Videoscited by 35
- 2024MuseTalk: Real-Time High-Fidelity Video Dubbing via Spatio-Temporal Samplingcited by 28
- 2023UniRef++: Segment Every Reference Object in Spatial and Temporal Spacescited by 22
- 2025AnyTalker: Scaling Multi-Person Talking Video Generation with Interactivity Refinementcited by 20
- 2024DNTextSpotter: Arbitrary-Shaped Scene Text Spotting via Improved Denoising Trainingcited by 11
- 2025Deforming Videos to Masks: Flow Matching for Referring Video Segmentationcited by 10
1 more
Built on by
Not cited yet.