mlsanityData to 7 Oct 2026

OnlineRefer: A Simple Online Baseline for Referring Video Object Segmentation

arXiv 2307.09356 ↗First posted 18 Jul 2023cs.CVcited by 62

Not on the map. Why?

Abstract (arXiv)

Referring video object segmentation (RVOS) aims at segmenting an object in a video following human instruction. Current state-of-the-art methods fall into an offline pattern, in which each clip independently interacts with text embedding for cross-modal understanding. They usually present that the offline pattern is necessary for RVOS, yet model limited temporal association within each clip. In this work, we break up the previous offline belief and propose a simple yet effective online model using explicit query propagation, named OnlineRefer. Specifically, our approach leverages target cues that gather semantic information and position prior to improve the accuracy and ease of referring predictions for the current frame. Furthermore, we generalize our online model into a semi-online framework to be compatible with video-based backbones. To show the effectiveness of our method, we evaluate it on four benchmarks, ie, Refer-Youtube-VOS, Refer-DAVIS17, A2D-Sentences, and JHMDB-Sentences. Without bells and whistles, our OnlineRefer with a Swin-L backbone achieves 63.5 J&F and 64.8 J&F on Refer-Youtube-VOS and Refer-DAVIS17, outperforming all other offline methods.

Key facts. Cited by 62 papers in the map (data through 7 Oct 2026). Builds on 36 of its 50 references that are in the map. First posted on arXiv 18 Jul 2023.

Builds on

36 of 50 references.

References · 36

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2020End-to-End Object Detection with Transformerscited by 7,384
  5. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  6. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
  7. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
  8. 2021Video Swin Transformercited by 1,090
  9. 2016Modeling Context in Referring Expressionscited by 1,054
  10. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
  11. 2017Focal Loss for Dense Object Detectioncited by 749
  12. 2021TrackFormer: Multi-Object Tracking with Transformerscited by 515
24 more
  1. 2019Video Object Segmentation using Space-Time Memory Networkscited by 436
  2. 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 379
  3. 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 313
  4. 2019Cross-Modal Self-Attention Network for Referring Image Segmentationcited by 263
  5. 2016Segmentation from Natural Language Expressionscited by 257
  6. 2018YouTube-VOS: Sequence-to-Sequence Video Object Segmentationcited by 228
  7. 2023Universal Instance Perception as Object Discovery and Retrievalcited by 190
  8. 2022Language as Queries for Referring Video Object Segmentationcited by 180
  9. 2018Video Object Segmentation with Language Referring Expressionscited by 161
  10. 2021End-to-End Referring Video Object Segmentation with Multimodal Transformerscited by 135
  11. 2017Recurrent Multimodal Interaction for Referring Image Segmentationcited by 125
  12. 2018Actor and Action Video Segmentation from a Sentencecited by 105
  13. 2021Cross-Modal Progressive Comprehension for Referring Segmentationcited by 102
  14. 2022In Defense of Online Models for Video Instance Segmentationcited by 97
  15. 2023Referring Multi-Object Trackingcited by 91
  16. 2023Referred by Multi-Modality: A Unified Temporal Transformer for Video Object Segmentationcited by 54
  17. 2022Language-Bridged Spatial-Temporal Interaction for Referring Video Object Segmentationcited by 50
  18. 2021Rethinking Cross-modal Interaction from a Top-down Perspective for Referring Video Object Segmentationcited by 42
  19. 2021Collaborative Spatial-Temporal Modeling for Language-Queried Video Actor Segmentationcited by 32
  20. 2021Referring Segmentation in Images and Videos with Cross-Modal Self-Attention Networkcited by 28
  21. 2022Multi-Attention Network for Compressed Video Referring Object Segmentationcited by 27
  22. 2021ClawCraneNet: Leveraging Object-level Relation for Text-based Video Segmentationcited by 21
  23. 2022Modeling Motion with Multi-Modal Features for Text-Based Video Segmentationcited by 18
  24. 2023InsPro: Propagating Instance Query and Proposal for Online Video Instance Segmentationcited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 4; 2024: 19; 2025: 20; 2026: 19.

62 papers.

Sort:

By area:

  1. 2025InternVideo2.5: Empowering Video MLLMs with Long and Rich Context Modelingcited by 203
  2. 2024VISA: Reasoning Video Object Segmentation via Large Language Modelscited by 123
  3. 2024One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videoscited by 99
  4. 2024Decoupling Static and Hierarchical Motion Perception for Referring Video Segmentationcited by 55
  5. 2024Toward Visual Grounding: A Surveycited by 52
  6. 2024SAMWISE: Infusing Wisdom in SAM2 for Text-Driven Video Segmentationcited by 43
  7. 2025MeViS: A Multi-Modal Dataset for Referring Motion Expression Video Segmentationcited by 34
  8. 2024HyperSeg: Towards Universal Visual Segmentation with Large Language Modelcited by 33
  9. 2023Tracking with Human-Intent Reasoningcited by 32
  10. 2023iKUN: Speak to Trackers without Retrainingcited by 31
  11. 2025ReferDINO: Referring Video Object Segmentation with Visual Grounding Foundationscited by 30
  12. 2024Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignmentcited by 29
38 more
  1. 2024Exploring Pre-trained Text-to-Video Diffusion Models for Referring Video Object Segmentationcited by 27
  2. 2024UniVS: Unified and Universal Video Segmentation with Prompts as Queriescited by 26
  3. 2025The Devil is in Temporal Token: High Quality Video Reasoning Segmentationcited by 26
  4. 2025Multimodal Referring Segmentation: A Surveycited by 22
  5. 2023Visual and Textual Prior Guided Mask Assemble for Few-Shot Segmentation and Beyondcited by 19
  6. 2023QDFormer: Towards Robust Audiovisual Segmentation in Complex Environments with Quantization-based Semantic Decompositioncited by 19
  7. 2025SAM2-LOVE: Segment Anything Model 2 in Language-aided Audio-Visual Scenescited by 16
  8. 2025ReSurgSAM2: Referring Segment Anything in Surgical Video via Credible Long-term Trackingcited by 15
  9. 2024Temporally Consistent Referring Video Object Segmentation with Hybrid Memorycited by 14
  10. 2024Compositional Video Generation as Flow Equalizationcited by 12
  11. 2025Fine-grained Spatiotemporal Grounding on Egocentric Videoscited by 11
  12. 2024ReferEverything: Towards Segmenting Everything We Can Speak of in Videoscited by 10
  13. 2025Deforming Videos to Masks: Flow Matching for Referring Video Segmentationcited by 10
  14. 2025CoT-RVS: Zero-Shot Chain-of-Thought Reasoning Segmentation for Videoscited by 8
  15. 2025MPG-SAM 2: Adapting SAM 2 with Mask Priors and Global Context for Referring Video Object Segmentationcited by 7
  16. 2024R2-Bench: Benchmarking the Robustness of Referring Perception Models under Perturbationscited by 6
  17. 2026GREx: Generalized Referring Expression Segmentation, Comprehension, and Generationcited by 5
  18. 2026Towards a Medical AI Scientistcited by 5
  19. 2025MomentSeg: Moment-Centric Sampling for Enhanced Video Pixel Understandingcited by 4
  20. 2026Instance-Aligned Captions for Explainable Video Anomaly Detectioncited by 4
  21. 20243rd Place Solution for MeViS Track in CVPR 2024 PVUW workshop: Motion Expression guided Video Segmentationcited by 3
  22. 2025Motion-Aware Vision-Reference Alignment for Referring Multi-Object Trackingcited by 3
  23. 2026From Web to Pixels: Bringing Agentic Search into Visual Perceptioncited by 3
  24. 2024GroPrompt: Efficient Grounded Prompting and Adaptation for Referring Video Object Segmentationcited by 2
  25. 20242nd Place Solution for MeViS Track in CVPR 2024 PVUW Workshop: Motion Expression guided Video Segmentationcited by 2
  26. 2025UFVideo: Towards Unified Fine-Grained Video Cooperative Understanding with Large Language Modelscited by 2
  27. 2026SetCon: Towards Open-Ended Referring Segmentation via Set-Level Concept Predictioncited by 2
  28. 20264DVLT: Dynamic Scene Understanding with Worldline-Centered Vision-Language Trackingcited by 2
  29. 2024ClickVOS: Click Video Object Segmentationcited by 1
  30. 2024Harnessing Vision-Language Pretrained Models with Temporal-Aware Adaptation for Referring Video Object Segmentationcited by 1
  31. 2026AR2-4FV: Anchored Referring and Re-identification for Long-Term Grounding in Fixed-View Videoscited by 1
  32. 2024Shift and matching queries for video semantic segmentationcited by 0
  33. 2025EventRR: Event Referential Reasoning for Referring Video Object Segmentationcited by 0
  34. 2025Temporal Grounding as a Learning Signal for Referring Video Object Segmentationcited by 0
  35. 2025Temporal Prompting Matters: Rethinking Referring Video Object Segmentationcited by 0
  36. 2025LTCA: Long-range Temporal Context Attention for Referring Video Object Segmentationcited by 0
  37. 2025Referring Video Object Segmentation with Cross-Modality Proxy Queriescited by 0
  38. 2025Track and Caption Any Motion: Open-Vocabulary Spatiotemporal Captioning via Trajectory-Conditioned Generationcited by 0

50 most cited of 62 All 62 (JSON)