The 2017 DAVIS Challenge on Video Object Segmentation
Not on the map. Why?
Cited by 141 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We present the 2017 DAVIS Challenge on Video Object Segmentation, a public dataset, benchmark, and competition specifically designed for the task of video object segmentation. Following the footsteps of other successful initiatives, such as ILSVRC and PASCAL VOC, which established the avenue of research in the fields of scene classification and semantic segmentation, the DAVIS Challenge comprises a dataset, an evaluation methodology, and a public competition with a dedicated workshop co-located with CVPR 2017. The DAVIS Challenge follows up on the recent publication of DAVIS (Densely-Annotated VIdeo Segmentation), which has fostered the development of several novel state-of-the-art video object segmentation techniques. In this paper we describe the scope of the benchmark, highlight the main characteristics of the dataset, define the evaluation metrics of the competition, and present a detailed analysis of the results of the participants to the challenge.
Key facts. Cited by 942 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Apr 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 74; 2022: 98; 2023: 194; 2024: 192; 2025: 230; 2026: 154.
942 papers.
Sort:
By area:
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
- 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 589
- 2023Segment Everything Everywhere All at Oncecited by 546
- 2023CoTracker: It is Better to Track Togethercited by 516
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 462
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
- 2023Emergent Correspondence from Image Diffusioncited by 437
- 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 436
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
38 more
- 2022Kubric: A scalable dataset generatorcited by 373
- 2023Segment Anything in High Qualitycited by 373
- 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 324
- 2025Perception Encoder: The best visual embeddings are not at the output of the networkcited by 315
- 2022Text2LIVE: Text-Driven Layered Image and Video Editingcited by 312
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
- 2023Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vcited by 291
- 2023TAPIR: Tracking Any Point with per-frame Initialization and temporal Refinementcited by 281
- 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 274
- 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 258
- 2023Personalize Segment Anything Model with One Shotcited by 250
- 2021Conditional Object-Centric Learning from Videocited by 247
- 2023MOSE: A New Dataset for Video Object Segmentation in Complex Scenescited by 232
- 2023Track Anything: Segment Anything Meets Videoscited by 230
- 2021Associating Objects with Transformers for Video Object Segmentationcited by 225
- 2023MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressionscited by 225
- 2021ViTAE: Vision Transformer Advanced by Exploring Intrinsic Inductive Biascited by 216
- 2022Particle Video Revisited: Tracking Through Occlusions Using Point Trajectoriescited by 215
- 2023Diffusion Hyperfeatures: Searching Through Time and Space for Semantic Correspondencecited by 211
- 2023A Survey on Video Diffusion Modelscited by 203
- 2021Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentationcited by 200
- 2023SegGPT: Segmenting Everything In Contextcited by 193
- 2023Segment and Track Anythingcited by 193
- 2023Universal Instance Perception as Object Discovery and Retrievalcited by 190
- 2023Tracking Everything Everywhere All at Oncecited by 190
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 186
- 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 184
- 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editingcited by 182
- 2022Language as Queries for Referring Video Object Segmentationcited by 180
- 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 178
- 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 177
- 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 176
- 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligencecited by 169
- 2022SAVi++: Towards End-to-End Object-Centric Learning from Real-World Videoscited by 165
- 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generationcited by 161
- 2021Self-supervised Video Object Segmentation by Motion Groupingcited by 147
- 2023PolyFormer: Referring Image Segmentation as Sequential Polygon Generationcited by 147
- 2022Decoupling Features in Hierarchical Propagation for Video Object Segmentationcited by 146
50 most cited of 942 All 942 (JSON)
- 2026Tabula Rasa: Monte Carlo estimation of unit-variance noise with controlled spatio-temporal correlation8 Oct 2026
- 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstruction30 Sep 2026
- 2026Universal Cross-Prompt Adversarial Attacks on Promptable Concept Segmentation30 Sep 2026
- 2026TripleFlow: Training-Free Video Object Removal by Bridging Residual Editing and Native Generation30 Sep 2026
- 2026Event-Driven Refresh and Recurrence Memory to Reduce Stale Grounding in Referring Video Object Segmentation30 Sep 2026
- 2026Masked Swingers: Harnessing Data Augmentation to Advance Autoencoders for Self-Supervised Learning29 Sep 2026
- 2026S4VY: Segment Anything in Feed-Forward 4D Visual Geometry29 Sep 2026
- 2026Hard Vision, Easy Vision: What GPT-6 Astra Reveals Across Computer Vision28 Sep 2026
- 2026Generative Uncertainty as a Self-supervised Signal for Semantic Similarity Learning28 Sep 2026
- 2026SWT: Self-Supervised Video Object Segmentation via Sliding, Wavelet and Transportation22 Sep 2026
- 2026Perceptual Refinement of an End-to-End Video Streaming Pipeline via Generative AI Layers16 Sep 2026
- 2026VOR-Bench: A Human Perception-Driven Benchmark for Video Object Removal15 Sep 2026
38 more
- 2026Hyper-RED: Scalable Event Pre-training via Semantic Hypergraph Distillation15 Sep 2026
- 2026World in World: Explore the World with World Models10 Sep 2026
- 2026What Moves? Localized Motion Representations for Compositional Scene Control3 Sep 2026
- 2026ENEAS: Embedding-guided Neural Ensemble for Adaptive Segmentation3 Sep 2026
- 2026FlashRender: Few-Step Generative Rendering via Camera-Controlled Video MeanFlow3 Sep 2026
- 2026A Survey on Adversarial Attacks and Defenses for Diffusion Models Across Multiple Modalities28 Aug 2026
- 2026Cut-ViT: Task-Specific Model Pruning via Gram Anchoring Subspace Consistency28 Aug 2026
- 2026Manifold4D: Denoising on Point Cloud Rendered Manifolds for Video Re-shooting28 Aug 2026
- 2026Zero-Shot Video Restoration and Enhancement with Text-to-Image Latent Diffusion Models and Multi-Modal References27 Aug 2026
- 2026PhysMLLMs: Spatial Priors for Unified Referring Segmentation and Grounded Reasoning of Images and Videos25 Aug 2026
- 2026DDMS: Discriminative Distillation of Multi-view Foundational Features into Single-view Models24 Aug 2026
- 2026RS3-Prune: Read-Sparse, Store-Sparse Token Pruning for Video Object Segmentation23 Aug 2026
- 2026SAM2Dual: Training-Free, Dual Memory for Long-Term Video Object Segmentation19 Aug 2026
- 2026Key-Frame Reasoning with SAM3: Third Place Solution for the MeViS-Text Track of the 8th LSVOS Challenge18 Aug 2026
- 2026EditStream: A Unified Autoregressive Framework for Interactive Video Generation and Editing16 Aug 2026
- 2026GS2CI: Robust Gaussian Splatting For Snapshot Compressive Imaging via Large Vision Model Priors13 Aug 2026
- 2026SNM-VFI: Symmetric Nonlinear Motion-Guided Generative Video Frame Interpolation13 Aug 2026
- 2026Distractor-Aware Video Object Segmentation12 Aug 2026
- 2026Bridging Event Streams and DiT: Event-Guided Video Frame Interpolation11 Aug 2026
- 2026Agreement-Based Audio-Visual Segmentation:Champion Report for the MeViS-Audio Track in the 8th LSVOS Challenge10 Aug 2026
- 2026Dueling World Models: Advantage-Style Action Channels for Common-Mode Distractor Rejection7 Aug 2026
- 2026Implicit Neural Speckle Denoising6 Aug 2026
- 2026TaskSense: Focusing on What Matters in World Models6 Aug 2026
- 2026StreamDAM: Presence-Aware Memory for Real-Time Streaming Video Object Segmentation4 Aug 2026
- 2026CameraAnything: Refilming Videos with Arbitrary Camera Control27 Jul 2026
- 2026GraphVid: Interactive Graph-Controllable Video Generation23 Jul 2026
- 2026Self-Supervised Learning of Structured Dynamics from Videos23 Jul 2026
- 2026ElasticTTT: Prior-Preserving Test-Time Tuning for Video Editing23 Jul 2026
- 2026Efficient Tracking and Understanding Object Transformations22 Jul 2026
- 2026SPEED: One-Step Pixel Diffusion for High-quality Video Frame Interpolation17 Jul 2026
- 2026Detector Confidence Signals Presence Rather Than Occlusion in Cluttered Manipulation15 Jul 2026
- 2026Evidence-Backed Video Question Answering13 Jul 2026
- 2026Knowledge as Orbit: Finite Collections as Phases of an Exactly Periodic Latent Generator11 Jul 2026
- 2026`Attention-Guided Cross-Temporal Clustering for Self-Supervised Video Object Segmentation8 Jul 2026
- 2026Streaming Neural Speech Codecs through Time-Invariant Representations6 Jul 2026
- 2026G2TAM: Geometry Grounded Track Anything Model4 Jul 2026
- 2026Mask-supervised Object-centric Representation Learning with LeJEPA2 Jul 2026
- 2026TrajLoc: Trajectory-Attention Localization for Multi-Object Motion Control1 Jul 2026
50 newest of 942 All 942 (JSON)
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 462
- 2023Emergent Correspondence from Image Diffusioncited by 437
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
- 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 324
- 2023Diffusion Hyperfeatures: Searching Through Time and Space for Semantic Correspondencecited by 211
- 2023A Survey on Video Diffusion Modelscited by 203
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 186
- 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 184
- 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editingcited by 182
- 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generationcited by 161
12 most cited of 139 All 139 (JSON)
- 2026A Survey on Adversarial Attacks and Defenses for Diffusion Models Across Multiple Modalities28 Aug 2026
- 2026Zero-Shot Video Restoration and Enhancement with Text-to-Image Latent Diffusion Models and Multi-Modal References27 Aug 2026
- 2026SNM-VFI: Symmetric Nonlinear Motion-Guided Generative Video Frame Interpolation13 Aug 2026
- 2026Bridging Event Streams and DiT: Event-Guided Video Frame Interpolation11 Aug 2026
- 2026ElasticTTT: Prior-Preserving Test-Time Tuning for Video Editing23 Jul 2026
- 2026SPEED: One-Step Pixel Diffusion for High-quality Video Frame Interpolation17 Jul 2026
- 2026Vera: A Layered Diffusion Model for Content-Preserving Video Editing22 Jun 2026
- 2026TrackCraft3R: Repurposing Video Diffusion Transformers for Dense 3D Tracking12 May 2026
- 2026Blind Bitstream-corrupted Video Recovery via Metadata-guided Diffusion Model15 Apr 2026
- 2026Accelerating Diffusion-based Video Editing via Heterogeneous Caching: Beyond Full Computing at Sampled Denoising Timestep25 Mar 2026
- 2026Improving Image-to-Image Translation via a Rectified Flow Reformulation20 Mar 2026
- 2026SHIFT: Motion Alignment in Video Diffusion Models with Adversarial Hybrid Fine-Tuning18 Mar 2026
12 newest of 139 All 139 (JSON)
- 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligencecited by 169
- 2024VISA: Reasoning Video Object Segmentation via Large Language Modelscited by 123
- 2025VLM4D: Towards Spatiotemporal Awareness in Vision Language Modelscited by 43
- 2025GLUS: Global-Local Reasoning Unified into A Single Large Language Model for Video Segmentationcited by 34
- 2023Tracking with Human-Intent Reasoningcited by 32
- 2025UniPixel: Unified Object Referring and Segmentation for Pixel-Level Visual Reasoningcited by 27
- 2025The Devil is in Temporal Token: High Quality Video Reasoning Segmentationcited by 26
- 2024Unleashing the Temporal-Spatial Reasoning Capacity of GPT for Training-Free Audio and Language Referenced Video Object Segmentationcited by 18
- 2025RVTBench: A Benchmark for Visual Reasoning Taskscited by 9
- 2025CoT-RVS: Zero-Shot Chain-of-Thought Reasoning Segmentation for Videoscited by 8
- 2026Refer-Agent: A Collaborative Multi-Agent System with Reasoning and Reflection for Referring Video Object Segmentationcited by 7
- 2025Enhancing Self-Supervised Visual Representation Learning via Low-Rank Adapted LLMscited by 1
12 most cited of 17 All 17 (JSON)
- 2026PhysMLLMs: Spatial Priors for Unified Referring Segmentation and Grounded Reasoning of Images and Videos25 Aug 2026
- 2026Training-Free Composed Video Retrieval via Visual Representation-Guided Video-LLM Reasoning1 Jun 2026
- 2026RCoT-Seg: Reinforced Chain-of-Thought for Video Reasoning and Segmentation8 May 2026
- 2026Edit2Interp: Adapting Image Foundation Models from Spatial Editing to Video Frame Interpolation with Few-Shot Learning16 Mar 2026
- 2026Refer-Agent: A Collaborative Multi-Agent System with Reasoning and Reflection for Referring Video Object Segmentation3 Feb 2026
- 2025Fast Reasoning Segmentation for Images and Videos15 Nov 2025
- 2025UniPixel: Unified Object Referring and Segmentation for Pixel-Level Visual Reasoning22 Sep 2025
- 2025VLM4D: Towards Spatiotemporal Awareness in Vision Language Models4 Aug 2025
- 2025Enhancing Self-Supervised Visual Representation Learning via Low-Rank Adapted LLMs1 Jul 2025
- 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence29 May 2025
- 2025CoT-RVS: Zero-Shot Chain-of-Thought Reasoning Segmentation for Videos24 May 2025
- 2025RVTBench: A Benchmark for Visual Reasoning Tasks17 May 2025
12 newest of 17 All 17 (JSON)
- 2023Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vcited by 291
- 2024PSALM: Pixelwise SegmentAtion with Large Multi-Modal Modelcited by 100
- 2024MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Modelscited by 61
- 2025InstructX: Towards Unified Visual Editing with MLLM Guidancecited by 31
- 2024ViCaS: A Dataset for Combining Holistic and Pixel-level Video Understanding using Captions with Grounded Segmentationcited by 16
- 2025Visual Representations inside the Language Modelcited by 13
- 2025V2P-Bench: Evaluating Video-Language Understanding with Visual Prompts for Better Human-Model Interactioncited by 10
- 2025Small Vision-Language Models: A Survey on Compact Architectures and Techniquescited by 4
- 2025UFVideo: Towards Unified Fine-Grained Video Cooperative Understanding with Large Language Modelscited by 2
- 2025PixFoundation 2.0: Do Video Multi-Modal LLMs Use Motion in Visual Grounding?cited by 1
- 2025RO-Bench: Large-scale robustness evaluation of MLLMs with text-driven counterfactual videoscited by 1
- 20254D-RGPT: Toward Region-level 4D Understanding via Perceptual Distillationcited by 1
12 most cited of 14 All 14 (JSON)
- 20264DP-QA: Scalable QA for 4D Perception in Vision Language Models10 Jun 2026
- 2026Vision-Language Models Unlock Task-Centric Latent Actions30 Jan 2026
- 20254D-RGPT: Toward Region-level 4D Understanding via Perceptual Distillation18 Dec 2025
- 2025UFVideo: Towards Unified Fine-Grained Video Cooperative Understanding with Large Language Models12 Dec 2025
- 2025RO-Bench: Large-scale robustness evaluation of MLLMs with text-driven counterfactual videos10 Oct 2025
- 2025InstructX: Towards Unified Visual Editing with MLLM Guidance9 Oct 2025
- 2025Visual Representations inside the Language Model6 Oct 2025
- 2025PixFoundation 2.0: Do Video Multi-Modal LLMs Use Motion in Visual Grounding?2 Sep 2025
- 2025V2P-Bench: Evaluating Video-Language Understanding with Visual Prompts for Better Human-Model Interaction22 Mar 2025
- 2025Small Vision-Language Models: A Survey on Compact Architectures and Techniques9 Mar 2025
- 2024ViCaS: A Dataset for Combining Holistic and Pixel-level Video Understanding using Captions with Grounded Segmentation12 Dec 2024
- 2024MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Models5 Aug 2024
12 newest of 14 All 14 (JSON)
- 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 589
- 2021Conditional Object-Centric Learning from Videocited by 247
- 2023Unifying (Machine) Vision via Counterfactual World Modelingcited by 18
- 2023Understanding Physical Dynamics with Counterfactual World Modelingcited by 11
- 2024Simplifying Latent Dynamics with Softly State-Invariant World Modelscited by 10
- 2024A Survey on Future Frame Synthesis: Bridging Deterministic and Generative Approachescited by 7
- 2025DynamicVerse: A Physically-Aware Multimodal Framework for 4D World Modelingcited by 5
- 2025Super Encoding Network: Recursive Association of Multi-Modal Encoders for Video Understandingcited by 4
- 2025Bridging the Gap Between Multimodal Foundation Models and World Modelscited by 1
- 2025MorphoSim: An Interactive, Controllable, and Editable Language-guided 4D World Simulatorcited by 1
- 2026ST-Gen4D: Embedding 4D Spatiotemporal Cognition into World Model for 4D Generationcited by 0
- 2026TaskSense: Focusing on What Matters in World Modelscited by 0
12 most cited of 14 All 14 (JSON)
- 2026World in World: Explore the World with World Models10 Sep 2026
- 2026Dueling World Models: Advantage-Style Action Channels for Common-Mode Distractor Rejection7 Aug 2026
- 2026TaskSense: Focusing on What Matters in World Models6 Aug 2026
- 2026ST-Gen4D: Embedding 4D Spatiotemporal Cognition into World Model for 4D Generation8 May 2026
- 2025DynamicVerse: A Physically-Aware Multimodal Framework for 4D World Modeling2 Dec 2025
- 2025MorphoSim: An Interactive, Controllable, and Editable Language-guided 4D World Simulator5 Oct 2025
- 2025Bridging the Gap Between Multimodal Foundation Models and World Models4 Oct 2025
- 2025Super Encoding Network: Recursive Association of Multi-Modal Encoders for Video Understanding9 Jun 2025
- 2024Simplifying Latent Dynamics with Softly State-Invariant World Models31 Jan 2024
- 2024A Survey on Future Frame Synthesis: Bridging Deterministic and Generative Approaches26 Jan 2024
- 2023Understanding Physical Dynamics with Counterfactual World Modeling11 Dec 2023
- 2023Unifying (Machine) Vision via Counterfactual World Modeling2 Jun 2023
12 newest of 14 All 14 (JSON)
- 2026RS3-Prune: Read-Sparse, Store-Sparse Token Pruning for Video Object Segmentation23 Aug 2026
- 2025Fast SAM2 with Text-Driven Token Pruning24 Dec 2025
- 2024Video Relationship Detection Using Mixture of Expertscited by 1
- 2025Robust Ego-Exo Correspondence with Long-Term Memorycited by 1
- 2025Robust Ego-Exo Correspondence with Long-Term Memory13 Oct 2025
- 2024Video Relationship Detection Using Mixture of Experts6 Mar 2024
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2023Segment Everything Everywhere All at Oncecited by 546
- 2023CoTracker: It is Better to Track Togethercited by 516
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
- 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 436
- 2022Kubric: A scalable dataset generatorcited by 373
- 2023Segment Anything in High Qualitycited by 373
- 2025Perception Encoder: The best visual embeddings are not at the output of the networkcited by 315
- 2022Text2LIVE: Text-Driven Layered Image and Video Editingcited by 312
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
- 2023TAPIR: Tracking Any Point with per-frame Initialization and temporal Refinementcited by 281
12 most cited of 751 All 751 (JSON)
- 2026Tabula Rasa: Monte Carlo estimation of unit-variance noise with controlled spatio-temporal correlation8 Oct 2026
- 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstruction30 Sep 2026
- 2026Universal Cross-Prompt Adversarial Attacks on Promptable Concept Segmentation30 Sep 2026
- 2026TripleFlow: Training-Free Video Object Removal by Bridging Residual Editing and Native Generation30 Sep 2026
- 2026Event-Driven Refresh and Recurrence Memory to Reduce Stale Grounding in Referring Video Object Segmentation30 Sep 2026
- 2026Masked Swingers: Harnessing Data Augmentation to Advance Autoencoders for Self-Supervised Learning29 Sep 2026
- 2026S4VY: Segment Anything in Feed-Forward 4D Visual Geometry29 Sep 2026
- 2026Hard Vision, Easy Vision: What GPT-6 Astra Reveals Across Computer Vision28 Sep 2026
- 2026Generative Uncertainty as a Self-supervised Signal for Semantic Similarity Learning28 Sep 2026
- 2026SWT: Self-Supervised Video Object Segmentation via Sliding, Wavelet and Transportation22 Sep 2026
- 2026Perceptual Refinement of an End-to-End Video Streaming Pipeline via Generative AI Layers16 Sep 2026
- 2026VOR-Bench: A Human Perception-Driven Benchmark for Video Object Removal15 Sep 2026
12 newest of 751 All 751 (JSON)