SlotVTG: Object-Centric Adapter for Generalizable Video Temporal Grounding
On the map: Multimodal LLMs / vision-language models → Video understanding with MLLMs
Abstract (arXiv)
Multimodal Large Language Models (MLLMs) have shown strong performance on Video Temporal Grounding (VTG). However, their coarse recognition capabilities are insufficient for fine-grained temporal understanding, making task-specific fine-tuning indispensable. This fine-tuning causes models to memorize dataset-specific shortcuts rather than faithfully grounding in the actual visual content, leading to poor Out-of-Domain (OOD) generalization. Object-centric learning offers a promising remedy by decomposing scenes into entity-level representations, but existing approaches require re-running the entire multi-stage training pipeline from scratch. We propose SlotVTG, a framework that steers MLLMs toward object-centric, input-grounded visual reasoning at minimal cost. SlotVTG introduces a lightweight slot adapter that decomposes visual tokens into abstract slots via slot attention and reconstructs the original sequence, where objectness priors from a self-supervised vision model encourage semantically coherent slot formation. Cross-domain evaluation on standard VTG benchmarks demonstrates that our approach significantly improves OOD robustness while maintaining competitive In-Domain (ID) performance with minimal overhead.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Video understanding with MLLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 47 of its 56 references that are in the map. First posted on arXiv 26 Mar 2026.
Builds on
47 of 56 references.
Closest ancestors · 7
Same direction, newest first
- 2025TimeLens: Rethinking Video Temporal Grounding with Multimodal LLMs16 Dec
- 2025Map the Flow: Revealing Hidden Pathways of Information in VideoLLMs15 Oct
- 2025Universal Video Temporal Grounding with Generative Multi-modal Large Language Models23 Jun
- 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Grounding17 Mar
- 2024TimeSuite: Improving MLLMs for Long Video Understanding via Grounded Tuning25 Oct
- 2024Chrono: A Simple Blueprint for Representing Time in MLLMs26 Jun
- 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understanding4 Dec
Other references · 40
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2018SlowFast Networks for Video Recognitioncited by 1,862
- 2020Object-Centric Learning with Slot Attentioncited by 865
- 2017Dense-Captioning Events in Videoscited by 789
- 2017Localizing Moments in Video with Natural Languagecited by 660
28 more
- 2017TALL: Temporal Activity Localization via Language Querycited by 581
- 2019Learning 2D Temporal Adjacent Networks for Moment Localization with Natural Languagecited by 283
- 2023VTimeLLM: Empower LLM to Grasp Video Momentscited by 253
- 2021Conditional Object-Centric Learning from Videocited by 247
- 2022Bridging the Gap to Real-World Object-Centric Learningcited by 219
- 2023UniVTG: Towards Unified Video-Language Temporal Groundingcited by 189
- 2020Dense Regression Network for Video Groundingcited by 176
- 2023Query-Dependent Video Representation for Moment Retrieval and Highlight Detectioncited by 166
- 2022SlotFormer: Unsupervised Visual Dynamics Simulation with Object-Centric Modelscited by 146
- 2022Revealing Single Frame Bias for Video-and-Language Learningcited by 131
- 2019Why Can't I Dance in the Mall? Learning to Mitigate Scene Bias in Action Recognitioncited by 117
- 2021Interventional Video Grounding with Dual Contrastive Learningcited by 94
- 2024TRACE: Temporal Grounding Video LLM via Causal Event Modelingcited by 87
- 2021Deconfounded Video Moment Retrieval with Causal Interventioncited by 84
- 2024HawkEye: Training Video-Text LLMs for Grounding Text in Videoscited by 83
- 2023Knowing Where to Focus: Event-aware Transformer for Video Groundingcited by 79
- 2022Compositional Temporal Grounding with Structured Variational Cross-Graph Correspondence Learningcited by 59
- 2024TR-DETR: Task-Reciprocal Transformer for Joint Moment Retrieval and Highlight Detectioncited by 59
- 2020Uncovering Hidden Challenges in Query-Based Video Moment Retrievalcited by 58
- 2021A Closer Look at Temporal Sentence Grounding in Videos: Dataset and Metriccited by 42
- 2025VideoMind: A Chain-of-LoRA Agent for Temporal-Grounded Video Reasoningcited by 41
- 2023Correlation-Guided Query-Dependency Calibration for Video Temporal Groundingcited by 31
- 2024Task-Driven Exploration: Decoupling and Inter-Task Feedback for Joint Moment Retrieval and Highlight Detectioncited by 25
- 2022Can Shuffling Video Benefit Temporal Bias Problem: A Novel Training Framework for Temporal Groundingcited by 22
- 2022Learning Sample Importance for Cross-Scenario Video Temporal Groundingcited by 8
- 2023DEVIAS: Learning Disentangled Video Representations of Action and Scenecited by 7
- 2024Bias-Conflict Sample Synthesis and Adversarial Removal Debias Strategy for Temporal Sentence Grounding in Videocited by 7
- 2025Slot-MLLM: Object-Centric Visual Tokenization for Multimodal LLMcited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Slot-VLM: SlowFast Slots for Video-Language Modeling
- 2025A Survey on Video Temporal Grounding with Multimodal Large Language Model
- 2026GroundVTS: Visual Token Sampling in Multimodal Large Language Models for Video Temporal Grounding
- 2025Harnessing Object Grounding for Time-Sensitive Video Understanding
- 2024Training-free Video Temporal Grounding using Large-scale Pre-trained Models
- 2025Connecting the Dots: Training-Free Visual Grounding via Agentic Reasoning
- 2026Slot-RAE: Streamlining Object-Centric Learning via Direct Representation Auto-Encoders
- 2026OmniVTG: A Large-Scale Dataset and Training Paradigm for Open-World Video Temporal Grounding