mlsanityData to 14 Oct 2026

Knowledge-Preserved Model Tuning in Null-Space for Robust Spatio-Temporal Video Grounding

arXiv 2606.03539 ↗First posted 2 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Spatio-Temporal Video Grounding aims to localize object tubes based on textual queries. While recent methods have achieved remarkable success, they mainly focus on high-quality(HQ) inputs, neglecting the widespread presence of low-quality(LQ) videos in real-world scenarios. Although tuning methods like LoRA can adapt to degraded inputs, they inevitably disrupt pre-trained knowledge. To address this, we propose Null-Space Tuning (NST). This framework exploits the geometric property that adding vectors within the null-space of frozen weights to the layer input does not affect the output. Leveraging this, NST injects learnable residuals into input features that can be selectively invisible to the pre-trained backbone. Specifically, NST combines the Quality-Adaptive Unit and Dual-Space Reparameterization to synthesize these residuals by confining components for HQ inputs to the null-space, while directing restoration components for LQ inputs to the non-null space. As the frozen weights eliminate null-space components, we effectively rectify degraded inputs while preserving pre-trained knowledge for HQ inputs. Extensive experiments show that NST outperforms state-of-the-art methods on our Mixed-Quality benchmark.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 23 references that are in the map. First posted on arXiv 2 Jun 2026.

Builds on

19 of 23 references.

References · 19

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2020End-to-End Object Detection with Transformerscited by 7,414
  5. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  6. 2022Visual Prompt Tuningcited by 1,681
  7. 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 819
  8. 2024DoRA: Weight-Decomposed Low-Rank Adaptationcited by 758
  9. 2024AlphaEdit: Null-Space Constrained Knowledge Editing for Language Modelscited by 236
  10. 2021Training Networks in Null Space of Feature Covariance for Continual Learningcited by 143
  11. 2020Where Does It Exist: Spatio-Temporal Video Grounding for Multi-Form Sentencescited by 118
  12. 2022TubeDETR: Spatio-Temporal Video Grounding with Transformerscited by 98
7 more
  1. 2020Human-centric Spatio-Temporal Video Grounding With Visual Transformerscited by 85
  2. 2024Context-Guided Spatio-Temporal Video Groundingcited by 46
  3. 2022Embracing Consistency: A One-Stage Approach for Spatio-Temporal Video Groundingcited by 42
  4. 2025FlyLoRA: Boosting Task Decoupling and Parameter Efficiency via Implicit Rank-Wise Mixture-of-Expertscited by 35
  5. 2020Object-Aware Multi-Branch Relation Networks for Spatio-Temporal Video Groundingcited by 24
  6. 2025Knowing Your Target: Target-Aware Transformer Makes Better Spatio-Temporal Video Groundingcited by 18
  7. 2024Mamba-CL: Optimizing Selective State Space Model in Null Space for Continual Learningcited by 5

Built on by

Not cited yet.