Mask IPL: Noise-Free Intrinsic Position Learning via Computation Graph Clipping for Event-Based Spike-Driven Tracking
Not on the map. Why?
Abstract (arXiv)
Spiking Neural Networks (SNNs) match the event-driven nature of event cameras and naturally extract spatiotemporal features. These properties have motivated a series of recent studies on event-based tracking with SNNs. Intrinsic Position Learning (IPL) acquires strong position information without introducing additional parameters, making it a mainstream approach for position encoding in event-based spike-driven tracking. However, the mechanism behind its effectiveness lacks systematic theoretical analysis. Moreover, our analysis reveals that IPL introduces noise in both forward and backward propagation. The former increases inference error, while the latter prevents parameters from converging to better solutions. This paper presents a systematic analysis of IPL and demonstrates that its effectiveness stems from the synergy between IPL and multi-stage convolution. The zero blocks in the joint tensor act as zero padding for convolution, and the resulting boundary effect propagates layer by layer through multi-stage convolution. Every parameter update is therefore driven by a gradient that perceives the relative displacement between template and search frames. Positional encoding added after the convolutional stage cannot provide this information. We further propose a simple Computation Graph Clipping method that applies a validity mask determined by the layout to the operations of every layer, making invalid regions equivalent to zero padding in both forward and backward propagation. This eliminates the noise without introducing additional parameters and makes the actual gradient coincide with the ideal gradient. We name the improved method Mask IPL. Without increasing parameters or computational cost, Mask IPL improves the AUC of the Tiny-scale tracker on FE108, FELT, and VisEvent, and consistently improves the Base-scale tracker as well.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 34 references that are in the map. First posted on arXiv 16 Sep 2026.
Builds on
24 of 34 references.
References · 24
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2019Event-based Vision: A Surveycited by 1,016
- 2021Learning Spatio-Temporal Transformer for Visual Trackingcited by 350
- 2019Learning Discriminative Model Prediction for Trackingcited by 344
- 2022Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Frameworkcited by 330
- 2018ATOM: Accurate Tracking by Overlap Maximizationcited by 285
- 2022MixFormer: End-to-End Tracking with Iterative Mixed Attentioncited by 281
- 2020Probabilistic Regression for Visual Trackingcited by 231
- 2020How Much Position Information Do Convolutional Neural Networks Encode?cited by 172
- 2020On Translation Invariance in CNNs: Convolutional Layers can Exploit Absolute Spatial Locationcited by 142
- 2022MetaFormer Baselines for Visioncited by 132
12 more
- 2021VisEvent: Reliable Object Tracking via Collaboration of Frame and Event Flowscited by 129
- 2024ODTrack: Online Dense Temporal Token Learning for Visual Trackingcited by 129
- 2022Backbone is All Your Need: A Simplified Architecture for Visual Object Trackingcited by 119
- 2023Generalized Relation Modeling for Transformer Trackingcited by 93
- 2021Object Tracking by Jointly Exploiting Frame and Event Domaincited by 84
- 2023HIPTrack: Visual Tracking with Historical Promptscited by 71
- 2024Scaling Spike-driven Transformer with Efficient Spike Firing Approximation Trainingcited by 59
- 2023Exploring Lightweight Hierarchical Vision Transformers for Efficient Visual Trackingcited by 53
- 2025SDTrack: A Baseline for Event-based Tracking via Spiking Neural Networkscited by 12
- 2025Fully Spiking Neural Networks for Unified Frame-Event Object Trackingcited by 6
- 2026TP-Spikformer: Token Pruned Spiking Transformercited by 4
- 2025Unveiling the Spatial-temporal Effective Receptive Fields of Spiking Neural Networkscited by 2
Built on by
Not cited yet.