# vSTMD: Visual Motion Detection for Extremely Tiny Target at Various Velocities

arXiv: https://arxiv.org/abs/2501.13054 · HTML: https://mlsanity.com/paper/2501.13054/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 13 of its 57 references that are in the map.
- First posted on arXiv 22 Jan 2025.

## Builds on (most cited first, 13 of 13)

- [RAFT: Recurrent All-Pairs Field Transforms for Optical Flow](https://mlsanity.com/paper/2003.12039/) (2020)
- [Object Detection in 20 Years: A Survey](https://mlsanity.com/paper/1905.05055/) (2019)
- [SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flow](https://mlsanity.com/paper/2405.14793/) (2024)
- [Learning Open-World Object Proposals without Learning to Classify](https://mlsanity.com/paper/2108.06753/) (2021)
- [SeaDronesSee: A Maritime Benchmark for Detecting Humans in Open Water](https://mlsanity.com/paper/2105.01922/) (2021)
- [MemFlow: Optical Flow Estimation and Prediction with Memory](https://mlsanity.com/paper/2404.04808/) (2024)
- [Visible-Thermal Tiny Object Detection: A Benchmark Dataset and Baselines](https://mlsanity.com/paper/2406.14482/) (2024)
- [A Robust Visual System for Small Target Motion Detection Against Cluttered Moving Backgrounds](https://mlsanity.com/paper/1904.04363/) (2019)
- [A Directionally Selective Small Target Motion Detecting Visual Neural Network in Cluttered Backgrounds](https://mlsanity.com/paper/1801.06687/) (2018)
- [Attention and Prediction Guided Motion Detection for Low-Contrast Small Moving Targets](https://mlsanity.com/paper/2104.13018/) (2021)
- [Towards Computational Models and Applications of Insect Visual Systems for Motion Perception: A Review](https://mlsanity.com/paper/1904.02048/) (2019)
- [A Time-Delay Feedback Neural Network for Discriminating Small, Fast-Moving Targets in Complex Dynamic Environments](https://mlsanity.com/paper/2001.05846/) (2019)
- [XS-VID: A Large-Scale Benchmark for Small Object Detection and Tracking in Videos](https://mlsanity.com/paper/2407.18137/) (2024)

## Built on by (most cited first, 1 of 1)

- [MITE-Net: SWaP-Optimized 4K Video Tiny Target Perception for Embodied Edge SAR](https://mlsanity.com/paper/2608.15830/) (2026)

## Abstract (arXiv)

Visual motion detection for extremely tiny (ET-) targets is challenging, due to their category-independent nature and the scarcity of visual cues, which often incapacitate mainstream feature-based models. Natural architectures with rich interpretability offer a promising alternative, where STMD architectures derived from insect visual STMD (Small Target Motion Detector) pathways have demonstrated their effectiveness. However, previous STMD models are constrained to a narrow velocity range, hindering their efficacy in real-world scenarios where targets exhibit diverse and unstable dynamics. To address this limitation, we present vSTMD, a learning-free model for motion detection of ET-targets at various velocities. Our key innovations include: (1) a cross-Inhibition Dynamic Potential (cIDP) that serves as a self-adaptive mechanism efficiently capturing motion cues across a wide velocity spectrum, and (2) the first Collaborative Directional Gradient Calculation (CDGC) strategy, which enhances orienting accuracy and robustness while reducing computational overhead to one-eighth of previously isolated strategies. Evaluated on the real-world dataset RIST, the proposed vSTMD and its feedback-facilitated variant vSTMD-F achieve relative F1 gains of 30% and 58% over state-of-the-art (SOTA) STMD approaches, respectively. Furthermore, both models demonstrate competitive orientation estimation performance compared to SOTA deep learning-driven methods. Experiments also reveal the superiority of the natural architecture for ET-object motion detection - vSTMD is 60× faster than contemporary data-driven methods, making it highly suitable for real-time applications in dynamic scenarios and complex backgrounds. Code is available at https://github.com/MingshuoXu/vSTMD.
