DGME-T: Directional Grid Motion Encoding for Transformer-Based Historical Camera Movement Classification
Not on the map. Why?
Abstract (arXiv)
Camera movement classification (CMC) models trained on contemporary, high-quality footage often degrade when applied to archival film, where noise, missing frames, and low contrast obscure motion cues. We bridge this gap by assembling a unified benchmark that consolidates two modern corpora into four canonical classes and restructures the HISTORIAN collection into five balanced categories. Building on this benchmark, we introduce DGME-T, a lightweight extension to the Video Swin Transformer that injects directional grid motion encoding, derived from optical flow, via a learnable and normalised late-fusion layer. DGME-T raises the backbone's top-1 accuracy from 81.78% to 86.14% and its macro F1 from 82.08% to 87.81% on modern clips, while still improving the demanding World-War-II footage from 83.43% to 84.62% accuracy and from 81.72% to 82.63% macro F1. A cross-domain study further shows that an intermediate fine-tuning stage on modern data increases historical performance by more than five percentage points. These results demonstrate that structured motion priors and transformer representations are complementary and that even a small, carefully calibrated motion head can substantially enhance robustness in degraded film analysis. Related resources are available at https://github.com/linty5/DGME-T.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 26 references that are in the map. First posted on arXiv 17 Oct 2025.
Builds on
13 of 26 references.
References · 13
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2017The Kinetics Human Action Video Datasetcited by 1,909
- 2018SlowFast Networks for Video Recognitioncited by 1,867
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
- 2021ViViT: A Video Vision Transformercited by 1,620
- 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,143
- 2016Temporal Segment Networks: Towards Good Practices for Deep Action Recognitioncited by 902
- 2021Multiscale Vision Transformerscited by 897
- 2017Rethinking Spatiotemporal Feature Learning: Speed-Accuracy Trade-offs in Video Classificationcited by 521
- 2021MoViNets: Mobile Video Networks for Efficient Video Recognitioncited by 135
- 2020A Unified Framework for Shot Type Classification Based on Subject Centric Lenscited by 44
- 2020Legacy Photo Editing with Learned Noise Priorcited by 7
1 more
Built on by
Not cited yet.