mlsanityData to 14 Oct 2026

DGME-T: Directional Grid Motion Encoding for Transformer-Based Historical Camera Movement Classification

arXiv 2510.15725 ↗First posted 17 Oct 2025cs.CV cs.AI eess.IVcited by 0

Not on the map. Why?

Abstract (arXiv)

Camera movement classification (CMC) models trained on contemporary, high-quality footage often degrade when applied to archival film, where noise, missing frames, and low contrast obscure motion cues. We bridge this gap by assembling a unified benchmark that consolidates two modern corpora into four canonical classes and restructures the HISTORIAN collection into five balanced categories. Building on this benchmark, we introduce DGME-T, a lightweight extension to the Video Swin Transformer that injects directional grid motion encoding, derived from optical flow, via a learnable and normalised late-fusion layer. DGME-T raises the backbone's top-1 accuracy from 81.78% to 86.14% and its macro F1 from 82.08% to 87.81% on modern clips, while still improving the demanding World-War-II footage from 83.43% to 84.62% accuracy and from 81.72% to 82.63% macro F1. A cross-domain study further shows that an intermediate fine-tuning stage on modern data increases historical performance by more than five percentage points. These results demonstrate that structured motion priors and transformer representations are complementary and that even a small, carefully calibrated motion head can substantially enhance robustness in degraded film analysis. Related resources are available at https://github.com/linty5/DGME-T.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 26 references that are in the map. First posted on arXiv 17 Oct 2025.

Builds on

13 of 26 references.

References · 13

  1. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  2. 2017The Kinetics Human Action Video Datasetcited by 1,909
  3. 2018SlowFast Networks for Video Recognitioncited by 1,867
  4. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
  5. 2021ViViT: A Video Vision Transformercited by 1,620
  6. 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,143
  7. 2016Temporal Segment Networks: Towards Good Practices for Deep Action Recognitioncited by 902
  8. 2021Multiscale Vision Transformerscited by 897
  9. 2017Rethinking Spatiotemporal Feature Learning: Speed-Accuracy Trade-offs in Video Classificationcited by 521
  10. 2021MoViNets: Mobile Video Networks for Efficient Video Recognitioncited by 135
  11. 2020A Unified Framework for Shot Type Classification Based on Subject Centric Lenscited by 44
  12. 2020Legacy Photo Editing with Learned Noise Priorcited by 7
1 more
  1. 2024Enhancing Historical Image Retrieval with Compositional Cuescited by 2

Built on by

Not cited yet.