mlsanityData to 14 Oct 2026

PERSIST: Persistent-State Discrimination for Shot Boundary Detection

arXiv 2608.29287 ↗First posted 29 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Shot boundary detection (SBD) is widely treated as the localisation of local visual discontinuities, yet many false positives such as hand-held shake, illumination flicker, motion blur, occlusion, and damaged archival material produce equally sharp local change without introducing a new shot. We reformulate SBD as boundary semantic discrimination: a frame is favoured as a boundary only when its local change evidence is accompanied by a persistent update of the video's latent temporal state, rather than a transient excursion that returns to the surrounding trend. This persistence test is operationalised with a continuous latent state from a FiLM-conditioned sinusoidal representation network and a structured discriminator that combines three semantic cues, local change, transient impulse, and return-to-trend, into a single interpretable per-frame signal over a dual-rate temporal backbone. The resulting framework, PERSIST, turns every decision into an inspectable one: the persistence criterion is trained into the classifier, its per-frame effect stays readable from the gate triple, and its learned latent state is measurably boundary-discriminative. On a 2,727-video per-subtype diagnostic it removes 33-80% of flash, text-overlay, and archival false positives relative to an identically trained cue detector, and at matched true-transition recall it roughly halves TransNetV2's pseudo-event false positives on that diagnostic and cuts its false positives on ClipShots footage by about a quarter, while preserving recall. It does so while reaching parity with the strongest public detector across online, broadcast, short-form, and historical-archive transfer evaluations, under markedly stricter training: it learns from ClipShots real transitions only, whereas the anchor draws on additional corpora whose transitions are 85% synthetic. Code is available at https://github.com/linty5/PERSIST.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 34 references that are in the map. First posted on arXiv 29 Aug 2026.

Builds on

23 of 34 references.

References · 23

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  3. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  4. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  5. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  6. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  7. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  8. 2018SlowFast Networks for Video Recognitioncited by 1,867
  9. 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,143
  10. 2019BMN: Boundary-Matching Network for Temporal Action Proposal Generationcited by 329
  11. 2018BSN: Boundary Sensitive Network for Temporal Action Proposal Generationcited by 271
  12. 2020MovieNet: A Holistic Dataset for Movie Understandingcited by 206
11 more
  1. 2020TransNet V2: An effective deep network architecture for fast shot transition detectioncited by 171
  2. 2020A Local-to-Global Approach to Multi-modal Movie Scene Segmentationcited by 60
  3. 2021Shot Contrastive Self-Supervised Learning for Scene Boundary Detectioncited by 35
  4. 2023AutoShot: A Short Video Dataset and State-of-the-Art Shot Boundary Detectioncited by 23
  5. 2022Boundary-aware Self-supervised Learning for Video Scene Segmentationcited by 17
  6. 2018Fast Video Shot Transition Localization with Deep Structured Modelscited by 16
  7. 2019TransNet: A deep network for fast detection of common shot transitionscited by 15
  8. 2017Large-scale, Fast and Accurate Shot Boundary Detection through Spatio-temporal Convolutional Neural Networkscited by 12
  9. 2017Ridiculously Fast Shot Boundary Detection with Fully Convolutional Neural Networkscited by 11
  10. 2026OmniShotCut: Holistic Relational Shot Boundary Detection with Shot-Query Transformercited by 5
  11. 2026TransVLM: A Vision-Language Framework and Benchmark for Detecting Any Shot Transitionscited by 1

Built on by

Not cited yet.