TransNet V2: An effective deep network architecture for fast shot transition detection
Not on the map. Why?
Abstract (arXiv)
Although automatic shot transition detection approaches are already investigated for more than two decades, an effective universal human-level model was not proposed yet. Even for common shot transitions like hard cuts or simple gradual changes, the potential diversity of analyzed video contents may still lead to both false hits and false dismissals. Recently, deep learning-based approaches significantly improved the accuracy of shot transition detection using 3D convolutional architectures and artificially created training data. Nevertheless, one hundred percent accuracy is still an unreachable ideal. In this paper, we share the current version of our deep network TransNet V2 that reaches state-of-the-art performance on respected benchmarks. A trained instance of the model is provided so it can be instantly utilized by the community for a highly efficient analysis of large video archives. Furthermore, the network architecture, as well as our experience with the training process, are detailed, including simple code snippets for convenient usage of the proposed model and visualization of results.
Key facts. Cited by 166 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Aug 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 15; 2023: 8; 2024: 19; 2025: 51; 2026: 70.
166 papers.
Sort:
By area:
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
- 2026Advancing Open-source World Modelscited by 144
- 2024GameGen-X: Interactive Open-world Game Video Generationcited by 124
- 2025LongCat-Video Technical Reportcited by 73
- 2025Multi-subject Open-set Personalization in Video Generationcited by 65
- 2025Towards Understanding Camera Motions in Any Videocited by 62
- 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narrativescited by 51
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformercited by 50
- 2024Mind the Time: Temporally-Controlled Multi-Event Video Generationcited by 39
- 2024MEMO: Memory-Guided Diffusion for Expressive Talking Video Generationcited by 38
- 2025RoboScape: Physics-informed Embodied World Modelcited by 38
38 more
- 2024SafeWatch: An Efficient Safety-Policy Following Video Guardrail Model with Transparent Explanationscited by 37
- 2026Infinite Worlds with Versatile Interactionscited by 37
- 2025MultiShotMaster: A Controllable Multi-Shot Video Generation Frameworkcited by 33
- 2025DualTalk: Dual-Speaker Interaction for 3D Talking Head Conversationscited by 31
- 2025OneStory: Coherent Multi-Shot Video Generation with Adaptive Memorycited by 31
- 2024Imagine360: Immersive 360 Video Generation from Perspective Anchorcited by 27
- 2022ClothFormer:Taming Video Virtual Try-on in All Modulecited by 26
- 2025CineTrans: Learning to Generate Videos with Cinematic Transitions via Masked Diffusion Modelscited by 26
- 2024FakingRecipe: Detecting Fake News on Short Video Platforms from the Perspective of Creative Processcited by 25
- 2022The Anatomy of Video Editing: A Dataset and Benchmark Suite for AI-Assisted Video Editingcited by 24
- 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Modelscited by 24
- 2023AutoShot: A Short Video Dataset and State-of-the-Art Shot Boundary Detectioncited by 22
- 2025ShotBench: Expert-Level Cinematic Understanding in Vision-Language Modelscited by 22
- 2026ShotStream: Streaming Multi-Shot Video Generation for Interactive Storytellingcited by 22
- 2021Improving the Perceptual Quality of 2D Animation Interpolationcited by 20
- 2025HumanDreamer: Generating Controllable Human-Motion Videos via Decoupled Generationcited by 19
- 2022PACS: A Dataset for Physical Audiovisual CommonSense Reasoningcited by 17
- 2023Meta-Personalizing Vision-Language Models to Find Named Instances in Videocited by 16
- 2025Cut2Next: Generating Next Shot via In-Context Tuningcited by 15
- 2025VADTree: Explainable Training-Free Video Anomaly Detection via Hierarchical Granularity-Aware Treecited by 15
- 2024LLM-AD: Large Language Model based Audio Description Systemcited by 14
- 2025Beyond the Frame: Generating 360 Panoramic Videos from Perspective Videoscited by 14
- 2022Temporal Perceiver: A General Architecture for Arbitrary Boundary Detectioncited by 12
- 2022Match Cutting: Finding Cuts with Smooth Visual Transitionscited by 12
- 2025DanceTogether! Identity-Preserving Multi-Person Interactive Video Generationcited by 12
- 2026SkyReels-V4: Multi-modal Video-Audio Generation, Inpainting and Editing modelcited by 11
- 2026LPM 1.0: Video-based Character Performance Modelcited by 11
- 2025Frame In-N-Out: Unbounded Controllable Image-to-Video Generationcited by 10
- 2025Video-EM: Event-Centric Episodic Memory for Long-Form Video Understandingcited by 10
- 2024Large Model based Sequential Keyframe Extraction for Video Summarizationcited by 9
- 2024Towards Automated Movie Trailer Generationcited by 9
- 2025MACE-Dance: Motion-Appearance Cascaded Experts for Music-Driven Dance Video Generationcited by 9
- 2022Synopses of Movie Narratives: a Video-Language Dataset for Story Understandingcited by 8
- 2026MuSS: A Large-Scale Dataset and Cinematic Narrative Benchmark for Multi-Shot Subject-to-Video Generationcited by 8
- 2026CausalCine: Real-Time Autoregressive Generation for Multi-Shot Video Narrativescited by 8
- 2026MSAVBench: Towards Comprehensive and Reliable Evaluation of Multi-Shot Audio-Video Generationcited by 8
- 2022Zero-shot Video Moment Retrieval With Off-the-Shelf Modelscited by 7
- 2023Long-range Multimodal Pretraining for Movie Understandingcited by 7
50 most cited of 166 All 166 (JSON)
- 2026MUGEN: Interactive Panoramic World Exploration via Camera Control29 Sep 2026
- 2026SubjectAnchor: Subject-Aware Memory-to-Video for Multi-Shot Storytelling28 Sep 2026
- 2026Measuring the evolution of camera distance across a century of film22 Sep 2026
- 2026OmniVBench: A Benchmark and Large-Scale Dataset for Omni Reference-to-Video Generation18 Sep 2026
- 2026StrucPhysVideo: Learning Physical Dynamics from Structured Captions and Robot Actions16 Sep 2026
- 2026AlayaVista: Streaming World Modeling from Panoramic States to Perspective Video13 Sep 2026
- 2026Caption-once, Frames-on-Demand: Visual-Need Routing for Budget-Aware Agentic Long Video Understanding10 Sep 2026
- 2026Beyond Coherence: Benchmarking Professional Editing-Technique Execution in Multi-Shot Audio-Video Generation8 Sep 2026
- 2026VidaForge: Open Research Infrastructure for Video Pretraining Data Recipes6 Sep 2026
- 2026Multi-Grid Post-Training for Long-Form Multi-Shot Video Generation6 Sep 2026
- 2026OctWorld: Long-Range World-Consistent Video Generation with Octree-Based 3D Mapping3 Sep 2026
- 2026PERSIST: Persistent-State Discrimination for Shot Boundary Detection29 Aug 2026
38 more
- 2026TLive-Omni: An Omni-Modal Understanding Model for E-Commerce Live Streaming21 Aug 2026
- 2026Evaluating Multimodal Narrative Understanding of Popular Hollywood Films17 Aug 2026
- 2026Measuring Gender Representation in Animated Films17 Aug 2026
- 2026PersonaShot: Benchmarking Person-Centric Narrative Continuity in Multi-Shot Video Generation17 Aug 2026
- 2026Temporally Grounded Compositional Camera Motion Understanding via Geometric Knowledge Distillation11 Aug 2026
- 2026Bridging Event Streams and DiT: Event-Guided Video Frame Interpolation11 Aug 2026
- 2026Towards Expressive and Faithful Audio-to-Image Generation: A Unified Multimodal Dataset and Synthesis Framework10 Aug 2026
- 2026I Seek You in Videos: Identity-Conditioned Queries for Person-Centric Video Reasoning7 Aug 2026
- 2026Vorch-Omni: Multi-Task Orchestration of Sight and Sound6 Aug 2026
- 2026Visko Orbis 1.0: A Live Model for Real-Time Interactive Long Video Generation29 Jul 2026
- 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytelling29 Jul 2026
- 2026STEER: Steerable Dyadic Head Avatars26 Jul 2026
- 2026SANA-Video 2.0: Hybrid Linear Attention with Attention Residuals for Efficient Video Generation23 Jul 2026
- 2026Sparse Evidence Can Suffice: Agentic Evidence Seeking for Multimodal Video Misinformation Detection20 Jul 2026
- 2026Modeling turn-taking with distant viewing: investigating silence thresholds in human and AI-generated discourse20 Jul 2026
- 2026ShotPlan: Cinematic Video Generation with Learnable Planning Token20 Jul 2026
- 2026Autoregressive Modeling of Film with Applications in Video Montage16 Jul 2026
- 2026Infinite Worlds with Versatile Interactions8 Jul 2026
- 2026MAVIN: Multi-Shot Audio-Visual Generation with Customized Narrative Control28 Jun 2026
- 2026UnityShots: Memory-Driven Multi-Shot Audio-Video Generation with Boundary-Aware Gating19 Jun 2026
- 2026Go-with-the-Track: Video Compositing and Motion Control with Point Tracking18 Jun 2026
- 2026MaineCoon: Pursuing A Real-Time Audio-Visual Social World Model16 Jun 2026
- 2026OmniDirector: General Multi-Shot Camera Cloning without Cross-Paired Data11 Jun 2026
- 2026CineDance: Towards Next-Generation Multi-Shot Long-Form Cinematic Audio-Video Generation8 Jun 2026
- 2026SVHighlights: Towards Extremely Long Sport Video Highlight Detection5 Jun 2026
- 2026AnyMo: Scaling Any-Modality Conditional Motion Generation with Masked Modeling28 May 2026
- 2026BEAT: Rhythm-Elastic Alignment for Agentic Music-guided Movie Trailer Generation26 May 2026
- 2026U-CESE: Unified Clip-based Event Search Engine for AI Challenge HCMC 202522 May 2026
- 2026iTryOn: Mastering Interactive Video Virtual Try-On with Spatial-Semantic Guidance20 May 2026
- 2026MSAVBench: Towards Comprehensive and Reliable Evaluation of Multi-Shot Audio-Video Generation19 May 2026
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer14 May 2026
- 2026SEDiT: Mask-Free Video Subtitle Erasure via One-step Diffusion Transformer14 May 2026
- 2026CausalCine: Real-Time Autoregressive Generation for Multi-Shot Video Narratives12 May 2026
- 2026AniMatrix: An Anime Video Generation Model that Thinks in Art, Not Physics5 May 2026
- 2026TransVLM: A Vision-Language Framework and Benchmark for Detecting Any Shot Transitions30 Apr 2026
- 2026OmniShotCut: Holistic Relational Shot Boundary Detection with Shot-Query Transformer27 Apr 2026
- 2026MuSS: A Large-Scale Dataset and Cinematic Narrative Benchmark for Multi-Shot Subject-to-Video Generation26 Apr 2026
- 2026Seeing Fast and Slow: Learning the Flow of Time in Videos23 Apr 2026
50 newest of 166 All 166 (JSON)
- 2024MEMO: Memory-Guided Diffusion for Expressive Talking Video Generationcited by 38
- 2025CineTrans: Learning to Generate Videos with Cinematic Transitions via Masked Diffusion Modelscited by 26
- 2025Conditional Video Generation for High-Efficiency Video Compressioncited by 5
- 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytellingcited by 4
- 2026Mind the Generative Details: Direct Localized Detail Preference Optimization for Video Diffusion Modelscited by 3
- 2026SANA-Video 2.0: Hybrid Linear Attention with Attention Residuals for Efficient Video Generationcited by 2
- 2026SEDiT: Mask-Free Video Subtitle Erasure via One-step Diffusion Transformercited by 0
- 2026Vorch-Omni: Multi-Task Orchestration of Sight and Soundcited by 0
- 2026Bridging Event Streams and DiT: Event-Guided Video Frame Interpolationcited by 0
- 2026OctWorld: Long-Range World-Consistent Video Generation with Octree-Based 3D Mappingcited by 0
- 2026OctWorld: Long-Range World-Consistent Video Generation with Octree-Based 3D Mapping3 Sep 2026
- 2026Bridging Event Streams and DiT: Event-Guided Video Frame Interpolation11 Aug 2026
- 2026Vorch-Omni: Multi-Task Orchestration of Sight and Sound6 Aug 2026
- 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytelling29 Jul 2026
- 2026SANA-Video 2.0: Hybrid Linear Attention with Attention Residuals for Efficient Video Generation23 Jul 2026
- 2026SEDiT: Mask-Free Video Subtitle Erasure via One-step Diffusion Transformer14 May 2026
- 2026Mind the Generative Details: Direct Localized Detail Preference Optimization for Video Diffusion Models7 Jan 2026
- 2025CineTrans: Learning to Generate Videos with Cinematic Transitions via Masked Diffusion Models15 Aug 2025
- 2025Conditional Video Generation for High-Efficiency Video Compression21 Jul 2025
- 2024MEMO: Memory-Guided Diffusion for Expressive Talking Video Generation5 Dec 2024
- 2026Advancing Open-source World Modelscited by 144
- 2024GameGen-X: Interactive Open-world Game Video Generationcited by 124
- 2025LongCat-Video Technical Reportcited by 73
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformercited by 50
- 2025RoboScape: Physics-informed Embodied World Modelcited by 38
- 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Modelscited by 24
- 2026MaineCoon: Pursuing A Real-Time Audio-Visual Social World Modelcited by 4
- 2026AlayaVista: Streaming World Modeling from Panoramic States to Perspective Videocited by 1
- 2026StrucPhysVideo: Learning Physical Dynamics from Structured Captions and Robot Actionscited by 0
- 2026StrucPhysVideo: Learning Physical Dynamics from Structured Captions and Robot Actions16 Sep 2026
- 2026AlayaVista: Streaming World Modeling from Panoramic States to Perspective Video13 Sep 2026
- 2026MaineCoon: Pursuing A Real-Time Audio-Visual Social World Model16 Jun 2026
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer14 May 2026
- 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Models23 Apr 2026
- 2026Advancing Open-source World Models28 Jan 2026
- 2025LongCat-Video Technical Report25 Oct 2025
- 2025RoboScape: Physics-informed Embodied World Model29 Jun 2025
- 2024GameGen-X: Interactive Open-world Game Video Generation1 Nov 2024
- 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
- 2025ShotBench: Expert-Level Cinematic Understanding in Vision-Language Modelscited by 22
- 2023Meta-Personalizing Vision-Language Models to Find Named Instances in Videocited by 16
- 2026Learning Compact Video Representations for Efficient Long-form Video Understanding in Large Multimodal Modelscited by 3
- 2026Shot-Aware Frame Sampling for Video Understandingcited by 1
- 2026Can LLM-Generated Text Empower Surgical Vision-Language Pre-training?cited by 1
- 2026Evaluating Multimodal Narrative Understanding of Popular Hollywood Filmscited by 1
- 2026Evaluating Multimodal Narrative Understanding of Popular Hollywood Films17 Aug 2026
- 2026Can LLM-Generated Text Empower Surgical Vision-Language Pre-training?20 Apr 2026
- 2026Shot-Aware Frame Sampling for Video Understanding18 Mar 2026
- 2026Learning Compact Video Representations for Efficient Long-form Video Understanding in Large Multimodal Models19 Feb 2026
- 2025ShotBench: Expert-Level Cinematic Understanding in Vision-Language Models26 Jun 2025
- 2025SkyReels-V2: Infinite-length Film Generative Model17 Apr 2025
- 2023Meta-Personalizing Vision-Language Models to Find Named Instances in Video16 Jun 2023
- 2026Caption-once, Frames-on-Demand: Visual-Need Routing for Budget-Aware Agentic Long Video Understandingcited by 2
- 2026LLandMark: A Multi-Agent Framework for Landmark-Aware Multimodal Interactive Video Retrievalcited by 0
- 2026Sparse Evidence Can Suffice: Agentic Evidence Seeking for Multimodal Video Misinformation Detectioncited by 0
- 2026Caption-once, Frames-on-Demand: Visual-Need Routing for Budget-Aware Agentic Long Video Understanding10 Sep 2026
- 2026Sparse Evidence Can Suffice: Agentic Evidence Seeking for Multimodal Video Misinformation Detection20 Jul 2026
- 2026LLandMark: A Multi-Agent Framework for Landmark-Aware Multimodal Interactive Video Retrieval3 Mar 2026
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2025Multi-subject Open-set Personalization in Video Generationcited by 65
- 2025Towards Understanding Camera Motions in Any Videocited by 62
- 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narrativescited by 51
- 2024Mind the Time: Temporally-Controlled Multi-Event Video Generationcited by 39
- 2026Infinite Worlds with Versatile Interactionscited by 37
- 2025MultiShotMaster: A Controllable Multi-Shot Video Generation Frameworkcited by 33
- 2025DualTalk: Dual-Speaker Interaction for 3D Talking Head Conversationscited by 31
- 2025OneStory: Coherent Multi-Shot Video Generation with Adaptive Memorycited by 31
- 2024Imagine360: Immersive 360 Video Generation from Perspective Anchorcited by 27
- 2022ClothFormer:Taming Video Virtual Try-on in All Modulecited by 26
- 2024FakingRecipe: Detecting Fake News on Short Video Platforms from the Perspective of Creative Processcited by 25
12 most cited of 131 All 131 (JSON)
- 2026MUGEN: Interactive Panoramic World Exploration via Camera Control29 Sep 2026
- 2026SubjectAnchor: Subject-Aware Memory-to-Video for Multi-Shot Storytelling28 Sep 2026
- 2026Measuring the evolution of camera distance across a century of film22 Sep 2026
- 2026OmniVBench: A Benchmark and Large-Scale Dataset for Omni Reference-to-Video Generation18 Sep 2026
- 2026Beyond Coherence: Benchmarking Professional Editing-Technique Execution in Multi-Shot Audio-Video Generation8 Sep 2026
- 2026VidaForge: Open Research Infrastructure for Video Pretraining Data Recipes6 Sep 2026
- 2026Multi-Grid Post-Training for Long-Form Multi-Shot Video Generation6 Sep 2026
- 2026PERSIST: Persistent-State Discrimination for Shot Boundary Detection29 Aug 2026
- 2026TLive-Omni: An Omni-Modal Understanding Model for E-Commerce Live Streaming21 Aug 2026
- 2026Measuring Gender Representation in Animated Films17 Aug 2026
- 2026PersonaShot: Benchmarking Person-Centric Narrative Continuity in Multi-Shot Video Generation17 Aug 2026
- 2026Temporally Grounded Compositional Camera Motion Understanding via Geometric Knowledge Distillation11 Aug 2026
12 newest of 131 All 131 (JSON)