Detecting AI-Generated Videos with Spiking Neural Networks
Not on the map. Why?
Abstract (arXiv)
Modern AI-generated videos are photorealistic at the single-frame level, leaving inter-frame dynamics as the main remaining axis for detection. Existing detectors typically handle this temporal evidence in three ways: feeding the full frame sequence to a generic temporal backbone, reducing one dominant temporal cue to fixed video-level descriptors, or comparing temporal features to real-video statistics through a detection metric. These strategies degrade sharply under cross-generator evaluation, where artifact type and timescale vary across generators. On caption-paired benchmark, GenVidBench, we identify two signatures that prior detectors do not jointly exploit: AI-generated videos exhibit smoother frame-to-frame temporal residuals at the pixel level, and more compact trajectories in the semantic feature space, indicating a temporal smoothness gap at both levels. We further observe that, when raw video is fed into a Spiking Neural Networks (SNNs), fake clips elicit firing predominantly at object and motion boundaries, unlike real clips, suggesting that the SNN responds to temporal artifacts localized at edges. These cues are sparse, asynchronous, and concentrated at moments of change, which makes SNNs a natural choice for this task: their event-driven, sparsely-activated dynamics align with the structure of the residual signal in a way that dense ANN backbones do not. Building on this observation, we propose MAST, a detector that processes multi-channel temporal residuals with a spike-driven temporal branch alongside a frozen semantic encoder for cross-generator generalization. On the GenVideo benchmark, MAST achieves 93.14% mean accuracy across 10 unseen generators under strict cross-generator evaluation, matching or surpassing the strongest ANN-based detectors and demonstrating the practical applicability of SNNs to AI-generated video detection.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 64 of its 86 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
64 of 86 references.
References · 64
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2020Supervised Contrastive Learningcited by 2,829
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2017The Kinetics Human Action Video Datasetcited by 1,909
- 2018SlowFast Networks for Video Recognitioncited by 1,867
- 2021Video Swin Transformercited by 1,091
- 2019Event-based Vision: A Surveycited by 1,016
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2018TSM: Temporal Shift Module for Efficient Video Understandingcited by 856
38 more
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
- 2023ModelScope Text-to-Video Technical Reportcited by 658
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
- 2020X3D: Expanding Architectures for Efficient Video Recognitioncited by 637
- 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 626
- 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
- 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 535
- 2021MViTv2: Improved Multiscale Vision Transformers for Classification and Detectioncited by 519
- 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
- 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
- 2020Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networkscited by 345
- 2024VideoMamba: State Space Model for Efficient Video Understandingcited by 328
- 2022Expanding Language-Image Pretrained Models for General Video Recognitioncited by 321
- 2024InternVideo2: Scaling Foundation Models for Multimodal Video Understandingcited by 317
- 2015Converting Static Image Datasets to Spiking Neuromorphic Datasets Using Saccadescited by 314
- 2023Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generationcited by 302
- 2022Spikformer: When Spiking Neural Network Meets Transformercited by 271
- 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Predictioncited by 233
- 2023SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligencecited by 169
- 2023Swap Attention in Spatiotemporal Diffusions for Text-to-Video Generationcited by 154
- 2023Spike-driven Transformercited by 146
- 2020Enabling Deep Spiking Neural Networks with Hybrid Conversion and Spike Timing Dependent Backpropagationcited by 144
- 2023TALL: Thumbnail Layout for Deepfake Video Detectioncited by 100
- 2018Event-based High Dynamic Range Image and Very High Frame Rate Video Generation using Conditional Generative Adversarial Networkscited by 97
- 2024DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmarkcited by 92
- 2021Spatiotemporal Inconsistency Learning for DeepFake Video Detectioncited by 88
- 2024Vript: A Video Is Worth Thousands of Wordscited by 71
- 2024Recent Event Camera Innovations: A Surveycited by 68
- 2022Event-based Video Reconstruction via Potential-assisted Spiking Neural Networkcited by 59
- 2024Scaling Spike-driven Transformer with Efficient Spike Firing Approximation Trainingcited by 59
- 2023SEENN: Towards Temporal Spiking Early-Exit Neural Networkscited by 41
- 2023Rethinking the Up-Sampling Operations in CNN-based Generative Network for Generalizable Deepfake Detectioncited by 41
- 2024On Learning Multi-Modal Forgery Representation for Diffusion Generated Video Detectioncited by 40
- 2023Spiking PointNet: Spiking Neural Networks for Point Cloudscited by 34
- 2025Ivy-Fake: A Unified Explainable Framework and Benchmark for Image and Video AIGC Detectioncited by 34
- 2025AI-Generated Video Detection via Perceptual Straighteningcited by 34
50 most cited of 64 All 64 (JSON)
Built on by
Not cited yet.