mlsanityData to 14 Oct 2026

Detecting AI-Generated Videos with Spiking Neural Networks

arXiv 2605.05895 ↗First posted 7 May 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Modern AI-generated videos are photorealistic at the single-frame level, leaving inter-frame dynamics as the main remaining axis for detection. Existing detectors typically handle this temporal evidence in three ways: feeding the full frame sequence to a generic temporal backbone, reducing one dominant temporal cue to fixed video-level descriptors, or comparing temporal features to real-video statistics through a detection metric. These strategies degrade sharply under cross-generator evaluation, where artifact type and timescale vary across generators. On caption-paired benchmark, GenVidBench, we identify two signatures that prior detectors do not jointly exploit: AI-generated videos exhibit smoother frame-to-frame temporal residuals at the pixel level, and more compact trajectories in the semantic feature space, indicating a temporal smoothness gap at both levels. We further observe that, when raw video is fed into a Spiking Neural Networks (SNNs), fake clips elicit firing predominantly at object and motion boundaries, unlike real clips, suggesting that the SNN responds to temporal artifacts localized at edges. These cues are sparse, asynchronous, and concentrated at moments of change, which makes SNNs a natural choice for this task: their event-driven, sparsely-activated dynamics align with the structure of the residual signal in a way that dense ANN backbones do not. Building on this observation, we propose MAST, a detector that processes multi-channel temporal residuals with a spike-driven temporal branch alongside a frozen semantic encoder for cross-generator generalization. On the GenVideo benchmark, MAST achieves 93.14% mean accuracy across 10 unseen generators under strict cross-generator evaluation, matching or surpassing the strongest ANN-based detectors and demonstrating the practical applicability of SNNs to AI-generated video detection.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 64 of its 86 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

64 of 86 references.

References · 64

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  3. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  4. 2020Supervised Contrastive Learningcited by 2,829
  5. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  6. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  7. 2017The Kinetics Human Action Video Datasetcited by 1,909
  8. 2018SlowFast Networks for Video Recognitioncited by 1,867
  9. 2021Video Swin Transformercited by 1,091
  10. 2019Event-based Vision: A Surveycited by 1,016
  11. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  12. 2018TSM: Temporal Shift Module for Efficient Video Understandingcited by 856
38 more
  1. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
  2. 2023ModelScope Text-to-Video Technical Reportcited by 658
  3. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  4. 2020X3D: Expanding Architectures for Efficient Video Recognitioncited by 637
  5. 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 626
  6. 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
  7. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
  8. 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
  9. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 535
  10. 2021MViTv2: Improved Multiscale Vision Transformers for Classification and Detectioncited by 519
  11. 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
  12. 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
  13. 2020Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networkscited by 345
  14. 2024VideoMamba: State Space Model for Efficient Video Understandingcited by 328
  15. 2022Expanding Language-Image Pretrained Models for General Video Recognitioncited by 321
  16. 2024InternVideo2: Scaling Foundation Models for Multimodal Video Understandingcited by 317
  17. 2015Converting Static Image Datasets to Spiking Neuromorphic Datasets Using Saccadescited by 314
  18. 2023Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generationcited by 302
  19. 2022Spikformer: When Spiking Neural Network Meets Transformercited by 271
  20. 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Predictioncited by 233
  21. 2023SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligencecited by 169
  22. 2023Swap Attention in Spatiotemporal Diffusions for Text-to-Video Generationcited by 154
  23. 2023Spike-driven Transformercited by 146
  24. 2020Enabling Deep Spiking Neural Networks with Hybrid Conversion and Spike Timing Dependent Backpropagationcited by 144
  25. 2023TALL: Thumbnail Layout for Deepfake Video Detectioncited by 100
  26. 2018Event-based High Dynamic Range Image and Very High Frame Rate Video Generation using Conditional Generative Adversarial Networkscited by 97
  27. 2024DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmarkcited by 92
  28. 2021Spatiotemporal Inconsistency Learning for DeepFake Video Detectioncited by 88
  29. 2024Vript: A Video Is Worth Thousands of Wordscited by 71
  30. 2024Recent Event Camera Innovations: A Surveycited by 68
  31. 2022Event-based Video Reconstruction via Potential-assisted Spiking Neural Networkcited by 59
  32. 2024Scaling Spike-driven Transformer with Efficient Spike Firing Approximation Trainingcited by 59
  33. 2023SEENN: Towards Temporal Spiking Early-Exit Neural Networkscited by 41
  34. 2023Rethinking the Up-Sampling Operations in CNN-based Generative Network for Generalizable Deepfake Detectioncited by 41
  35. 2024On Learning Multi-Modal Forgery Representation for Diffusion Generated Video Detectioncited by 40
  36. 2023Spiking PointNet: Spiking Neural Networks for Point Cloudscited by 34
  37. 2025Ivy-Fake: A Unified Explainable Framework and Benchmark for Image and Video AIGC Detectioncited by 34
  38. 2025AI-Generated Video Detection via Perceptual Straighteningcited by 34

50 most cited of 64 All 64 (JSON)

Built on by

Not cited yet.