SpecSem-Net: Integrating Spectral and Semantic Features for Robust AI-generated Video Detection
Not on the map. Why?
Abstract (arXiv)
The remarkable visual fidelity of recent commercial video generative models, such as Sora and Veo, renders robust AI-generated video detection increasingly essential to prevent synthetic content from being indistinguishable from real videos and exploited for disinformation. However, existing detectors often fail due to an over-reliance on increasingly realistic semantic features, neglecting subtle spectral artifacts. In this paper, we propose SpecSem-Net, the first framework to introduce a semantic-guided spectral denoising mechanism specifically for high-fidelity AI-generated video detection. Specifically, we design a spectral module to extract high-frequency features via Fourier-Transform based filtering. Furthermore, to reduce misjudgments arising from spectral noise, we employ a Gated Merging Mechanism to adaptively fuse semantic context, effectively mitigating spectral noise. Additionally, to evaluate detector performance on the latest top-tier generative models, we construct a comprehensive benchmark comprising 5 SOTA commercial generators. Extensive experiments demonstrate that SpecSem-Net outperforms existing methods, achieving accuracies of 87.25% and 95.59% on our benchmark and public datasets, respectively.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 43 of its 59 references that are in the map. First posted on arXiv 17 May 2026.
Builds on
43 of 59 references.
References · 43
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2017The Kinetics Human Action Video Datasetcited by 1,909
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
31 more
- 2021ViViT: A Video Vision Transformercited by 1,620
- 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,432
- 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
- 2021Video Swin Transformercited by 1,091
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
- 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 280
- 2020What makes fake images detectable? Understanding properties that generalizecited by 273
- 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 262
- 2020Focal Frequency Loss for Image Reconstruction and Synthesiscited by 206
- 2025HunyuanImage 3.0 Technical Reportcited by 149
- 2019Fourier Spectrum Discrepancies in Deep Network Generated Imagescited by 139
- 2023TALL: Thumbnail Layout for Deepfake Video Detectioncited by 100
- 2024DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmarkcited by 92
- 2021A Closer Look at Fourier Spectrum Discrepancies for CNN-generated Images Detectioncited by 68
- 2021BiHPF: Bilateral High-Pass Filters for Robust Deepfake Detectioncited by 60
- 2024Any-Resolution AI-Generated Image Detection by Spectral Learningcited by 57
- 2025D3: Training-Free AI-Generated Video Detection Using Second-Order Featurescited by 34
- 2025BusterX: MLLM-Powered AI-Generated Video Forgery Detection and Explanationcited by 33
- 2025BusterX++: Towards Unified Cross-Modal AI-Generated Content Detection and Explanation with MLLMcited by 29
- 2025Physics-Driven Spatiotemporal Modeling for AI-Generated Video Detectioncited by 27
- 2024Distinguish Any Fake Videos: Unleashing the Power of Large-scale Data and Motion Featurescited by 21
- 2024Turns Out I'm Not Real: Towards Robust Detection of AI-Generated Videoscited by 21
- 2024Frequency-Aware Deepfake Detection: Improving Generalizability through Frequency Space Learningcited by 20
- 2024How Far are AI-generated Videos from Simulating the 3D Visual World: A Learned 3D Evaluation Approachcited by 16
- 2025VidGuard-R1: AI-Generated Video Detection and Explanation via Reasoning MLLMs and RLcited by 15
- 2025Dual Frequency Branch Framework with Reconstructed Sliding Windows Attention for AI-Generated Image Detectioncited by 11
- 2024AI-Generated Video Detection via Spatio-Temporal Anomaly Learningcited by 9
- 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challengescited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.