mlsanityData to 14 Oct 2026

SPARK-IL: Spectral Retrieval-Augmented RAG for Knowledge-driven Deepfake Detection via Incremental Learning

arXiv 2604.03833 ↗First posted 4 Apr 2026cs.CVcited by 0

On the map: Retrieval-augmented generation → Multimodal RAG

Abstract (arXiv)

Detecting AI-generated images remains a significant challenge because detectors trained on specific generators often fail to generalize to unseen models; however, while pixel-level artifacts vary across models, frequency-domain signatures exhibit greater consistency, providing a promising foundation for cross-generator detection. To address this, we propose SPARK-IL, a retrieval-augmented framework that combines dual-path spectral analysis with incremental learning by utilizing a partially frozen ViT-L/14 encoder for semantic representations alongside a parallel path for raw RGB pixel embeddings. Both paths undergo multi-band Fourier decomposition into four frequency bands, which are individually processed by Kolmogorov-Arnold Networks (KAN) with mixture-of-experts for band-specific transformations before the resulting spectral embeddings are fused via cross-attention with residual connections. During inference, this fused embedding retrieves the k nearest labeled signatures from a Milvus database using cosine similarity to facilitate predictions via majority voting, while an incremental learning strategy expands the database and employs elastic weight consolidation to preserve previously learned transformations. Evaluated on the UniversalFakeDetect benchmark across 19 generative models -- including GANs, face-swapping, and diffusion methods -- SPARK-IL achieves a 94.6% mean accuracy, with the code to be publicly released at https://github.com/HessenUPHF/SPARK-IL.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal RAG, one of 15 directions in Retrieval-augmented generation. Builds on 24 of its 34 references that are in the map. First posted on arXiv 4 Apr 2026.

Builds on

24 of 34 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Retrieval-Augmented Visual Question Answering via Built-in Autoregressive Search Engines23 Feb
  2. 2024Wiki-LLaVA: Hierarchical Retrieval-Augmented Generation for Multimodal LLMs23 Apr

Other references · 22

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  3. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  4. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  5. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  6. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  7. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
  8. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
  9. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
  10. 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
  11. 2020What makes fake images detectable? Understanding properties that generalizecited by 273
  12. 2024G-Retriever: Retrieval-Augmented Generation for Textual Graph Understanding and Question Answeringcited by 223
10 more
  1. 2023Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detectioncited by 182
  2. 2023UFOGen: You Forward Once Large Scale Text-to-Image Generation via Diffusion GANscited by 166
  3. 2023Raising the Bar of AI-generated Image Detection with CLIPcited by 164
  4. 2019Detecting GAN generated Fake Images using Co-occurrence Matricescited by 124
  5. 2024C2P-CLIP: Injecting Category Common Prompt in CLIP to Enhance Generalization in Deepfake Detectioncited by 113
  6. 2024Leveraging Representations from Intermediate Encoder-blocks for Synthetic Image Detectioncited by 89
  7. 2023GALIP: Generative Adversarial CLIPs for Text-to-Image Synthesiscited by 85
  8. 2023AntifakePrompt: Prompt-Tuned Vision-Language Models are Fake Image Detectorscited by 64
  9. 2024Bi-LORA: A Vision-Language Approach for Synthetic Image Detectioncited by 20
  10. 2025Visual RAG: Expanding MLLM visual knowledge without fine-tuningcited by 11

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025SpecXNet: A Dual-Domain Convolutional Network for Robust Deepfake Detection
  2. 2025Training-Free Multimodal Deepfake Detection via Graph Reasoning
  3. 2023DFIL: Deepfake Incremental Learning by Exploiting Domain-invariant Forgery Clues
  4. 2026A Multi-Domain Feature Fusion Framework for Generalizable Deepfake Detection Across Different Generators
  5. 2026Evidence Packing for Cross-Domain Image Deepfake Detection with LVLMs
  6. 2025AdaptPrompt: Parameter-Efficient Adaptation of VLMs for Generalizable Deepfake Detection
  7. 2026VRAG-DFD: Verifiable Retrieval-Augmentation for MLLM-based Deepfake Detection
  8. 2026Spectral Retrieval: Multi-Scale Sinc Convolution over Token Embeddings for Localized Retrieval in LLM Multi-Agent Systems