mlsanityData to 14 Oct 2026

SKDU at De-Factify 4.0: Vision Transformer with Data Augmentation for AI-Generated Image Detection

arXiv 2503.18812 ↗First posted 24 Mar 2025cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning

also in 1 more
Abstract (arXiv)

The aim of this work is to explore the potential of pre-trained vision-language models, e.g. Vision Transformers (ViT), enhanced with advanced data augmentation strategies for the detection of AI-generated images. Our approach leverages a fine-tuned ViT model trained on the Defactify-4.0 dataset, which includes images generated by state-of-the-art models such as Stable Diffusion 2.1, Stable Diffusion XL, Stable Diffusion 3, DALL-E 3, and MidJourney. We employ perturbation techniques like flipping, rotation, Gaussian noise injection, and JPEG compression during training to improve model robustness and generalisation. The experimental results demonstrate that our ViT-based pipeline achieves state-of-the-art performance, significantly outperforming competing methods on both validation and test datasets.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. First posted on arXiv 24 Mar 2025.

Builds on

0 of 0 references.

No references here yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026ViT-5: Vision Transformers for The Mid-2020s
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
  3. 2023Interpretability-Aware Vision Transformer
  4. 2024ViT-1.58b: Mobile Vision Transformers in the 1-bit Era
  5. 2023DiffiT: Diffusion Vision Transformers for Image Generation
  6. 2022All are Worth Words: A ViT Backbone for Diffusion Models
  7. 2022PSAQ-ViT V2: Towards Accurate and General Data-Free Quantization for Vision Transformers
  8. 2022Exploring Vision Transformers as Diffusion Learners