AEGIS: A Holistic Benchmark for Evaluating Forensic Analysis of AI-Generated Academic Images
Not on the map. Why?
Abstract (arXiv)
We introduce AEGIS, A holistic benchmark for Evaluating forensic analysis of AI-Generated academic ImageS. Compared to existing benchmarks, AEGIS features three key advances: (1) Domain-Specific Complexity: covering seven academic categories with 39 fine-grained subtypes, exposing intrinsic forensic difficulty, where even GPT-5.1 reaches 48.80% overall performance and expert models achieve only limited localization accuracy (IoU 30.09%); (2) Diverse Forgery Simulations: modeling four prevalent academic forgery strategies across 25 generative models, with 11 yielding average forensic accuracy below 50%, showing that forensics lag behind generative advances; and (3) Multi-Dimensional Forensic Evaluation: jointly assessing detection, reasoning, and localization, revealing complementary strengths between model families, with multimodal large language models (MLLMs) at 84.74% accuracy in textual artifact recognition and expert detectors peaking at 79.54% accuracy in binary authenticity detection. By evaluating 25 leading MLLMs, nine expert models, and one unified multimodal understanding and generation model, AEGIS serves as a diagnostic testbed exposing fundamental limitations in academic image forensics.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 15 of its 35 references that are in the map. First posted on arXiv 30 Apr 2026.
Builds on
15 of 35 references.
References · 15
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 982
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 321
- 2022On the detection of synthetic images generated by diffusion modelscited by 283
- 2024A Sanity Check for AI-generated Image Detectioncited by 189
- 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 108
- 2025Spot the Fake: Large Multimodal Model-Based Synthetic Image Detection with Artifact Explanationcited by 68
- 2025Dual Data Alignment Makes AI-Generated Image Detector Easier Generalizablecited by 60
- 2025Is Artificial Intelligence Generated Image Detection a Solved Problem?cited by 51
3 more
- 2024Aligned Datasets Improve Detection of Latent Diffusion-Generated Imagescited by 36
- 2023Rethinking Image Editing Detection in the Era of Generative AI Revolutioncited by 21
- 2024Semi-Truths: A Large-Scale Dataset of AI-Augmented Images for Evaluating Robustness of AI-Generated Image detectorscited by 17
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025AEGIS: Authenticity Evaluation Benchmark for AI-Generated Video Sequences
- 2025Forensics-Bench: A Comprehensive Forgery Detection Benchmark Suite for Large Vision Language Models
- 2026ForensicFormer: Hierarchical Multi-Scale Reasoning for Cross-Domain Image Forgery Detection
- 2025ForenX: Towards Explainable AI-Generated Image Detection with Multimodal Large Language Models
- 2026ReAlign: Generalizable Image Forgery Detection via Reasoning-Aligned Representation
- 2025Toward Generalizable Forgery Detection and Reasoning
- 2025FakeScope: Large Multimodal Expert Model for Transparent AI-Generated Image Forensics
- 2026THEMIS: Towards Holistic Evaluation of MLLMs for Scientific Paper Fraud Forensics