AIForge-Doc: A Benchmark for Detecting AI-Forged Tampering in Financial and Form Documents
Not on the map. Why?
Abstract (arXiv)
We present AIForge-Doc, the first dedicated benchmark targeting exclusively diffusion-model-based inpainting in financial and form documents with pixel-level annotation. Existing document forgery datasets rely on traditional digital editing tools (e.g., Adobe Photoshop, GIMP), creating a critical gap: state-of-the-art detectors are blind to the rapidly growing threat of AI-forged document fraud. AIForge-Doc addresses this gap by systematically forging numeric fields in real-world receipt and form images using two AI inpainting APIs -- Gemini 2.5 Flash Image and Ideogram v2 Edit -- yielding 4,061 forged images from four public document datasets (CORD, WildReceipt, SROIE, XFUND) across nine languages, annotated with pixel-precise tampered-region masks in DocTamper-compatible format. We benchmark three representative detectors -- TruFor, DocTamper, and a zero-shot GPT-4o judge -- and find that all existing methods degrade substantially: TruFor achieves AUC=0.751 (zero-shot, out-of-distribution) vs. AUC=0.96 on NIST16; DocTamper achieves AUC=0.563 vs. AUC=0.98 in-distribution, with pixel-level IoU=0.020; GPT-4o achieves only 0.509 -- essentially at chance -- confirming that AI-forged values are indistinguishable to automated detectors and VLMs. These results demonstrate that AIForge-Doc represents a qualitatively new and unsolved challenge for document forensics.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 17 of its 41 references that are in the map. First posted on arXiv 24 Feb 2026.
Builds on
17 of 41 references.
References · 17
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2022On the detection of synthetic images generated by diffusion modelscited by 282
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
- 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
- 2022TruFor: Leveraging all-round clues for trustworthy image forgery detection and localizationcited by 130
- 2024AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Errorcited by 123
- 2021Spatial Dual-Modality Graph Reasoning for Key Information Extractioncited by 43
- 2023IML-ViT: Benchmarking Image Manipulation Localization by Vision Transformercited by 42
- 2024Revisiting Tampered Scene Text Detection in the Era of Generative AIcited by 21
- 2023Toward Real Text Manipulation Detection: New Dataset and New Solutioncited by 20
5 more
- 2026How well are open sourced AI-generated image detection models out-of-the-box: A comprehensive benchmark studycited by 15
- 2025Can Multi-modal (reasoning) LLMs work as deepfake detectors?cited by 14
- 2025Do Deepfake Detectors Work in Reality?cited by 11
- 2025Can Multi-modal (reasoning) LLMs detect document manipulation?cited by 7
- 2026Out of the box age estimation through facial imagery: A Comprehensive Benchmark of Vision-Language Models vs. out-of-the-box Traditional Architecturescited by 5
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026GPT4o-Receipt: A Dataset and Human Study for AI-Generated Document Forensicscited by 4
- 2026When the Forger Is the Judge: GPT-Image-2 Cannot Recognize Its Own Faked Documentscited by 3
- 2026TextRich: A Multi-Domain Benchmark for Detecting AI-Generated Text-Rich Images from GPT-Image-2cited by 2
- 2026ChatGPT Images 2.5 on Forgery Tasks: Testing Advertised Improvements Against Known Answerscited by 2
- 2026Agents That Edit Documents: Measuring Agentic PDF Forgery Against a Non-Agentic Controlcited by 0
- 2026Agents That Edit Documents: Measuring Agentic PDF Forgery Against a Non-Agentic Control20 Sep 2026
- 2026ChatGPT Images 2.5 on Forgery Tasks: Testing Advertised Improvements Against Known Answers12 Sep 2026
- 2026TextRich: A Multi-Domain Benchmark for Detecting AI-Generated Text-Rich Images from GPT-Image-217 Jun 2026
- 2026When the Forger Is the Judge: GPT-Image-2 Cannot Recognize Its Own Faked Documents28 Apr 2026
- 2026GPT4o-Receipt: A Dataset and Human Study for AI-Generated Document Forensics12 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Models
- 2026From Forgeries to Foundation Models: A Systematic Survey of Identity Document Attack and Detection
- 2026FraudBench: A Multimodal Benchmark for Detecting AI-Generated Fraudulent Refund Evidence
- 2025Can Generative Models Actually Forge Realistic Identity Documents?
- 2026Universal Anti-forensics Attack against Image Forgery Detection via Multi-modal Guidance
- 2024EditScout: Locating Forged Regions from Diffusion-based Edited Images with Multimodal LLM
- 2025Toward Generalizable Forgery Detection and Reasoning
- 2024TGIF: Text-Guided Inpainting Forgery Dataset