Omni-IML: Towards Unified Image Manipulation Localization
Not on the map. Why?
Abstract (arXiv)
Existing Image Manipulation Localization (IML) methods mostly rely heavily on task-specific designs, making them perform well only on the target IML task, while joint training on multiple IML tasks causes significant performance degradation, hindering real applications. To this end, we propose Omni-IML, the first generalist model designed to unify IML across diverse tasks. Specifically, Omni-IML achieves generalization through three key components: (1) a Modal Gate Encoder, which adaptively selects the optimal encoding modality per sample, (2) a Dynamic Weight Decoder, which dynamically adjusts decoder filters to the task at hand, and (3) an Anomaly Enhancement module that leverages box supervision to highlight the tampered regions and facilitate the learning of task-agnostic features. Beyond localization, to support interpretation of the tampered images, we construct Omni-273k, a large high-quality dataset that includes natural language descriptions of tampered artifact. It is annotated through our automatic, chain-of-thoughts annotation technique. We also design a simple-yet-effective interpretation module to better utilize these descriptive annotations. Our extensive experiments show that our single Omni-IML model achieves state-of-the-art performance across all four major IML tasks, providing a valuable solution for practical deployment and a promising direction of generalist models in image forensics. Our code and dataset will be publicly available.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 17 of its 40 references that are in the map. First posted on arXiv 22 Nov 2024.
Builds on
17 of 40 references.
References · 17
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
- 2017Advances in Pre-Training Distributed Word Representationscited by 207
- 2019ICDAR 2019 Robust Reading Challenge on Reading Chinese Text on Signboardcited by 128
- 2021MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detectioncited by 117
- 2023Explicit Visual Prompting for Low-Level Structure Segmentationscited by 114
- 2024FFAA: Multimodal Large Language Model based Explainable Open-World Face Forgery Analysis Assistantcited by 61
- 2021OpenForensics: Large-Scale Challenging Dataset For Multi-Face Forgery Detection And Segmentation In-The-Wildcited by 50
5 more
- 2023AutoSplice: A Text-prompt Manipulated Image Dataset for Media Forensicscited by 46
- 2024IMDL-BenCo: A Comprehensive Benchmark and Codebase for Image Manipulation Detection & Localizationcited by 42
- 2024Revisiting Tampered Scene Text Detection in the Era of Generative AIcited by 21
- 2021MultiTask-CenterNet (MCN): Efficient and Diverse Multitask Learning using an Anchor Free Approachcited by 17
- 2024DA-HFNet: Progressive Fine-Grained Forgery Image Detection and Localization Based on Dual Attentioncited by 4
Built on by
Citing papers per year: 2025: 4; 2026: 3.
7 papers.
- 2026TextShield-R1: Reinforced Reasoning for Tampered Text Detectioncited by 6
- 2025Webly-Supervised Image Manipulation Localization via Category-Aware Auto-Annotationcited by 3
- 2025Revisiting Image Manipulation Localization under Realistic Manipulation Scenarioscited by 3
- 2025RelayFormer: A Unified Local-Global Attention Framework for Scalable Image and Video Manipulation Localizationcited by 0
- 2025EfficientIML: Efficient High-Resolution Image Manipulation Localizationcited by 0
- 2026Efficient Document Tampering Localization with Multi-Level Discrepancy Features and Unified DCT-Quantization Embeddingcited by 0
- 2026Agents That Edit Documents: Measuring Agentic PDF Forgery Against a Non-Agentic Controlcited by 0
- 2026Agents That Edit Documents: Measuring Agentic PDF Forgery Against a Non-Agentic Control20 Sep 2026
- 2026Efficient Document Tampering Localization with Multi-Level Discrepancy Features and Unified DCT-Quantization Embedding21 Jun 2026
- 2026TextShield-R1: Reinforced Reasoning for Tampered Text Detection23 Feb 2026
- 2025Revisiting Image Manipulation Localization under Realistic Manipulation Scenarios24 Sep 2025
- 2025EfficientIML: Efficient High-Resolution Image Manipulation Localization10 Sep 2025
- 2025Webly-Supervised Image Manipulation Localization via Category-Aware Auto-Annotation28 Aug 2025
- 2025RelayFormer: A Unified Local-Global Attention Framework for Scalable Image and Video Manipulation Localization13 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2025From Passive Perception to Active Memory: A Weakly Supervised Image Manipulation Localization Framework Driven by Coarse-Grained Annotations
- 2025UGD-IML: A Unified Generative Diffusion-based Framework for Constrained and Unconstrained Image Manipulation Localization
- 2025Training-Free In-Context Forensic Chain for Image Manipulation Detection and Localization
- 2025ManipShield: A Unified Framework for Image Manipulation Detection, Localization and Explanation
- 2026Impostor: An Agent-Curated Benchmark for Realistic AIGC Manipulation Localization
- 2026FOCUS: Forcing In-Context Object Localization through Visual Support Constraints and Policy Optimization
- 2025DEAL-300K: Diffusion-based Editing Area Localization with a 300K-Scale Dataset and Frequency-Prompted Baseline
- 2026When 2D Cues Fail: Improving Image Manipulation Localization with Reliable 3D Geometry