mlsanityData to 14 Oct 2026

ObjectFormer for Image Manipulation Detection and Localization

arXiv 2203.14681 ↗First posted 28 Mar 2022cs.CVcited by 78

Not on the map. Why?

Abstract (arXiv)

Recent advances in image editing techniques have posed serious challenges to the trustworthiness of multimedia data, which drives the research of image tampering detection. In this paper, we propose ObjectFormer to detect and localize image manipulations. To capture subtle manipulation traces that are no longer visible in the RGB domain, we extract high-frequency features of the images and combine them with RGB features as multimodal patch embeddings. Additionally, we use a set of learnable object prototypes as mid-level representations to model the object-level consistencies among different regions, which are further used to refine patch embeddings to capture the patch-level consistencies. We conduct extensive experiments on various datasets and the results verify the effectiveness of the proposed method, outperforming state-of-the-art tampering detection and localization methods.

Key facts. Cited by 78 papers in the map (data through 14 Oct 2026). Builds on 32 of its 48 references that are in the map. First posted on arXiv 28 Mar 2022.

Builds on

32 of 48 references.

References · 32

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  4. 2020End-to-End Object Detection with Transformerscited by 7,414
  5. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  6. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  7. 2022Generative Adversarial Networkscited by 5,627
  8. 2013Auto-Encoding Variational Bayescited by 4,053
  9. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  10. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
  11. 2014Conditional Generative Adversarial Netscited by 2,162
  12. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
20 more
  1. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
  2. 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,101
  3. 2021Video Swin Transformercited by 1,091
  4. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
  5. 2021Early Convolutions Help Transformers See Bettercited by 396
  6. 2021Rethinking Spatial Dimensions of Vision Transformerscited by 361
  7. 2021AdaViT: Adaptive Vision Transformers for Efficient Image Recognitioncited by 228
  8. 2020Swapping Autoencoder for Deep Image Manipulationcited by 215
  9. 2021BEVT: BERT Pretraining of Video Transformerscited by 169
  10. 2019ManiGAN: Text-Guided Image Manipulationcited by 156
  11. 2018Learning Rich Features for Image Manipulation Detectioncited by 154
  12. 2018Fighting Fake News: Image Splice Detection via Learned Self-Consistencycited by 136
  13. 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
  14. 2021M2TR: Multi-modal Multi-scale Transformers for Deepfake Detectioncited by 114
  15. 2021Local Relation Learning for Face Forgery Detectioncited by 100
  16. 2020SPAN: Spatial Pyramid Attention Network forImage Manipulation Localizationcited by 92
  17. 2020Semantic Image Manipulation Using Scene Graphscited by 82
  18. 2019Hybrid LSTM and Encoder-Decoder Architecture for Detection of Image Forgeriescited by 59
  19. 2021Efficient Video Transformers with Spatial-Temporal Token Selectioncited by 59
  20. 2021Visual Parser: Representing Part-whole Hierarchies with Transformerscited by 21

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 8; 2023: 19; 2024: 17; 2025: 21; 2026: 13.

78 papers.

Sort:

By area:

  1. 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
  2. 2022TruFor: Leveraging all-round clues for trustworthy image forgery detection and localizationcited by 130
  3. 2024OmniTokenizer: A Joint Image-Video Tokenizer for Visual Generationcited by 118
  4. 2023Explicit Visual Prompting for Low-Level Structure Segmentationscited by 114
  5. 2022Wave-ViT: Unifying Wavelet and Transformers for Visual Representation Learningcited by 78
  6. 2023AutoSplice: A Text-prompt Manipulated Image Dataset for Media Forensicscited by 46
  7. 2023IML-ViT: Benchmarking Image Manipulation Localization by Vision Transformercited by 44
  8. 2024IMDL-BenCo: A Comprehensive Benchmark and Codebase for Image Manipulation Detection & Localizationcited by 42
  9. 2022Look Before You Match: Instance Understanding Matters in Video Object Segmentationcited by 34
  10. 2023Pixel-Inconsistency Modeling for Image Manipulation Localizationcited by 33
  11. 2023Pre-training-free Image Manipulation Localization through Non-Mutually Exclusive Contrastive Learningcited by 23
  12. 2023Toward Real Text Manipulation Detection: New Dataset and New Solutioncited by 20
38 more
  1. 2024GIM: A Million-scale Benchmark for Generative Image Manipulation Detection and Localizationcited by 19
  2. 2023Explicit Visual Prompting for Universal Foreground Segmentationscited by 17
  3. 2024Language-guided Hierarchical Fine-grained Image Forgery Detection and Localizationcited by 16
  4. 2024Exploring Multi-view Pixel Contrast for General and Robust Image Forgery Localizationcited by 15
  5. 2024ForgeryGPT: A Multimodal LLM for Interpretable Image Forgery Detection and Localizationcited by 13
  6. 2023Multi-spectral Class Center Network for Face Manipulation Detection and Localizationcited by 11
  7. 2024ForgerySleuth: Empowering Multimodal Large Language Models for Image Manipulation Detectioncited by 11
  8. 2023TBFormer: Two-Branch Transformer for Image Forgery Localizationcited by 8
  9. 2024ForgeryTTT: Zero-Shot Image Manipulation Localization with Test-Time Trainingcited by 8
  10. 2025A Neurosymbolic Framework for Interpretable Cognitive Attack Detection in Augmented Realitycited by 8
  11. 2023Discrepancy-Guided Reconstruction Learning for Image Forgery Detectioncited by 7
  12. 2024Mixture-of-Noises Enhanced Forgery-Aware Predictor for Multi-Face Manipulation Detection and Localizationcited by 7
  13. 2024COMPrompter: reconceptualized segment anything model with multiprompt network for camouflaged object detectioncited by 6
  14. 2025ForensicsSAM: Toward Robust and Unified Image Forgery Detection and Localization Resisting to Adversarial Attackcited by 6
  15. 2022ReLoc: A Restoration-Assisted Framework for Robust Image Tampering Localizationcited by 5
  16. 2023SimpSON: Simplifying Photo Cleanup with Single-Click Distracting Object Segmentation Networkcited by 5
  17. 2023TrainFors: A Large Benchmark Training Dataset for Image Manipulation Detection and Localizationcited by 5
  18. 2023MMFusion: Combining Image Forensic Filters for Visual Manipulation Detection and Localizationcited by 5
  19. 2025StableGuard: Towards Unified Copyright Protection and Tamper Localization in Latent Diffusion Modelscited by 5
  20. 2023Progressive Feedback-Enhanced Transformer for Image Forgery Localizationcited by 4
  21. 2025Towards Reliable Identification of Diffusion-based Image Manipulationscited by 4
  22. 2025Code-in-the-Loop Forensics: Agentic Tool Use for Image Forgery Detectioncited by 4
  23. 2026DOCFORGE-BENCH: A Comprehensive 0-shot Benchmark for Document Forgery Detection and Analysiscited by 4
  24. 2022MONet: Multi-scale Overlap Network for Duplication Detection in Biomedical Imagescited by 3
  25. 2024Dense Feature Interaction Network for Image Inpainting Localizationcited by 3
  26. 2025SAMwave: Wavelet-Driven Feature Enrichment for Effective Adaptation of Segment Anything Modelcited by 3
  27. 2025Webly-Supervised Image Manipulation Localization via Category-Aware Auto-Annotationcited by 3
  28. 2025DEAL-300K: Diffusion-based Editing Area Localization with a 300K-Scale Dataset and Frequency-Prompted Baselinecited by 3
  29. 2026Can We Build a Monolithic Model for Fake Image Detection? SICA: Semantic-Induced Constrained Adaptation for Unified-Yet-Discriminative Artifact Feature Space Reconstructioncited by 3
  30. 2022Fighting Malicious Media Data: A Survey on Tampering Detection and Deepfake Detectioncited by 2
  31. 2024MALT: Multi-scale Action Learning Transformer for Online Action Detectioncited by 2
  32. 2025Context-Aware Weakly Supervised Image Manipulation Localization with SAM Refinementcited by 2
  33. 2026LocateEdit-Bench: A Benchmark for Instruction-Based Editing Localizationcited by 2
  34. 2023CMFDFormer: Transformer-based Copy-Move Forgery Detection with Continual Learningcited by 1
  35. 2024A Noise and Edge extraction-based dual-branch method for Shallowfake and Deepfake Localizationcited by 1
  36. 2024HRGR: Enhancing Image Manipulation Detection via Hierarchical Region-aware Graph Reasoningcited by 1
  37. 2024Image Forgery Localization via Guided Noise and Multi-Scale Feature Aggregationcited by 1
  38. 2025CapsFake: A Multimodal Capsule Network for Detecting Instruction-Guided Deepfakescited by 1

50 most cited of 78 All 78 (JSON)