mlsanityData to 7 Oct 2026

M^3:Manipulation Mask Manufacturer for Arbitrary-Scale Super-Resolution Mask

arXiv 2407.03695 ↗First posted 4 Jul 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

In the field of image manipulation localization (IML), the small quantity and poor quality of existing datasets have always been major issues. A dataset containing various types of manipulations will greatly help improve the accuracy of IML models. Images on the internet (such as those on Baidu Tieba's PS Bar) are manipulated using various techniques, and creating a dataset from these images will significantly enrich the types of manipulations in our data. However, images on the internet suffer from resolution and clarity issues, and the masks obtained by simply subtracting the manipulated image from the original contain various noises. These noises are difficult to remove, rendering the masks unusable for IML models. Inspired by the field of change detection, we treat the original and manipulated images as changes over time for the same image and view the data generation task as a change detection task. However, due to clarity issues between images, conventional change detection models perform poorly. Therefore, we introduced a super-resolution module and proposed the Manipulation Mask Manufacturer (MMM) framework. It enhances the resolution of both the original and tampered images, thereby improving image details for better comparison. Simultaneously, the framework converts the original and tampered images into feature embeddings and concatenates them, effectively modeling the context. Additionally, we created the Manipulation Mask Manufacturer Dataset (MMMD), a dataset that covers a wide range of manipulation techniques. We aim to contribute to the fields of image forensics and manipulation detection by providing more realistic manipulation data through MMM and MMMD. Detailed information about MMMD and the download link can be found at: the code and datasets will be made available.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 54 references that are in the map. First posted on arXiv 4 Jul 2024.

Builds on

19 of 54 references.

References · 19

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
  3. 2015Learning Transferable Features with Deep Adaptation Networkscited by 1,323
  4. 2021Remote Sensing Image Change Detection with Transformerscited by 305
  5. 2020The Creation and Detection of Deepfakes: A Surveycited by 246
  6. 2022A Transformer-Based Siamese Network for Change Detectioncited by 243
  7. 2017Neural Style Transfer: A Reviewcited by 199
  8. 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
  9. 2022TruFor: Leveraging all-round clues for trustworthy image forgery detection and localizationcited by 130
  10. 2021MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detectioncited by 117
  11. 2020SPAN: Spatial Pyramid Attention Network forImage Manipulation Localizationcited by 92
  12. 2019Image inpainting: A reviewcited by 89
7 more
  1. 2021Learning JPEG Compression Artifacts for Image Manipulation Detection and Localizationcited by 78
  2. 2022ObjectFormer for Image Manipulation Detection and Localizationcited by 78
  3. 2023Cascaded Local Implicit Transformer for Arbitrary-Scale Super-Resolutioncited by 51
  4. 2024IMDL-BenCo: A Comprehensive Benchmark and Codebase for Image Manipulation Detection & Localizationcited by 42
  5. 2021TransForensics: Image Forgery Localization with Dense Self-Attentioncited by 26
  6. 2023Pre-training-free Image Manipulation Localization through Non-Mutually Exclusive Contrastive Learningcited by 23
  7. 2023Manipulation Mask Generator: High-Quality Image Manipulation Mask Generation Method Based on Modified Total Variation Noise Reductioncited by 1

Built on by

Not cited yet.