mlsanityData to 7 Oct 2026

Is JPEG AI going to change image forensics?

arXiv 2412.03261 ↗First posted 4 Dec 2024eess.IV cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

In this paper, we investigate the counter-forensic effects of the new JPEG AI standard based on neural image compression, focusing on two critical areas: deepfake image detection and image splicing localization. Neural image compression leverages advanced neural network algorithms to achieve higher compression rates while maintaining image quality. However, it introduces artifacts that closely resemble those generated by image synthesis techniques and image splicing pipelines, complicating the work of researchers when discriminating pristine from manipulated content. We comprehensively analyze JPEG AI's counter-forensic effects through extensive experiments on several state-of-the-art detectors and datasets. Our results demonstrate a reduction in the performance of leading forensic detectors when analyzing content processed through JPEG AI. By exposing the vulnerabilities of the available forensic tools, we aim to raise the urgent need for multimedia forensics researchers to include JPEG AI images in their experimental setups and develop robust forensic techniques to distinguish between neural compression artifacts and actual manipulations.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 49 of its 93 references that are in the map. First posted on arXiv 4 Dec 2024.

Builds on

49 of 93 references.

References · 49

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  7. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  8. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  9. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  10. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  11. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  12. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
37 more
  1. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  2. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  3. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
  4. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
  5. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
  6. 2018Variational image compression with a scale hyperpriorcited by 910
  7. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
  8. 2016End-to-end Optimized Image Compressioncited by 673
  9. 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 642
  10. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 483
  11. 2020High-Fidelity Generative Image Compressioncited by 331
  12. 2017Lossy Image Compression with Compressive Autoencoderscited by 289
  13. 2022On the detection of synthetic images generated by diffusion modelscited by 282
  14. 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 278
  15. 2020Channel-wise Autoregressive Entropy Models for Learned Image Compressioncited by 255
  16. 2020Media Forensics and DeepFakes: an overviewcited by 208
  17. 2016Full Resolution Image Compression with Recurrent Neural Networkscited by 170
  18. 2022Lossy Image Compression with Conditional Diffusion Modelscited by 165
  19. 2023Raising the Bar of AI-generated Image Detection with CLIPcited by 163
  20. 2021Are GAN generated images easy to detect? A critical analysis of the state-of-the-artcited by 139
  21. 2022TruFor: Leveraging all-round clues for trustworthy image forgery detection and localizationcited by 130
  22. 2023Intriguing properties of synthetic images: from generative adversarial networks to diffusion modelscited by 121
  23. 2019Variable Rate Deep Image Compression With a Conditional Autoencodercited by 109
  24. 2020Evading Deepfake-Image Detectors with White- and Black-Box Attackscited by 80
  25. 2020Adversarial Deepfakes: Evaluating Vulnerability of Deepfake Detectors to Adversarial Examplescited by 66
  26. 2023High-Fidelity Image Compression with Score-based Generative Modelscited by 53
  27. 2022Deepfake Detection: A Comprehensive Survey from the Reliability Perspectivecited by 48
  28. 2022Unified Multivariate Gaussian Mixture for Efficient Neural Image Compressioncited by 43
  29. 2021Slimmable Compressive Autoencoders for Practical Neural Image Compressioncited by 38
  30. 2017Aligned and Non-Aligned Double JPEG Detection Using Convolutional Neural Networkscited by 22
  31. 2020Training CNNs in Presence of JPEG Compression: Multimedia Forensics vs Computer Visioncited by 17
  32. 2020Training Strategies and Data Augmentations in CNN-based DeepFake Video Detectioncited by 17
  33. 2023Avatar Fingerprinting for Authorized Use of Synthetic Talking-Head Videoscited by 11
  34. 2024Exploring the Adversarial Robustness of CLIP for AI-generated Image Detectioncited by 11
  35. 2024When Synthetic Traces Hide Real Content: Analysis of Stable Diffusion Image Launderingcited by 7
  36. 2023Neural Image Compression: Generalization, Robustness, and Spectral Biasescited by 4
  37. 2024A Taxonomy of Miscompressions: Preparing Image Forensics for Neural Compressioncited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 1.

4 papers.