mlsanityData to 14 Oct 2026

The Age of Synthetic Realities: Challenges and Opportunities

arXiv 2306.11503 ↗First posted 9 Jun 2023cs.CY cs.AI cs.LGcited by 15

Not on the map. Why?

Abstract (arXiv)

Synthetic realities are digital creations or augmentations that are contextually generated through the use of Artificial Intelligence (AI) methods, leveraging extensive amounts of data to construct new narratives or realities, regardless of the intent to deceive. In this paper, we delve into the concept of synthetic realities and their implications for Digital Forensics and society at large within the rapidly advancing field of AI. We highlight the crucial need for the development of forensic techniques capable of identifying harmful synthetic creations and distinguishing them from reality. This is especially important in scenarios involving the creation and dissemination of fake news, disinformation, and misinformation. Our focus extends to various forms of media, such as images, videos, audio, and text, as we examine how synthetic realities are crafted and explore approaches to detecting these malicious creations. Additionally, we shed light on the key research challenges that lie ahead in this area. This study is of paramount importance due to the rapid progress of AI generative techniques and their impact on the fundamental principles of Forensic Science.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 188 of its 301 references that are in the map. First posted on arXiv 9 Jun 2023.

Builds on

188 of 301 references.

References · 188

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  6. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  7. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  8. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  9. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  10. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  11. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  12. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
38 more
  1. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  2. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  3. 2017Neural Discrete Representation Learningcited by 4,712
  4. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  5. 2013Auto-Encoding Variational Bayescited by 4,053
  6. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  7. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  8. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
  9. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  10. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  11. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
  12. 2022Video Diffusion Modelscited by 2,305
  13. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
  14. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  15. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
  16. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
  17. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  18. 2016WaveNet: A Generative Model for Raw Audiocited by 1,722
  19. 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,476
  20. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  21. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  22. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
  23. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
  24. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
  25. 2022LaMDA: Language Models for Dialog Applicationscited by 1,220
  26. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,202
  27. 2021Alias-Free Generative Adversarial Networkscited by 1,184
  28. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  29. 2022Diffusion Models in Vision: A Surveycited by 1,015
  30. 2019An Introduction to Variational Autoencoderscited by 1,000
  31. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  32. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  33. 2023BloombergGPT: A Large Language Model for Financecited by 939
  34. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 897
  35. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
  36. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
  37. 2023A Watermark for Large Language Modelscited by 725
  38. 2023OpenAssistant Conversations -- Democratizing Large Language Model Alignmentcited by 721

50 most cited of 188 All 188 (JSON)

Built on by

Cited by year

Citing papers per year: 2023: 3; 2024: 11; 2025: 1.

15 papers.

Sort:

By area:

  1. 2023Raising the Bar of AI-generated Image Detection with CLIPcited by 164
  2. 2023A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directionscited by 105
  3. 2023Three Bricks to Consolidate Watermarks for Large Language Modelscited by 84
  4. 2024Detecting Multimedia Generated by Large AI Models: A Surveycited by 76
  5. 2024DetectRL: Benchmarking LLM-Generated Text Detection in Real-World Scenarioscited by 38
  6. 2024Exploring Self-Supervised Vision Transformers for Deepfake Detection: A Comparative Analysiscited by 15
  7. 2024Synthetic Image Verification in the Era of Generative AI: What Works and What Isn't There Yetcited by 13
  8. 2024A Survey of Defenses Against AI-Generated Visual Media: Detection,Disruption, and Authenticationcited by 13
  9. 2024Blessing or curse? A survey on the Impact of Generative AI on Fake Newscited by 12
  10. 2024Open-Set Deepfake Detection: A Parameter-Efficient Adaptation Method with Forgery Style Mixturecited by 7
  11. 2024Synthetic Photography Detection: A Visual Guidance for Identifying Synthetic Images Created by AIcited by 3
  12. 2024Localization of Synthetic Manipulations in Western Blot Imagescited by 2
3 more
  1. 2024Explainable Artifacts for Synthetic Western Blot Source Attributioncited by 1
  2. 2024Detect Fake with Fake: Leveraging Synthetic Data-driven Representation for Synthetic Image Detectioncited by 0
  3. 2025Spotting tell-tale visual artifacts in face swapping videos: strengths and pitfalls of CNN detectorscited by 0