Lighting (In)consistency of Paint by Text
Not on the map. Why?
Abstract (arXiv)
Whereas generative adversarial networks are capable of synthesizing highly realistic images of faces, cats, landscapes, or almost any other single category, paint-by-text synthesis engines can -- from a single text prompt -- synthesize realistic images of seemingly endless categories with arbitrary configurations and combinations. This powerful technology poses new challenges to the photo-forensic community. Motivated by the fact that paint by text is not based on explicit geometric or physical models, and the human visual system's general insensitivity to lighting inconsistencies, we provide an initial exploration of the lighting consistency of DALL-E-2 synthesized images to determine if physics-based forensic analyses will prove fruitful in detecting this new breed of synthetic media.
Key facts. Cited by 35 papers in the map (data through 14 Oct 2026). Builds on 6 of its 22 references that are in the map. First posted on arXiv 27 Jul 2022.
Builds on
6 of 22 references.
References · 6
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 695
- 2021Paint by Wordcited by 107
- 2022Perspective (In)consistency of Paint by Textcited by 34
Built on by
Citing papers per year: 2022: 2; 2023: 9; 2024: 10; 2025: 8; 2026: 6.
35 papers.
Sort:
By area:
- 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Modelscited by 304
- 2022On the detection of synthetic images generated by diffusion modelscited by 283
- 2023Raising the Bar of AI-generated Image Detection with CLIPcited by 164
- 2024AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Errorcited by 125
- 2023Intriguing properties of synthetic images: from generative adversarial networks to diffusion modelscited by 123
- 2022Towards the Detection of Diffusion Model Deepfakescited by 111
- 2024Any-Resolution AI-Generated Image Detection by Spectral Learningcited by 57
- 2024Zero-Shot Detection of AI-Generated Imagescited by 50
- 2024FakeBench: Probing Explainable Fake Image Detection via Large Multimodal Modelscited by 36
- 2024PhyBench: A Physical Commonsense Benchmark for Evaluating Text-to-Image Modelscited by 36
- 2023Deep Image Fingerprint: Towards Low Budget Synthetic Image Detection and Model Lineage Analysiscited by 30
- 2023Weakly-supervised deepfake localization in diffusion-generated imagescited by 24
23 more
- 2024Robust CLIP-Based Detector for Exposing Diffusion Model-Generated Imagescited by 20
- 2023Enhancing Diffusion Models with 3D Perspective Geometry Constraintscited by 16
- 2023The Age of Synthetic Realities: Challenges and Opportunitiescited by 15
- 2025Characterizing Photorealism and Artifacts in Diffusion Model-Generated Imagescited by 14
- 2024Synthetic Image Verification in the Era of Generative AI: What Works and What Isn't There Yetcited by 13
- 2025Survey on AI-Generated Media Detection: From Non-MLLM to MLLMcited by 12
- 2024A Survey on Responsible Generative AI: What to Generate and What Notcited by 8
- 2025NS-Net: Decoupling CLIP Semantic Information through NULL-Space for Generalizable AI-Generated Image Detectioncited by 8
- 2023Local Statistics for Generative Image Detectioncited by 5
- 2023Synthetic images aid the recognition of human-made art forgeriescited by 4
- 2024Trinity Detector:text-assisted and attention mechanisms based spectral fusion for diffusion generation image detectioncited by 4
- 2024Synthetic Photography Detection: A Visual Guidance for Identifying Synthetic Images Created by AIcited by 3
- 2026Diffusion Epistemic Uncertainty with Asymmetric Learning for Diffusion-Generated Image Detectioncited by 3
- 2025Where's the liability in the Generative Era? Recovery-based Black-Box Detection of AI-Generated Contentcited by 1
- 2025PRADA: Probability-Ratio-Based Attribution and Detection of Autoregressive-Generated Imagescited by 1
- 2025A parameter-efficient three-branch architecture for multimodal misinformation detection with limited annotationscited by 1
- 2026Fake3DGS: A Benchmark for 3D Manipulation Detection in Neural Renderingcited by 1
- 2026Shedding Light: A Benchmark for Evaluating Lighting Understanding in Generative Image Modelscited by 1
- 2025Robustness in AI-Generated Detection: Enhancing Resistance to Adversarial Attackscited by 0
- 2025AdaptPrompt: Parameter-Efficient Adaptation of VLMs for Generalizable Deepfake Detectioncited by 0
- 2026Unknown Aware AI-Generated Content Attributioncited by 0
- 2026Moir'e Video Authentication: A Physical Signature Against AI Video Generationcited by 0
- 2026Do Generative Priors Align with Human Naturalness Perception?cited by 0
- 2026Do Generative Priors Align with Human Naturalness Perception?7 Oct 2026
- 2026Shedding Light: A Benchmark for Evaluating Lighting Understanding in Generative Image Models9 Sep 2026
- 2026Fake3DGS: A Benchmark for 3D Manipulation Detection in Neural Rendering30 Apr 2026
- 2026Moir'e Video Authentication: A Physical Signature Against AI Video Generation2 Apr 2026
- 2026Diffusion Epistemic Uncertainty with Asymmetric Learning for Diffusion-Generated Image Detection21 Jan 2026
- 2026Unknown Aware AI-Generated Content Attribution1 Jan 2026
- 2025A parameter-efficient three-branch architecture for multimodal misinformation detection with limited annotations23 Dec 2025
- 2025AdaptPrompt: Parameter-Efficient Adaptation of VLMs for Generalizable Deepfake Detection19 Dec 2025
- 2025PRADA: Probability-Ratio-Based Attribution and Detection of Autoregressive-Generated Images25 Nov 2025
- 2025NS-Net: Decoupling CLIP Semantic Information through NULL-Space for Generalizable AI-Generated Image Detection2 Aug 2025
- 2025Robustness in AI-Generated Detection: Enhancing Resistance to Adversarial Attacks6 May 2025
- 2025Where's the liability in the Generative Era? Recovery-based Black-Box Detection of AI-Generated Content2 May 2025
23 more
- 2025Characterizing Photorealism and Artifacts in Diffusion Model-Generated Images17 Feb 2025
- 2025Survey on AI-Generated Media Detection: From Non-MLLM to MLLM7 Feb 2025
- 2024Any-Resolution AI-Generated Image Detection by Spectral Learning28 Nov 2024
- 2024Zero-Shot Detection of AI-Generated Images24 Sep 2024
- 2024Synthetic Photography Detection: A Visual Guidance for Identifying Synthetic Images Created by AI12 Aug 2024
- 2024PhyBench: A Physical Commonsense Benchmark for Evaluating Text-to-Image Models17 Jun 2024
- 2024Synthetic Image Verification in the Era of Generative AI: What Works and What Isn't There Yet30 Apr 2024
- 2024Trinity Detector:text-assisted and attention mechanisms based spectral fusion for diffusion generation image detection26 Apr 2024
- 2024FakeBench: Probing Explainable Fake Image Detection via Large Multimodal Models20 Apr 2024
- 2024Robust CLIP-Based Detector for Exposing Diffusion Model-Generated Images19 Apr 2024
- 2024A Survey on Responsible Generative AI: What to Generate and What Not8 Apr 2024
- 2024AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Error31 Jan 2024
- 2023Synthetic images aid the recognition of human-made art forgeries22 Dec 2023
- 2023Enhancing Diffusion Models with 3D Perspective Geometry Constraints1 Dec 2023
- 2023Raising the Bar of AI-generated Image Detection with CLIP30 Nov 2023
- 2023Weakly-supervised deepfake localization in diffusion-generated images8 Nov 2023
- 2023Local Statistics for Generative Image Detection25 Oct 2023
- 2023The Age of Synthetic Realities: Challenges and Opportunities9 Jun 2023
- 2023Intriguing properties of synthetic images: from generative adversarial networks to diffusion models13 Apr 2023
- 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Models27 Mar 2023
- 2023Deep Image Fingerprint: Towards Low Budget Synthetic Image Detection and Model Lineage Analysis19 Mar 2023
- 2022On the detection of synthetic images generated by diffusion models1 Nov 2022
- 2022Towards the Detection of Diffusion Model Deepfakes26 Oct 2022
- 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Modelscited by 304
- 2022On the detection of synthetic images generated by diffusion modelscited by 283
- 2024AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Errorcited by 125
- 2023Intriguing properties of synthetic images: from generative adversarial networks to diffusion modelscited by 123
- 2022Towards the Detection of Diffusion Model Deepfakescited by 111
- 2023Deep Image Fingerprint: Towards Low Budget Synthetic Image Detection and Model Lineage Analysiscited by 30
- 2023Weakly-supervised deepfake localization in diffusion-generated imagescited by 24
- 2024Robust CLIP-Based Detector for Exposing Diffusion Model-Generated Imagescited by 20
- 2023Enhancing Diffusion Models with 3D Perspective Geometry Constraintscited by 16
- 2025Characterizing Photorealism and Artifacts in Diffusion Model-Generated Imagescited by 14
- 2025NS-Net: Decoupling CLIP Semantic Information through NULL-Space for Generalizable AI-Generated Image Detectioncited by 8
- 2023Local Statistics for Generative Image Detectioncited by 5
12 most cited of 15 All 15 (JSON)
- 2026Diffusion Epistemic Uncertainty with Asymmetric Learning for Diffusion-Generated Image Detection21 Jan 2026
- 2025AdaptPrompt: Parameter-Efficient Adaptation of VLMs for Generalizable Deepfake Detection19 Dec 2025
- 2025NS-Net: Decoupling CLIP Semantic Information through NULL-Space for Generalizable AI-Generated Image Detection2 Aug 2025
- 2025Characterizing Photorealism and Artifacts in Diffusion Model-Generated Images17 Feb 2025
- 2024Trinity Detector:text-assisted and attention mechanisms based spectral fusion for diffusion generation image detection26 Apr 2024
- 2024Robust CLIP-Based Detector for Exposing Diffusion Model-Generated Images19 Apr 2024
- 2024AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Error31 Jan 2024
- 2023Enhancing Diffusion Models with 3D Perspective Geometry Constraints1 Dec 2023
- 2023Weakly-supervised deepfake localization in diffusion-generated images8 Nov 2023
- 2023Local Statistics for Generative Image Detection25 Oct 2023
- 2023Intriguing properties of synthetic images: from generative adversarial networks to diffusion models13 Apr 2023
- 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Models27 Mar 2023
12 newest of 15 All 15 (JSON)
- 2024Any-Resolution AI-Generated Image Detection by Spectral Learningcited by 57
- 2024Zero-Shot Detection of AI-Generated Imagescited by 50
- 2024PhyBench: A Physical Commonsense Benchmark for Evaluating Text-to-Image Modelscited by 36
- 2023The Age of Synthetic Realities: Challenges and Opportunitiescited by 15
- 2024Synthetic Image Verification in the Era of Generative AI: What Works and What Isn't There Yetcited by 13
- 2025Survey on AI-Generated Media Detection: From Non-MLLM to MLLMcited by 12
- 2024A Survey on Responsible Generative AI: What to Generate and What Notcited by 8
- 2023Synthetic images aid the recognition of human-made art forgeriescited by 4
- 2024Synthetic Photography Detection: A Visual Guidance for Identifying Synthetic Images Created by AIcited by 3
- 2025Where's the liability in the Generative Era? Recovery-based Black-Box Detection of AI-Generated Contentcited by 1
- 2025PRADA: Probability-Ratio-Based Attribution and Detection of Autoregressive-Generated Imagescited by 1
- 2025A parameter-efficient three-branch architecture for multimodal misinformation detection with limited annotationscited by 1
12 most cited of 18 All 18 (JSON)
- 2026Do Generative Priors Align with Human Naturalness Perception?7 Oct 2026
- 2026Shedding Light: A Benchmark for Evaluating Lighting Understanding in Generative Image Models9 Sep 2026
- 2026Fake3DGS: A Benchmark for 3D Manipulation Detection in Neural Rendering30 Apr 2026
- 2026Moir'e Video Authentication: A Physical Signature Against AI Video Generation2 Apr 2026
- 2026Unknown Aware AI-Generated Content Attribution1 Jan 2026
- 2025A parameter-efficient three-branch architecture for multimodal misinformation detection with limited annotations23 Dec 2025
- 2025PRADA: Probability-Ratio-Based Attribution and Detection of Autoregressive-Generated Images25 Nov 2025
- 2025Robustness in AI-Generated Detection: Enhancing Resistance to Adversarial Attacks6 May 2025
- 2025Where's the liability in the Generative Era? Recovery-based Black-Box Detection of AI-Generated Content2 May 2025
- 2025Survey on AI-Generated Media Detection: From Non-MLLM to MLLM7 Feb 2025
- 2024Any-Resolution AI-Generated Image Detection by Spectral Learning28 Nov 2024
- 2024Zero-Shot Detection of AI-Generated Images24 Sep 2024
12 newest of 18 All 18 (JSON)