PKU-I2IQA: An Image-to-Image Quality Assessment Database for AI Generated Images
Not on the map. Why?
Abstract (arXiv)
As image generation technology advances, AI-based image generation has been applied in various fields and Artificial Intelligence Generated Content (AIGC) has garnered widespread attention. However, the development of AI-based image generative models also brings new problems and challenges. A significant challenge is that AI-generated images (AIGI) may exhibit unique distortions compared to natural images, and not all generated images meet the requirements of the real world. Therefore, it is of great significance to evaluate AIGIs more comprehensively. Although previous work has established several human perception-based AIGC image quality assessment (AIGCIQA) databases for text-generated images, the AI image generation technology includes scenarios like text-to-image and image-to-image, and assessing only the images generated by text-to-image models is insufficient. To address this issue, we establish a human perception-based image-to-image AIGCIQA database, named PKU-I2IQA. We conduct a well-organized subjective experiment to collect quality labels for AIGIs and then conduct a comprehensive analysis of the PKU-I2IQA database. Furthermore, we have proposed two benchmark models: NR-AIGCIQA based on the no-reference image quality assessment method and FR-AIGCIQA based on the full-reference image quality assessment method. Finally, leveraging this database, we conduct benchmark experiments and compare the performance of the proposed benchmark models. The PKU-I2IQA database and benchmarks will be released to facilitate future research on urlhttps://github.com/jiquan123/I2IQA.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 33 of its 47 references that are in the map. First posted on arXiv 27 Nov 2023.
Builds on
33 of 47 references.
References · 33
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2014Going Deeper with Convolutionscited by 4,241
- 2013Auto-Encoding Variational Bayescited by 4,053
21 more
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2017Improved Training of Wasserstein GANscited by 2,235
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,512
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
- 2023Aligning Text-to-Image Models using Human Feedbackcited by 422
- 2016Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessmentcited by 225
- 2023One Transformer Fits All Distributions in Multi-Modal Diffusion at Scalecited by 187
- 2017RankIQA: Learning from Rankings for No-reference Image Quality Assessmentcited by 151
- 2020MetaIQA: Deep Meta-learning for No-Reference Image Quality Assessmentcited by 144
- 2023AGIQA-3K: An Open Database for AI-Generated Image Quality Assessmentcited by 142
- 2021LAFITE: Towards Language-Free Training for Text-to-Image Generationcited by 128
- 2016Perceptual Quality Prediction on Authentically Distorted Images Using a Bag of Features Approachcited by 71
- 2023Toward Verifiable and Reproducible Human Evaluation for Text-to-Image Generationcited by 68
- 2023AIGCIQA2023: A Large-scale Image Quality Assessment Database for AI Generated Images: from the Perspectives of Quality, Authenticity and Correspondencecited by 61
- 2022Attentions Help CNNs See Better: Attention-based Hybrid Image Quality Assessment Networkcited by 57
- 2023A Perceptual Quality Assessment Exploration for AIGC Imagescited by 55
- 2022Perceptual Quality Assessment of Omnidirectional Imagescited by 34
- 2022Confusing Image Quality Assessment: Towards Better Augmented Reality Experiencecited by 32
- 2020Full Reference Screen Content Image Quality Assessment by Fusing Multi-level Structure Similaritycited by 5
Built on by
Citing papers per year: 2023: 1; 2024: 8; 2025: 3; 2026: 2.
14 papers.
Sort:
By area:
- 2024FakeBench: Probing Explainable Fake Image Detection via Large Multimodal Modelscited by 36
- 2024NTIRE 2024 Quality Assessment of AI-Generated Content Challengecited by 20
- 2024CLIP-AGIQA: Boosting the Performance of AI-Generated Image Quality Assessment with CLIPcited by 14
- 2023PSCR: Patches Sampling-based Contrastive Regression for AIGC Image Quality Assessmentcited by 10
- 2024Adaptive Mixed-Scale Feature Fusion Network for Blind AI-Generated Image Quality Assessmentcited by 10
- 2024QPT V2: Masked Image Modeling Advances Visual Scoringcited by 8
- 2024TIER: Text-Image Encoder-based Regression for AIGC Image Quality Assessmentcited by 7
- 2025Perceptual Visual Quality Assessment: Principles, Methods, and Future Directionscited by 5
- 2025M3-AGIQA: Multimodal, Multi-Round, Multi-Aspect AI-Generated Image Quality Assessmentcited by 2
- 2024D-Judge: How Far Are We? Assessing the Discrepancies Between AI-synthesized and Natural Images through Multimodal Guidancecited by 1
- 2026HyperAlign: Hyperbolic Entailment Cones for Adaptive Text-to-Image Alignment Assessmentcited by 1
- 2024PKU-AIGIQA-4K: A Perceptual Quality Assessment Database for Both Text-to-Image and Image-to-Image AI-Generated Imagescited by 0
- 2026Patch Knowledge Transfer for Efficient AI-Generated Image Quality Assessment6 Jul 2026
- 2026HyperAlign: Hyperbolic Entailment Cones for Adaptive Text-to-Image Alignment Assessment8 Jan 2026
- 2025DREAM: A Benchmark Study for Deepfake photoREalism AssessMent11 Oct 2025
- 2025Perceptual Visual Quality Assessment: Principles, Methods, and Future Directions1 Mar 2025
- 2025M3-AGIQA: Multimodal, Multi-Round, Multi-Aspect AI-Generated Image Quality Assessment21 Feb 2025
- 2024D-Judge: How Far Are We? Assessing the Discrepancies Between AI-synthesized and Natural Images through Multimodal Guidance23 Dec 2024
- 2024CLIP-AGIQA: Boosting the Performance of AI-Generated Image Quality Assessment with CLIP27 Aug 2024
- 2024QPT V2: Masked Image Modeling Advances Visual Scoring23 Jul 2024
- 2024PKU-AIGIQA-4K: A Perceptual Quality Assessment Database for Both Text-to-Image and Image-to-Image AI-Generated Images29 Apr 2024
- 2024NTIRE 2024 Quality Assessment of AI-Generated Content Challenge25 Apr 2024
- 2024Adaptive Mixed-Scale Feature Fusion Network for Blind AI-Generated Image Quality Assessment23 Apr 2024
- 2024FakeBench: Probing Explainable Fake Image Detection via Large Multimodal Models20 Apr 2024
- 2024NTIRE 2024 Quality Assessment of AI-Generated Content Challengecited by 20
- 2024CLIP-AGIQA: Boosting the Performance of AI-Generated Image Quality Assessment with CLIPcited by 14
- 2023PSCR: Patches Sampling-based Contrastive Regression for AIGC Image Quality Assessmentcited by 10
- 2024Adaptive Mixed-Scale Feature Fusion Network for Blind AI-Generated Image Quality Assessmentcited by 10
- 2024QPT V2: Masked Image Modeling Advances Visual Scoringcited by 8
- 2024TIER: Text-Image Encoder-based Regression for AIGC Image Quality Assessmentcited by 7
- 2025Perceptual Visual Quality Assessment: Principles, Methods, and Future Directionscited by 5
- 2025M3-AGIQA: Multimodal, Multi-Round, Multi-Aspect AI-Generated Image Quality Assessmentcited by 2
- 2024D-Judge: How Far Are We? Assessing the Discrepancies Between AI-synthesized and Natural Images through Multimodal Guidancecited by 1
- 2026HyperAlign: Hyperbolic Entailment Cones for Adaptive Text-to-Image Alignment Assessmentcited by 1
- 2024PKU-AIGIQA-4K: A Perceptual Quality Assessment Database for Both Text-to-Image and Image-to-Image AI-Generated Imagescited by 0
- 2025DREAM: A Benchmark Study for Deepfake photoREalism AssessMentcited by 0
12 most cited of 13 All 13 (JSON)
- 2026Patch Knowledge Transfer for Efficient AI-Generated Image Quality Assessment6 Jul 2026
- 2026HyperAlign: Hyperbolic Entailment Cones for Adaptive Text-to-Image Alignment Assessment8 Jan 2026
- 2025DREAM: A Benchmark Study for Deepfake photoREalism AssessMent11 Oct 2025
- 2025Perceptual Visual Quality Assessment: Principles, Methods, and Future Directions1 Mar 2025
- 2025M3-AGIQA: Multimodal, Multi-Round, Multi-Aspect AI-Generated Image Quality Assessment21 Feb 2025
- 2024D-Judge: How Far Are We? Assessing the Discrepancies Between AI-synthesized and Natural Images through Multimodal Guidance23 Dec 2024
- 2024CLIP-AGIQA: Boosting the Performance of AI-Generated Image Quality Assessment with CLIP27 Aug 2024
- 2024QPT V2: Masked Image Modeling Advances Visual Scoring23 Jul 2024
- 2024PKU-AIGIQA-4K: A Perceptual Quality Assessment Database for Both Text-to-Image and Image-to-Image AI-Generated Images29 Apr 2024
- 2024NTIRE 2024 Quality Assessment of AI-Generated Content Challenge25 Apr 2024
- 2024Adaptive Mixed-Scale Feature Fusion Network for Blind AI-Generated Image Quality Assessment23 Apr 2024
- 2024TIER: Text-Image Encoder-based Regression for AIGC Image Quality Assessment8 Jan 2024
12 newest of 13 All 13 (JSON)