NTIRE 2024 Quality Assessment of AI-Generated Content Challenge
Not on the map. Why?
Abstract (arXiv)
This paper reports on the NTIRE 2024 Quality Assessment of AI-Generated Content Challenge, which will be held in conjunction with the New Trends in Image Restoration and Enhancement Workshop (NTIRE) at CVPR 2024. This challenge is to address a major challenge in the field of image and video processing, namely, Image Quality Assessment (IQA) and Video Quality Assessment (VQA) for AI-Generated Content (AIGC). The challenge is divided into the image track and the video track. The image track uses the AIGIQA-20K, which contains 20,000 AI-Generated Images (AIGIs) generated by 15 popular generative models. The image track has a total of 318 registered participants. A total of 1,646 submissions are received in the development phase, and 221 submissions are received in the test phase. Finally, 16 participating teams submitted their models and fact sheets. The video track uses the T2VQA-DB, which contains 10,000 AI-Generated Videos (AIGVs) generated by 9 popular Text-to-Video (T2V) models. A total of 196 participants have registered in the video track. A total of 991 submissions are received in the development phase, and 185 submissions are received in the test phase. Finally, 12 participating teams submitted their models and fact sheets. Some methods have achieved better results than baseline methods, and the winning methods in both tracks have demonstrated superior prediction performance on AIGC.
Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Builds on 102 of its 126 references that are in the map. First posted on arXiv 25 Apr 2024.
Builds on
102 of 126 references.
References · 102
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
38 more
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2022A ConvNet for the 2020scited by 3,579
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2018SlowFast Networks for Video Recognitioncited by 1,867
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2016Neural Architecture Search with Reinforcement Learningcited by 1,499
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
- 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
- 2019VisualBERT: A Simple and Performant Baseline for Vision and Languagecited by 1,296
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,228
- 2017ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devicescited by 1,200
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
- 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
- 2021Video Swin Transformercited by 1,091
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
- 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 798
- 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 712
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
- 2023ModelScope Text-to-Video Technical Reportcited by 658
- 2023DataComp: In search of the next generation of multimodal datasetscited by 644
- 2023mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaborationcited by 547
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2019Res2Net: A New Multi-scale Backbone Architecturecited by 470
- 2017AVA: A Video Dataset of Spatio-temporally Localized Atomic Visual Actionscited by 449
- 2023Emergent Correspondence from Image Diffusioncited by 446
- 2020ResNeSt: Split-Attention Networkscited by 445
- 2023EVA-02: A Visual Representation for Neon Genesiscited by 381
- 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 379
- 2019KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessmentcited by 355
- 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
50 most cited of 102 All 102 (JSON)
Built on by
Citing papers per year: 2024: 10; 2025: 9; 2026: 1.
20 papers.
Sort:
By area:
- 2024Fr'echet Video Motion Distance: A Metric for Evaluating Motion Consistency in Videoscited by 58
- 2024Q-Bench-Video: Benchmarking the Video Quality Understanding of LMMscited by 39
- 2024Quality Assessment in the Era of Large Models: A Surveycited by 26
- 2024PPLLaVA: Varied Video Sequence Understanding With Prompt Guidancecited by 20
- 2025Image Quality Assessment: From Human to Machine Preferencecited by 12
- 2024AltGen: AI-Driven Alt Text Generation for Enhancing EPUB Accessibilitycited by 11
- 2024NTIRE 2024 Restore Any Image Model (RAIM) in the Wild Challengecited by 9
- 2025Flow4Agent: Long-form Video Understanding via Motion Prior from Optical Flowcited by 9
- 2024G-Refine: A General Quality Refiner for Text-to-Image Generationcited by 8
- 2024CMC-Bench: Towards a New Paradigm of Visual Signal Compressioncited by 6
- 2024NTIRE 2024 Challenge on Night Photography Renderingcited by 4
- 2025VF-Eval: Evaluating Multimodal LLMs for Generating Feedback on AIGC Videoscited by 4
8 more
- 2025Q-Save: Towards Scoring and Attribution for Generated Video Evaluationcited by 4
- 2025Multilevel Semantic-Aware Model for AI-Generated Video Quality Assessmentcited by 2
- 2025M3-AGIQA: Multimodal, Multi-Round, Multi-Aspect AI-Generated Image Quality Assessmentcited by 2
- 2025GeneVA: A Dataset of Human Annotations for Generative Text to Video Artifactscited by 2
- 2026RL-ScanIQA: Reinforcement-Learned Scanpaths for Blind 360degImage Quality Assessmentcited by 2
- 2025RAISE: Realness Assessment for Image Synthesis and Evaluationcited by 1
- 2025IE-Critic-R1: Advancing the Explanatory Measurement of Text-Driven Image Editing for Human Perception Alignmentcited by 1
- 2024NTIRE 2024 Challenge on Stereo Image Super-Resolution: Methods and Resultscited by 0
- 2026RL-ScanIQA: Reinforcement-Learned Scanpaths for Blind 360degImage Quality Assessment15 Mar 2026
- 2025Q-Save: Towards Scoring and Attribution for Generated Video Evaluation24 Nov 2025
- 2025IE-Critic-R1: Advancing the Explanatory Measurement of Text-Driven Image Editing for Human Perception Alignment22 Nov 2025
- 2025Flow4Agent: Long-form Video Understanding via Motion Prior from Optical Flow7 Oct 2025
- 2025GeneVA: A Dataset of Human Annotations for Generative Text to Video Artifacts10 Sep 2025
- 2025VF-Eval: Evaluating Multimodal LLMs for Generating Feedback on AIGC Videos29 May 2025
- 2025RAISE: Realness Assessment for Image Synthesis and Evaluation25 May 2025
- 2025Image Quality Assessment: From Human to Machine Preference13 Mar 2025
- 2025M3-AGIQA: Multimodal, Multi-Round, Multi-Aspect AI-Generated Image Quality Assessment21 Feb 2025
- 2025Multilevel Semantic-Aware Model for AI-Generated Video Quality Assessment6 Jan 2025
- 2024AltGen: AI-Driven Alt Text Generation for Enhancing EPUB Accessibility30 Dec 2024
- 2024PPLLaVA: Varied Video Sequence Understanding With Prompt Guidance4 Nov 2024
8 more
- 2024Q-Bench-Video: Benchmarking the Video Quality Understanding of LMMs30 Sep 2024
- 2024NTIRE 2024 Challenge on Stereo Image Super-Resolution: Methods and Results25 Sep 2024
- 2024Quality Assessment in the Era of Large Models: A Survey17 Aug 2024
- 2024Fr'echet Video Motion Distance: A Metric for Evaluating Motion Consistency in Videos23 Jul 2024
- 2024NTIRE 2024 Challenge on Night Photography Rendering18 Jun 2024
- 2024CMC-Bench: Towards a New Paradigm of Visual Signal Compression13 Jun 2024
- 2024NTIRE 2024 Restore Any Image Model (RAIM) in the Wild Challenge16 May 2024
- 2024G-Refine: A General Quality Refiner for Text-to-Image Generation29 Apr 2024
- 2024Fr'echet Video Motion Distance: A Metric for Evaluating Motion Consistency in Videoscited by 58
- 2024Quality Assessment in the Era of Large Models: A Surveycited by 26
- 2025Image Quality Assessment: From Human to Machine Preferencecited by 12
- 2024AltGen: AI-Driven Alt Text Generation for Enhancing EPUB Accessibilitycited by 11
- 2024NTIRE 2024 Restore Any Image Model (RAIM) in the Wild Challengecited by 9
- 2025Flow4Agent: Long-form Video Understanding via Motion Prior from Optical Flowcited by 9
- 2024G-Refine: A General Quality Refiner for Text-to-Image Generationcited by 8
- 2024CMC-Bench: Towards a New Paradigm of Visual Signal Compressioncited by 6
- 2024NTIRE 2024 Challenge on Night Photography Renderingcited by 4
- 2025Q-Save: Towards Scoring and Attribution for Generated Video Evaluationcited by 4
- 2025M3-AGIQA: Multimodal, Multi-Round, Multi-Aspect AI-Generated Image Quality Assessmentcited by 2
- 2025GeneVA: A Dataset of Human Annotations for Generative Text to Video Artifactscited by 2
12 most cited of 16 All 16 (JSON)
- 2026RL-ScanIQA: Reinforcement-Learned Scanpaths for Blind 360degImage Quality Assessment15 Mar 2026
- 2025Q-Save: Towards Scoring and Attribution for Generated Video Evaluation24 Nov 2025
- 2025IE-Critic-R1: Advancing the Explanatory Measurement of Text-Driven Image Editing for Human Perception Alignment22 Nov 2025
- 2025Flow4Agent: Long-form Video Understanding via Motion Prior from Optical Flow7 Oct 2025
- 2025GeneVA: A Dataset of Human Annotations for Generative Text to Video Artifacts10 Sep 2025
- 2025RAISE: Realness Assessment for Image Synthesis and Evaluation25 May 2025
- 2025Image Quality Assessment: From Human to Machine Preference13 Mar 2025
- 2025M3-AGIQA: Multimodal, Multi-Round, Multi-Aspect AI-Generated Image Quality Assessment21 Feb 2025
- 2024AltGen: AI-Driven Alt Text Generation for Enhancing EPUB Accessibility30 Dec 2024
- 2024NTIRE 2024 Challenge on Stereo Image Super-Resolution: Methods and Results25 Sep 2024
- 2024Quality Assessment in the Era of Large Models: A Survey17 Aug 2024
- 2024Fr'echet Video Motion Distance: A Metric for Evaluating Motion Consistency in Videos23 Jul 2024
12 newest of 16 All 16 (JSON)