AI Challenger : A Large-scale Dataset for Going Deeper in Image Understanding
Not on the map. Why?
Abstract (arXiv)
Significant progress has been achieved in Computer Vision by leveraging large-scale image datasets. However, large-scale datasets for complex Computer Vision tasks beyond classification are still limited. This paper proposed a large-scale dataset named AIC (AI Challenger) with three sub-datasets, human keypoint detection (HKD), large-scale attribute dataset (LAD) and image Chinese captioning (ICC). In this dataset, we annotate class labels (LAD), keypoint coordinate (HKD), bounding box (HKD and LAD), attribute (LAD) and caption (ICC). These rich annotations bridge the semantic gap between low-level images and high-level concepts. The proposed dataset is an effective benchmark to evaluate and improve different computational methods. In addition, for related tasks, others can also use our dataset as a new resource to pre-train their models.
Key facts. Cited by 73 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 Nov 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 10; 2023: 14; 2024: 15; 2025: 15; 2026: 8.
73 papers.
Sort:
By area:
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2023A Survey on Multimodal Large Language Modelscited by 909
- 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 456
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 350
- 2024MM-LLMs: Recent Advances in MultiModal Large Language Modelscited by 278
- 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 175
- 2023InstructDiffusion: A Generalist Modeling Interface for Vision Taskscited by 164
- 2023X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languagescited by 128
- 2022Wukong: A 100 Million Large-scale Chinese Cross-modal Pre-training Benchmarkcited by 114
- 2021Towards artificial general intelligence via a multimodal foundation modelcited by 112
- 2024TokenHMR: Advancing Human Mesh Recovery with a Tokenized Pose Representationcited by 95
- 2021WenLan: Bridging Vision and Language by Large-Scale Multi-Modal Pre-Trainingcited by 84
38 more
- 2025PromptHMR: Promptable Human Mesh Recoverycited by 76
- 2024A Survey of Multimodal Large Language Model from A Data-centric Perspectivecited by 75
- 2021Learning to Estimate Robust 3D Human Mesh from In-the-Wild Crowded Scenescited by 65
- 2022ViTPose++: Vision Transformer for Generic Body Pose Estimationcited by 65
- 2024CameraHMR: Aligning People with Perspectivecited by 65
- 2024Neural Localizer Fields for Continuous 3D Human Pose and Shape Estimationcited by 59
- 2021Recent Advances in Monocular 2D and 3D Human Pose Estimation: A Deep Learning Perspectivecited by 50
- 2021Mengzi: Towards Lightweight yet Ingenious Pre-trained Models for Chinesecited by 45
- 2021ERNIE-ViLG: Unified Generative Pre-training for Bidirectional Vision-Language Generationcited by 41
- 2021VoxelTrack: Multi-Person 3D Human Pose Estimation and Tracking in the Wildcited by 39
- 2022Pose for Everything: Towards Category-Agnostic Pose Estimationcited by 36
- 2023RTMO: Towards High-Performance One-Stage Real-Time Multi-Person Pose Estimationcited by 34
- 2023HAP: Structure-Aware Masked Image Modeling for Human-Centric Perceptioncited by 33
- 2022Benchmarking and Analyzing 3D Human Pose and Shape Estimation Beyond Algorithmscited by 28
- 2022One Model, Multiple Modalities: A Sparsely Activated Approach for Text, Sound, Image, Video and Codecited by 26
- 2024Animal Avatars: Reconstructing Animatable 3D Animals from Casual Videoscited by 26
- 2024Lumen: Unleashing Versatile Vision-Centric Capabilities of Large Multimodal Modelscited by 24
- 2024From Specific-MLLMs to Omni-MLLMs: A Survey on MLLMs Aligned with Multi-modalitiescited by 22
- 2025Reconstructing Humans with a Biomechanically Accurate Skeletoncited by 22
- 20222D Human Pose Estimation: A Surveycited by 21
- 2022CCMB: A Large-scale Chinese Cross-modal Benchmarkcited by 21
- 2023Cross2StrA: Unpaired Cross-lingual Image Captioning with Cross-lingual Cross-modal Structure-pivoted Alignmentcited by 15
- 2025FG-CLIP 2: A Bilingual Fine-grained Vision-Language Alignment Modelcited by 13
- 2023UniHuman: A Unified Model for Editing Human Images in the Wildcited by 12
- 2021EfficientCLIP: Efficient Cross-Modal Pre-training by Ensemble Confident Learning and Language Modelingcited by 10
- 2023You Only Learn One Query: Learning Unified Human Query for Single-Stage Multi-Person Multi-Task Human-Centric Perceptioncited by 9
- 2024CVLUE: A New Benchmark Dataset for Chinese Vision-Language Understanding Evaluationcited by 8
- 2024HERM: Benchmarking and Enhancing Multimodal LLMs for Human-Centric Understandingcited by 7
- 2025Megrez-Omni Technical Reportcited by 7
- 2024Referring Human Pose and Mask Estimation in the Wildcited by 6
- 2021Towards Zero-shot Cross-lingual Image Retrieval and Taggingcited by 4
- 2022Continual Knowledge Distillation for Neural Machine Translationcited by 4
- 2023Semi-Supervised Image Captioning by Adversarially Propagating Labeled Datacited by 4
- 2023Efficient Vision Transformer for Human Pose Estimation via Patch Selectioncited by 4
- 2024PoseBench: Benchmarking the Robustness of Pose Estimation Models under Corruptionscited by 4
- 2025MetricHMSR:Metric Human Mesh and Scene Recovery from Monocular Imagescited by 4
- 2025Towards Metric-Aware Multi-Person Mesh Recovery by Jointly Optimizing Human Crowd in Camera Spacecited by 3
- 2026PEAR: Pixel-aligned Expressive humAn mesh Recoverycited by 3
50 most cited of 73 All 73 (JSON)
- 2026MHE-Former: Multi-Hypothesis Transformers via Entropy Maximization for 3D Mesh Recovery9 Sep 2026
- 2026Again-Pose: Anchor-Guided Adaptive Inter-Frame Motion Cues Propagating for High-quality Human Pose Reconstruction28 Jun 2026
- 2026FTibSuite: A Comprehensive Resource Suite for Tibetan Vision-Language Modeling26 May 2026
- 2026Monocular Models are Strong Learners for Multi-View Human Mesh Recovery20 Mar 2026
- 2026CIGPose: Causal Intervention Graph Neural Network for Whole-Body Pose Estimation10 Mar 2026
- 2026PEAR: Pixel-aligned Expressive humAn mesh Recovery30 Jan 2026
- 2026BBoxMaskPose v2: Expanding Mutual Conditioning to 3D21 Jan 2026
- 2026SAM-pose2seg: Pose-Guided Human Instance Segmentation in Crowds13 Jan 2026
- 2025BLANKET: Anonymizing Faces in Infant Video Recordings17 Dec 2025
- 2025SKEL-CF: Coarse-to-Fine Biomechanical Skeleton and Surface Mesh Recovery25 Nov 2025
- 2025Towards Metric-Aware Multi-Person Mesh Recovery by Jointly Optimizing Human Crowd in Camera Space17 Nov 2025
- 2025FG-CLIP 2: A Bilingual Fine-grained Vision-Language Alignment Model13 Oct 2025
38 more
- 2025Empowering Multimodal LLMs with External Tools: A Comprehensive Survey14 Aug 2025
- 2025MetricHMSR:Metric Human Mesh and Scene Recovery from Monocular Images11 Jun 2025
- 2025PoseBH: Prototypical Multi-Dataset Training Beyond Human Pose Estimation23 May 2025
- 2025Adept: Annotation-Denoising Auxiliary Tasks with Discrete Cosine Transform Map and Keypoint for Human-Centric Pretraining29 Apr 2025
- 2025PromptHMR: Promptable Human Mesh Recovery8 Apr 2025
- 2025Reconstructing Humans with a Biomechanically Accurate Skeleton27 Mar 2025
- 2025PoseSyn: Synthesizing Diverse 3D Pose Data from In-the-Wild 2D Data17 Mar 2025
- 2025Scale-Aware Pre-Training for Human-Centric Visual Perception: Enabling Lightweight and Generalizable Models11 Mar 2025
- 2025Transformers with Joint Tokens and Local-Global Attention for Efficient Human Pose Estimation28 Feb 2025
- 2025Megrez-Omni Technical Report19 Feb 2025
- 2025BlanketGen2-Fit3D: Synthetic Blanket Augmentation Towards Improving Real-World In-Bed Blanket Occluded Human Pose Estimation21 Jan 2025
- 2024From Specific-MLLMs to Omni-MLLMs: A Survey on MLLMs Aligned with Multi-modalities16 Dec 2024
- 2024Detection, Pose Estimation and Segmentation for Multiple Bodies: Closing the Virtuous Circle2 Dec 2024
- 2024CameraHMR: Aligning People with Perspective12 Nov 2024
- 2024Referring Human Pose and Mask Estimation in the Wild27 Oct 2024
- 2024HERM: Benchmarking and Enhancing Multimodal LLMs for Human-Centric Understanding9 Oct 2024
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phone3 Aug 2024
- 2024Neural Localizer Fields for Continuous 3D Human Pose and Shape Estimation10 Jul 2024
- 2024CVLUE: A New Benchmark Dataset for Chinese Vision-Language Understanding Evaluation1 Jul 2024
- 2024PoseBench: Benchmarking the Robustness of Pose Estimation Models under Corruptions20 Jun 2024
- 2024Image captioning in different languages31 May 2024
- 2024A Survey of Multimodal Large Language Model from A Data-centric Perspective26 May 2024
- 2024TokenHMR: Advancing Human Mesh Recovery with a Tokenized Pose Representation25 Apr 2024
- 2024Animal Avatars: Reconstructing Animatable 3D Animals from Casual Videos25 Mar 2024
- 2024Lumen: Unleashing Versatile Vision-Centric Capabilities of Large Multimodal Models12 Mar 2024
- 2024MM-LLMs: Recent Advances in MultiModal Large Language Models24 Jan 2024
- 2023Active headrest combined with a depth camera-based ear-positioning system25 Dec 2023
- 2023UniHuman: A Unified Model for Editing Human Images in the Wild22 Dec 2023
- 2023RTMO: Towards High-Performance One-Stage Real-Time Multi-Person Pose Estimation12 Dec 2023
- 2023You Only Learn One Query: Learning Unified Human Query for Single-Stage Multi-Person Multi-Task Human-Centric Perception9 Dec 2023
- 2023HAP: Structure-Aware Masked Image Modeling for Human-Centric Perception31 Oct 2023
- 2023InstructDiffusion: A Generalist Modeling Interface for Vision Tasks7 Sep 2023
- 2023A Survey on Multimodal Large Language Models23 Jun 2023
- 2023Efficient Vision Transformer for Human Pose Estimation via Patch Selection7 Jun 2023
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformers31 May 2023
- 2023Cross2StrA: Unpaired Cross-lingual Image Captioning with Cross-lingual Cross-modal Structure-pivoted Alignment20 May 2023
- 2023X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages7 May 2023
- 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPose13 Mar 2023
50 newest of 73 All 73 (JSON)
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2023A Survey on Multimodal Large Language Modelscited by 909
- 2024MM-LLMs: Recent Advances in MultiModal Large Language Modelscited by 278
- 2022Wukong: A 100 Million Large-scale Chinese Cross-modal Pre-training Benchmarkcited by 114
- 2024A Survey of Multimodal Large Language Model from A Data-centric Perspectivecited by 75
- 2024Lumen: Unleashing Versatile Vision-Centric Capabilities of Large Multimodal Modelscited by 24
- 2022CCMB: A Large-scale Chinese Cross-modal Benchmarkcited by 21
- 2024CVLUE: A New Benchmark Dataset for Chinese Vision-Language Understanding Evaluationcited by 8
- 2024HERM: Benchmarking and Enhancing Multimodal LLMs for Human-Centric Understandingcited by 7
- 2025Empowering Multimodal LLMs with External Tools: A Comprehensive Surveycited by 2
- 2026FTibSuite: A Comprehensive Resource Suite for Tibetan Vision-Language Modelingcited by 2
- 2026FTibSuite: A Comprehensive Resource Suite for Tibetan Vision-Language Modeling26 May 2026
- 2025Empowering Multimodal LLMs with External Tools: A Comprehensive Survey14 Aug 2025
- 2024HERM: Benchmarking and Enhancing Multimodal LLMs for Human-Centric Understanding9 Oct 2024
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phone3 Aug 2024
- 2024CVLUE: A New Benchmark Dataset for Chinese Vision-Language Understanding Evaluation1 Jul 2024
- 2024A Survey of Multimodal Large Language Model from A Data-centric Perspective26 May 2024
- 2024Lumen: Unleashing Versatile Vision-Centric Capabilities of Large Multimodal Models12 Mar 2024
- 2024MM-LLMs: Recent Advances in MultiModal Large Language Models24 Jan 2024
- 2023A Survey on Multimodal Large Language Models23 Jun 2023
- 2022CCMB: A Large-scale Chinese Cross-modal Benchmark8 May 2022
- 2022Wukong: A 100 Million Large-scale Chinese Cross-modal Pre-training Benchmark14 Feb 2022
- 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 456
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 350
- 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 175
- 2023InstructDiffusion: A Generalist Modeling Interface for Vision Taskscited by 164
- 2021Towards artificial general intelligence via a multimodal foundation modelcited by 112
- 2024TokenHMR: Advancing Human Mesh Recovery with a Tokenized Pose Representationcited by 95
- 2021WenLan: Bridging Vision and Language by Large-Scale Multi-Modal Pre-Trainingcited by 84
- 2025PromptHMR: Promptable Human Mesh Recoverycited by 76
- 2021Learning to Estimate Robust 3D Human Mesh from In-the-Wild Crowded Scenescited by 65
- 2022ViTPose++: Vision Transformer for Generic Body Pose Estimationcited by 65
- 2024CameraHMR: Aligning People with Perspectivecited by 65
- 2024Neural Localizer Fields for Continuous 3D Human Pose and Shape Estimationcited by 59
12 most cited of 60 All 60 (JSON)
- 2026MHE-Former: Multi-Hypothesis Transformers via Entropy Maximization for 3D Mesh Recovery9 Sep 2026
- 2026Again-Pose: Anchor-Guided Adaptive Inter-Frame Motion Cues Propagating for High-quality Human Pose Reconstruction28 Jun 2026
- 2026Monocular Models are Strong Learners for Multi-View Human Mesh Recovery20 Mar 2026
- 2026CIGPose: Causal Intervention Graph Neural Network for Whole-Body Pose Estimation10 Mar 2026
- 2026PEAR: Pixel-aligned Expressive humAn mesh Recovery30 Jan 2026
- 2026BBoxMaskPose v2: Expanding Mutual Conditioning to 3D21 Jan 2026
- 2026SAM-pose2seg: Pose-Guided Human Instance Segmentation in Crowds13 Jan 2026
- 2025BLANKET: Anonymizing Faces in Infant Video Recordings17 Dec 2025
- 2025SKEL-CF: Coarse-to-Fine Biomechanical Skeleton and Surface Mesh Recovery25 Nov 2025
- 2025Towards Metric-Aware Multi-Person Mesh Recovery by Jointly Optimizing Human Crowd in Camera Space17 Nov 2025
- 2025FG-CLIP 2: A Bilingual Fine-grained Vision-Language Alignment Model13 Oct 2025
- 2025MetricHMSR:Metric Human Mesh and Scene Recovery from Monocular Images11 Jun 2025
12 newest of 60 All 60 (JSON)