YFCC100M: The New Data in Multimedia Research
Not on the map. Why?
Abstract (arXiv)
We present the Yahoo Flickr Creative Commons 100 Million Dataset (YFCC100M), the largest public multimedia collection that has ever been released. The dataset contains a total of 100 million media objects, of which approximately 99.2 million are photos and 0.8 million are videos, all of which carry a Creative Commons license. Each media object in the dataset is represented by several pieces of metadata, e.g. Flickr identifier, owner name, camera, title, tags, geo, media source. The collection provides a comprehensive snapshot of how photos and videos were taken, described, and shared over the years, from the inception of Flickr in 2004 until early 2014. In this article we explain the rationale behind its creation, as well as the implications the dataset has for science, research, engineering, and development. We further present several new challenges in multimedia research that can now be expanded upon with our dataset.
Key facts. Cited by 234 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Mar 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 51; 2022: 65; 2023: 62; 2024: 27; 2025: 23; 2026: 6.
234 papers.
Sort:
By area:
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2022Reproducible scaling laws for contrastive language-image learningcited by 1,163
- 2021NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actionscited by 735
- 2023DataComp: In search of the next generation of multimodal datasetscited by 635
- 2021LiT: Zero-Shot Transfer with Locked-image text Tuningcited by 572
- 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 479
- 2023Poisoning Web-Scale Training Datasets is Practicalcited by 276
- 2023Multimodal C4: An Open, Billion-scale Corpus of Images Interleaved with Textcited by 208
- 2022Unified Contrastive Learning in Image-Text-Label Spacecited by 194
- 2022MaskCLIP: Masked Self-Distillation Advances Contrastive Language-Image Pretrainingcited by 187
38 more
- 2023Cut and Learn for Unsupervised Object Detection and Instance Segmentationcited by 186
- 2022CREPE: Can Vision-Language Foundation Models Reason Compositionally?cited by 177
- 2022A Self-Supervised Descriptor for Image Copy Detectioncited by 175
- 2023Unsafe Diffusion: On the Generation of Unsafe Images and Hateful Memes From Text-To-Image Modelscited by 171
- 2023Large-scale Multi-Modal Pre-trained Models: A Comprehensive Surveycited by 153
- 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensingcited by 150
- 2023SatCLIP: Global, General-Purpose Location Embeddings with Satellite Imagerycited by 148
- 2022Learning 3D Representations from 2D Pre-trained Models via Image-to-Point Masked Autoencoderscited by 143
- 2022ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Modelscited by 141
- 2022Task Residual for Tuning Vision-Language Modelscited by 122
- 2022Open Vocabulary Semantic Segmentation with Patch Aligned Contrastive Learningcited by 115
- 2021Learning Accurate Dense Correspondences and When to Trust Themcited by 113
- 2022Multimodal Masked Autoencoders Learn Transferable Representationscited by 107
- 2023A Picture is Worth More Than 77 Text Tokens: Evaluating CLIP-Style Models on Dense Captionscited by 107
- 2022A Prompt Array Keeps the Bias Away: Debiasing Vision-Language Models with Adversarial Learningcited by 104
- 2022PyramidCLIP: Hierarchical Feature Alignment for Vision-language Model Pretrainingcited by 104
- 2023Re-IQA: Unsupervised Learning for Image Quality Assessment in the Wildcited by 97
- 2023SED: A Simple Encoder-Decoder for Open-Vocabulary Semantic Segmentationcited by 95
- 2021Medical Visual Question Answering: A Surveycited by 93
- 2021When Does Contrastive Visual Representation Learning Work?cited by 92
- 2021Learning to Match Features with Seeded Graph Matching Networkcited by 92
- 2021Divide and Contrast: Self-supervised Learning from Uncurated Datacited by 85
- 2022Vision Models Are More Robust And Fair When Pretrained On Uncurated Images Without Supervisioncited by 80
- 2022A Survey on Long-Tailed Visual Recognitioncited by 75
- 2023A Pilot Study of Query-Free Adversarial Attack against Stable Diffusioncited by 75
- 2024Multimodal Alignment and Fusion: A Surveycited by 73
- 2022Open-world Semantic Segmentation via Contrasting and Clustering Vision-Language Embeddingcited by 67
- 2022BURST: A Benchmark for Unifying Object Recognition, Segmentation and Tracking in Videocited by 66
- 2021Few-Shot Bot: Prompt-Based Learning for Dialogue Systemscited by 64
- 2023Learning Customized Visual Models with Retrieval-Augmented Knowledgecited by 58
- 2023SoftCLIP: Softer Cross-modal Alignment Makes CLIP Strongercited by 56
- 2022Robust Cross-Modal Representation Learning with Progressive Self-Distillationcited by 55
- 2023Where We Are and What We're Looking At: Query Based Worldwide Image Geo-localization Using Hierarchies and Scenescited by 55
- 2023ControlRoom3D: Room Generation using Semantic Proxy Roomscited by 54
- 2022CLIPPO: Image-and-Language Understanding from Pixels Onlycited by 53
- 2022DeepPrivacy2: Towards Realistic Full-Body Anonymizationcited by 51
- 2021Co-learning: Learning from Noisy Labels with Self-supervisioncited by 50
- 2021Progressive Correspondence Pruning by Consensus Learningcited by 46
50 most cited of 234 All 234 (JSON)
- 2026Multi-Modal Contrastive Learning for Implicit Earth Embeddings via Location Tying18 Jun 2026
- 2026What Are We Really Measuring? Rethinking Dataset Bias in Web-Scale Natural Image Collections via Unsupervised Semantic Clustering15 Apr 2026
- 2026M3D-Stereo: A Multiple-Medium and Multiple-Degradation Dataset for Stereo Image Restoration14 Apr 2026
- 2026An In-Depth Study of Filter-Agnostic Vector Search on a PostgreSQL Database System: [Experiments and Analysis]24 Mar 2026
- 2026MoXaRt: Audio-Visual Object-Guided Sound Interaction for XR11 Mar 2026
- 2026A Practical Guide to Streaming Continual Learning2 Mar 2026
- 2025LLHA-Net: A Hierarchical Attention Network for Two-View Correspondence Learning31 Dec 2025
- 2025Towards Generative Location Awareness for Disaster Response: A Probabilistic Cross-view Geolocalization Approach23 Dec 2025
- 2025Patch-wise Retrieval: A Bag of Practical Techniques for Instance-level Matching14 Dec 2025
- 2025Exqutor: Extended Query Optimizer for Vector-augmented Analytical Queries10 Dec 2025
- 2025LeCoT: revisiting network architecture for two-view correspondence pruning10 Nov 2025
- 2025GeoToken: Hierarchical Geolocalization of Images via Next Token Prediction2 Nov 2025
38 more
- 2025Generative AI in Depth: A Survey of Recent Advances, Model Variants, and Real-World Applications23 Oct 2025
- 2025Trade-offs in Cross-Domain Generalization of Foundation Model Fine-Tuned for Biometric Applications18 Sep 2025
- 2025Unsupervised Instance Segmentation with Superpixels3 Sep 2025
- 2025Object Recognition Datasets and Challenges: A Review30 Jul 2025
- 2025Point of Interest Recommendation: Pitfalls and Viable Solutions18 Jul 2025
- 2025OpenEvents V1: Large-Scale Benchmark Dataset for Multimodal Event Grounding23 Jun 2025
- 2025Vocabulary-free few-shot learning for Vision-Language Models4 Jun 2025
- 2025Argus Inspection: Do Multimodal Large Language Models Possess the Eye of Panoptes?3 Jun 2025
- 2025What You Perceive Is What You Conceive: A Cognition-Inspired Framework for Open Vocabulary Image Segmentation26 May 2025
- 2025TAGS: 3D Tumor-Adaptive Guidance for SAM21 May 2025
- 2025UFM: Unified Feature Matching Pre-training with Multi-Modal Image Assistants26 Mar 2025
- 2025Seeing What Matters: Empowering CLIP with Patch Generation-to-Selection21 Mar 2025
- 2025KVQ: Boosting Video Quality Assessment via Saliency-guided Local Perception13 Mar 2025
- 2025RealSyn: An Effective and Scalable Multimodal Interleaved Document Transformation Paradigm18 Feb 2025
- 2025ILIAS: Instance-Level Image retrieval At Scale17 Feb 2025
- 2025Noise-Tolerant Hybrid Prototypical Learning with Noisy Web Data5 Jan 2025
- 2025DreamMask: Boosting Open-vocabulary Panoptic Segmentation with Synthetic Data3 Jan 2025
- 2024Frequency Is What You Need: Considering Word Frequency When Text Masking Benefits Vision-Language Model Pre-training20 Dec 2024
- 2024Bringing Multimodality to Amazon Visual Search System17 Dec 2024
- 2024FiVA: Fine-grained Visual Attribute Dataset for Text-to-Image Diffusion Models10 Dec 2024
- 2024MVImgNet2.0: A Larger-scale Dataset of Multi-view Images2 Dec 2024
- 2024Multimodal Alignment and Fusion: A Survey26 Nov 2024
- 2024ImageRAG: Enhancing Ultra High Resolution Remote Sensing Imagery Analysis with ImageRAG12 Nov 2024
- 2024FEED: Fairness-Enhanced Meta-Learning for Domain Generalization2 Nov 2024
- 2024Enhancing Vision-Language Model Pre-training with Image-text Pair Pruning Based on Word Frequency9 Oct 2024
- 2024Securing Vision-Language Models with a Robust Encoder Against Jailbreak and Adversarial Attacks11 Sep 2024
- 2024RSTeller: Scaling Up Visual Language Modeling in Remote Sensing with Rich Linguistic Semantics from Openly Available Data and Large Language Models27 Aug 2024
- 2024Quality Assessment in the Era of Large Models: A Survey17 Aug 2024
- 2024PSM: Learning Probabilistic Embeddings for Multi-scale Zero-Shot Soundscape Mapping13 Aug 2024
- 2024A Comprehensive Review of Few-shot Action Recognition20 Jul 2024
- 2024Enhancing Worldwide Image Geolocation by Ensembling Satellite-Based Ground-Level Attribute Predictors18 Jul 2024
- 2024Disturbing Image Detection Using LMM-Elicited Emotion Embeddings18 Jun 2024
- 2024Relational Self-supervised Distillation with Compact Descriptors for Image Copy Detection28 May 2024
- 2024FFF: Fixing Flawed Foundations in contrastive pre-training results in very strong Vision-Language models16 May 2024
- 2024How Good is my Video LMM? Complex Video Reasoning and Robustness Evaluation Suite for Video-LMMs6 May 2024
- 2024OpenStreetView-5M: The Many Roads to Global Visual Geolocation29 Apr 2024
- 2024Improving Interpretable Embeddings for Ad-hoc Video Search with Generative Captions and Multi-word Concept Bank9 Apr 2024
- 2024Zero-shot Prompt-based Video Encoder for Surgical Gesture Recognition28 Mar 2024
50 newest of 234 All 234 (JSON)
- 2022CREPE: Can Vision-Language Foundation Models Reason Compositionally?cited by 177
- 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensingcited by 150
- 2022Task Residual for Tuning Vision-Language Modelscited by 122
- 2022A Prompt Array Keeps the Bias Away: Debiasing Vision-Language Models with Adversarial Learningcited by 104
- 2022PyramidCLIP: Hierarchical Feature Alignment for Vision-language Model Pretrainingcited by 104
- 2023SoftCLIP: Softer Cross-modal Alignment Makes CLIP Strongercited by 56
- 2025ILIAS: Instance-Level Image retrieval At Scalecited by 29
- 2022CCMB: A Large-scale Chinese Cross-modal Benchmarkcited by 21
- 2024Securing Vision-Language Models with a Robust Encoder Against Jailbreak and Adversarial Attackscited by 13
- 2024FFF: Fixing Flawed Foundations in contrastive pre-training results in very strong Vision-Language modelscited by 7
- 2024RSTeller: Scaling Up Visual Language Modeling in Remote Sensing with Rich Linguistic Semantics from Openly Available Data and Large Language Modelscited by 7
- 2024COCO is "ALL'' You Need for Visual Instruction Fine-tuningcited by 3
12 most cited of 16 All 16 (JSON)
- 2025Vocabulary-free few-shot learning for Vision-Language Models4 Jun 2025
- 2025ILIAS: Instance-Level Image retrieval At Scale17 Feb 2025
- 2024Frequency Is What You Need: Considering Word Frequency When Text Masking Benefits Vision-Language Model Pre-training20 Dec 2024
- 2024Enhancing Vision-Language Model Pre-training with Image-text Pair Pruning Based on Word Frequency9 Oct 2024
- 2024Securing Vision-Language Models with a Robust Encoder Against Jailbreak and Adversarial Attacks11 Sep 2024
- 2024RSTeller: Scaling Up Visual Language Modeling in Remote Sensing with Rich Linguistic Semantics from Openly Available Data and Large Language Models27 Aug 2024
- 2024FFF: Fixing Flawed Foundations in contrastive pre-training results in very strong Vision-Language models16 May 2024
- 2024COCO is "ALL'' You Need for Visual Instruction Fine-tuning17 Jan 2024
- 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensing20 Jun 2023
- 2023A Survey of Vision-Language Pre-training from the Lens of Multimodal Machine Translation12 Jun 2023
- 2023SoftCLIP: Softer Cross-modal Alignment Makes CLIP Stronger30 Mar 2023
- 2022CREPE: Can Vision-Language Foundation Models Reason Compositionally?13 Dec 2022
12 newest of 16 All 16 (JSON)
- 2023DataComp: In search of the next generation of multimodal datasetscited by 635
- 2023Unsafe Diffusion: On the Generation of Unsafe Images and Hateful Memes From Text-To-Image Modelscited by 171
- 2023A Pilot Study of Query-Free Adversarial Attack against Stable Diffusioncited by 75
- 2025Generative AI in Depth: A Survey of Recent Advances, Model Variants, and Real-World Applicationscited by 5
- 2024FiVA: Fine-grained Visual Attribute Dataset for Text-to-Image Diffusion Modelscited by 3
- 2025Generative AI in Depth: A Survey of Recent Advances, Model Variants, and Real-World Applications23 Oct 2025
- 2024FiVA: Fine-grained Visual Attribute Dataset for Text-to-Image Diffusion Models10 Dec 2024
- 2023Unsafe Diffusion: On the Generation of Unsafe Images and Hateful Memes From Text-To-Image Models23 May 2023
- 2023DataComp: In search of the next generation of multimodal datasets27 Apr 2023
- 2023A Pilot Study of Query-Free Adversarial Attack against Stable Diffusion29 Mar 2023
- 2023Benchmarks for Automated Commonsense Reasoning: A Surveycited by 40
- 2024How Good is my Video LMM? Complex Video Reasoning and Robustness Evaluation Suite for Video-LMMscited by 30
- 2023Multimodality Representation Learning: A Survey on Evolution, Pretraining and Its Applicationscited by 27
- 2025Argus Inspection: Do Multimodal Large Language Models Possess the Eye of Panoptes?cited by 1
- 2025Argus Inspection: Do Multimodal Large Language Models Possess the Eye of Panoptes?3 Jun 2025
- 2024How Good is my Video LMM? Complex Video Reasoning and Robustness Evaluation Suite for Video-LMMs6 May 2024
- 2023Benchmarks for Automated Commonsense Reasoning: A Survey9 Feb 2023
- 2023Multimodality Representation Learning: A Survey on Evolution, Pretraining and Its Applications1 Feb 2023
- 2022Certified Graph Unlearningcited by 46
- 2023Breaking the Trilemma of Privacy, Utility, Efficiency via Controllable Machine Unlearningcited by 21
- 2023Breaking the Trilemma of Privacy, Utility, Efficiency via Controllable Machine Unlearning28 Oct 2023
- 2022Certified Graph Unlearning18 Jun 2022
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2022Reproducible scaling laws for contrastive language-image learningcited by 1,163
- 2021NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actionscited by 735
- 2021LiT: Zero-Shot Transfer with Locked-image text Tuningcited by 572
- 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 479
- 2023Poisoning Web-Scale Training Datasets is Practicalcited by 276
- 2023Multimodal C4: An Open, Billion-scale Corpus of Images Interleaved with Textcited by 208
- 2022Unified Contrastive Learning in Image-Text-Label Spacecited by 194
- 2022MaskCLIP: Masked Self-Distillation Advances Contrastive Language-Image Pretrainingcited by 187
- 2023Cut and Learn for Unsupervised Object Detection and Instance Segmentationcited by 186
- 2022A Self-Supervised Descriptor for Image Copy Detectioncited by 175
12 most cited of 202 All 202 (JSON)
- 2026Multi-Modal Contrastive Learning for Implicit Earth Embeddings via Location Tying18 Jun 2026
- 2026What Are We Really Measuring? Rethinking Dataset Bias in Web-Scale Natural Image Collections via Unsupervised Semantic Clustering15 Apr 2026
- 2026M3D-Stereo: A Multiple-Medium and Multiple-Degradation Dataset for Stereo Image Restoration14 Apr 2026
- 2026An In-Depth Study of Filter-Agnostic Vector Search on a PostgreSQL Database System: [Experiments and Analysis]24 Mar 2026
- 2026MoXaRt: Audio-Visual Object-Guided Sound Interaction for XR11 Mar 2026
- 2026A Practical Guide to Streaming Continual Learning2 Mar 2026
- 2025LLHA-Net: A Hierarchical Attention Network for Two-View Correspondence Learning31 Dec 2025
- 2025Towards Generative Location Awareness for Disaster Response: A Probabilistic Cross-view Geolocalization Approach23 Dec 2025
- 2025Patch-wise Retrieval: A Bag of Practical Techniques for Instance-level Matching14 Dec 2025
- 2025LeCoT: revisiting network architecture for two-view correspondence pruning10 Nov 2025
- 2025GeoToken: Hierarchical Geolocalization of Images via Next Token Prediction2 Nov 2025
- 2025Trade-offs in Cross-Domain Generalization of Foundation Model Fine-Tuned for Biometric Applications18 Sep 2025
12 newest of 202 All 202 (JSON)