mlsanityData to 7 Oct 2026

GeoDE: a Geographically Diverse Evaluation Dataset for Object Recognition

arXiv 2301.02560 ↗First posted 5 Jan 2023cs.CVcited by 50

Not on the map. Why?

Abstract (arXiv)

Current dataset collection methods typically scrape large amounts of data from the web. While this technique is extremely scalable, data collected in this way tends to reinforce stereotypical biases, can contain personally identifiable information, and typically originates from Europe and North America. In this work, we rethink the dataset collection paradigm and introduce GeoDE, a geographically diverse dataset with 61,940 images from 40 classes and 6 world regions, with no personally identifiable information, collected by soliciting images from people around the world. We analyse GeoDE to understand differences in images collected in this manner compared to web-scraping. We demonstrate its use as both an evaluation and training dataset, allowing us to highlight and begin to mitigate the shortcomings in current models, despite GeoDE's relatively small size. We release the full dataset and code at https://geodiverse-data-collection.cs.princeton.edu

Key facts. Cited by 50 papers in the map (data through 7 Oct 2026). Builds on 21 of its 41 references that are in the map. First posted on arXiv 5 Jan 2023.

Builds on

21 of 41 references.

References · 21

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  4. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  5. 2016Identity Mappings in Deep Residual Networkscited by 1,960
  6. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  7. 2018Datasheets for Datasetscited by 1,371
  8. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
  9. 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 789
  10. 2016Hollywood in Homes: Crowdsourcing Data Collection for Activity Understandingcited by 535
  11. 2017Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraintscited by 420
  12. 2020Large image datasets: A pyrrhic win for computer vision?cited by 237
9 more
  1. 2019Towards Fairer Datasets: Filtering and Balancing the Distribution of the People Subtree in the ImageNet Hierarchycited by 156
  2. 2017No Classification without Representation: Assessing Geodiversity Issues in Open Data Sets for the Developing Worldcited by 152
  3. 2019Does Object Recognition Work for Everyone?cited by 149
  4. 2020REVISE: A Tool for Measuring and Mitigating Bias in Visual Datasetscited by 136
  5. 2019Lessons from Archives: Strategies for Collecting Sociocultural Data in Machine Learningcited by 116
  6. 2021A Study of Face Obfuscation in ImageNetcited by 83
  7. 2021Adaptive Methods for Real-World Domain Generalizationcited by 66
  8. 2021PASS: An ImageNet replacement for self-supervised pretraining without humanscited by 51
  9. 2019Auditing ImageNet: Towards a Model-driven Framework for Annotating Demographic Attributes of Large-Scale Image Datasetscited by 24

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 4; 2024: 19; 2025: 20; 2026: 7.

50 papers.

Sort:

By area:

  1. 2025Meta CLIP 2: A Worldwide Scaling Recipecited by 59
  2. 2025Ask in Any Modality: A Comprehensive Survey on Multimodal Retrieval-Augmented Generationcited by 42
  3. 2024MRAG-Bench: Vision-Centric Evaluation for Retrieval-Augmented Multimodal Modelscited by 41
  4. 2024V-IRL: Grounding Virtual Intelligence in Real Lifecited by 35
  5. 2024Consistency-diversity-realism Pareto fronts of conditional image generative modelscited by 35
  6. 2024African or European Swallow? Benchmarking Large Vision-Language Models for Fine-Grained Object Classificationcited by 31
  7. 2024Position: Measure Dataset Diversity, Don't Just Claim Itcited by 26
  8. 2024Evaluating Visual and Cultural Interpretation: The K-Viscuit Benchmark with Human-VLM Collaborationcited by 19
  9. 2024Active Data Curation Effectively Distills Large-Scale Multimodal Modelscited by 19
  10. 2025Scaling Pre-training to One Hundred Billion Data for Vision Language Modelscited by 18
  11. 2023Ethical Considerations for Responsible Data Curationcited by 17
  12. 2023PerceptionCLIP: Visual Classification by Inferring and Conditioning on Contextscited by 16
38 more
  1. 2024No Filter: Cultural and Socioeconomic Diversity in Contrastive Vision-Language Modelscited by 16
  2. 2024Probabilistic Language-Image Pre-Trainingcited by 16
  3. 2025Grounding Multilingual Multimodal LLMs With Cultural Knowledgecited by 16
  4. 2024Multilingual Diversity Improves Vision-Language Representationscited by 14
  5. 2024From Local Concepts to Universals: Evaluating the Multicultural Understanding of Vision-Language Modelscited by 14
  6. 2025SPARKE: Scalable Prompt-Aware Diversity and Novelty Guidance in Diffusion Models via RKE Scorecited by 14
  7. 2024Fairness and Bias Mitigation in Computer Vision: A Surveycited by 12
  8. 2023DMLR: Data-centric Machine Learning Research -- Past, Present and Futurecited by 11
  9. 2023DIG In: Evaluating Disparities in Image Generations with Indicators for Geographic Diversitycited by 9
  10. 2024The Power of Many: Multi-Agent Multimodal Models for Cultural Image Captioningcited by 9
  11. 2025Culture in Action: Evaluating Text-to-Image Models through Social Activitiescited by 9
  12. 2025Recursive Inference Scaling: A Winning Path to Scalable Inference in Language and Multimodal Systemscited by 8
  13. 2025Whose Truth? Pluralistic Geo-Alignment for (Agentic) AIcited by 6
  14. 2025Increasing the Utility of Synthetic Images through Chamfer Guidancecited by 6
  15. 2024EvalGIM: A Library for Evaluating Generative Image Modelscited by 5
  16. 2025GAEA: A Geolocation Aware Conversational Assistantcited by 5
  17. 2025Alif: Advancing Urdu Large Language Models via Multilingual Synthetic Data Distillationcited by 5
  18. 2024Incorporating Geo-Diverse Knowledge into Prompting for Increased Geographical Robustness in Object Recognitioncited by 4
  19. 2025What are Foundation Models Cooking in the Post-Soviet World?cited by 3
  20. 2025Ontologies in Design: How Imagining a Tree Reveals Possibilites and Assumptions in Large Language Modelscited by 3
  21. 2025Evaluation of Cultural Competence of Vision-Language Modelscited by 3
  22. 2024A Taxonomy of Challenges to Curating Fair Datasetscited by 2
  23. 2024FairLoRA: Unpacking Bias Mitigation in Vision Models with Fairness-Driven Low-Rank Adaptationcited by 2
  24. 2025Conflicts in Texts: Data, Implications and Challengescited by 2
  25. 2025LongProLIP: A Probabilistic Vision-Language Model with Long Context Textcited by 1
  26. 2025Toward Reliable VLM: A Fine-Grained Benchmark and Framework for Exposure, Bias, and Inference in Korean Street Viewscited by 1
  27. 2025CAIRe: Cultural Attribution of Images by Retrieval-Augmented Evaluationcited by 1
  28. 2025Culture Affordance Atlas: Reconciling Object Diversity Through Functional Mappingcited by 1
  29. 2026Breaking the Limits of Open-Weight CLIP: An Optimization Framework for Self-supervised Fine-tuning of CLIPcited by 1
  30. 2026ValueGround: Evaluating Culture-Conditioned Visual Value Grounding in MLLMscited by 1
  31. 2026OT on the Map: Quantifying Domain Shifts in Geographic Spacecited by 1
  32. 2024DoubleCCA: Improving Foundation Model Group Robustness with Random Sentence Embeddingscited by 0
  33. 2024Classification Drives Geographic Bias in Street Scene Segmentationcited by 0
  34. 2025WAON: A Large-Scale Japanese Image-Text Dataset for Cultural Adaptation in Contrastive Vision-Language Modelscited by 0
  35. 2026Where Do Images Come From? Analyzing Captions to Geographically Profile Datasetscited by 0
  36. 2026T2I-BiasBench: A Multi-Metric Framework for Auditing Demographic and Cultural Bias in Text-to-Image Modelscited by 0
  37. 2026GeoFidelity-Bench: Evaluating Block-Conditioned Geographic Fidelity in Text-to-Image Street-View Generationcited by 0
  38. 2026Lifelong Representations: A Survey on Continual Self-Supervised Learning for Vision Modelscited by 0