Are Video Generation Models Geographically Fair? An Attraction-Centric Evaluation of Global Visual Knowledge
Not on the map. Why?
Abstract (arXiv)
Recent advances in text-to-video generation have produced visually compelling results, yet it remains unclear whether these models encode geographically equitable visual knowledge. In this work, we investigate the geo-equity and geographically grounded visual knowledge of text-to-video models through an attraction-centric evaluation. We introduce Geo-Attraction Landmark Probing (GAP), a systematic framework for assessing how faithfully models synthesize tourist attractions from diverse regions, and construct GEOATTRACTION-500, a benchmark of 500 globally distributed attractions spanning varied regions and popularity levels. GAP integrates complementary metrics that disentangle overall video quality from attraction-specific knowledge, including global structural alignment, fine-grained keypoint-based alignment, and vision-language model judgments, all validated against human evaluation. Applying GAP to the state-of-the-art text-to-video model Sora 2, we find that, contrary to common assumptions of strong geographic bias, the model exhibits a relatively uniform level of geographically grounded visual knowledge across regions, development levels, and cultural groupings, with only weak dependence on attraction popularity. These results suggest that current text-to-video models express global visual knowledge more evenly than expected, highlighting both their promise for globally deployed applications and the need for continued evaluation as such systems evolve.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 39 references that are in the map. First posted on arXiv 26 Jan 2026.
Builds on
28 of 39 references.
References · 28
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Segment Anythingcited by 8,158
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2024A Survey on LLM-as-a-Judgecited by 1,384
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
- 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 416
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 332
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 314
16 more
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
- 2018A Note on the Inception Scorecited by 225
- 2023A Survey on Video Diffusion Modelscited by 203
- 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 190
- 2023Cultural Bias and Cultural Alignment of Large Language Modelscited by 149
- 2024Large Language Models are Geographically Biasedcited by 91
- 2025Diffusion Beats Autoregressive in Data-Constrained Settingscited by 61
- 2025T2VWorldBench: A Benchmark for Evaluating World Knowledge in Text-to-Video Generationcited by 18
- 2023A Survey of AI Text-to-Image and AI Text-to-Video Generatorscited by 17
- 2024A Survey of AI-Generated Video Evaluationcited by 17
- 2023Towards Robust Text-Prompted Semantic Criterion for In-the-Wild Video Quality Assessmentcited by 16
- 2023Optimization of Rank Losses for Image Retrievalcited by 10
- 2025AIGVE-Tool: AI-Generated Video Evaluation Toolkit with Multifaceted Benchmarkcited by 7
- 2024Evaluation of Geographical Distortions in Language Modelscited by 6
- 2025The World According to LLMs: How Geographic Origin Influences LLMs' Entity Deduction Capabilitiescited by 5
- 2020Procrustes analysis for high-dimensional datacited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026GeoDiv: Framework For Measuring Geographical Diversity In Text-To-Image Models
- 2025Culture in Action: Evaluating Text-to-Image Models through Social Activities
- 2025GIMMICK -- Globally Inclusive Multimodal Multitask Cultural Knowledge Benchmarking
- 2026Cultural Moment Benchmark: Evaluating Video Cultural Reasoning and Grounding in Southeast Asia
- 2024Sora as a World Model? A Complete Survey on Text-to-Video Generation
- 2025WorldModelBench: Judging Video Generation Models As World Models
- 2026CultureVidBench: Benchmarking Cultural Understanding in Text-to-Video Generation
- 2026TerraVis: Towards Evaluation of World-Grounded Visual Consistency in Text-to-Image Generation via MLLM Workflows