mlsanityData to 14 Oct 2026

Multimodal Large Language Models Predict Urban Safety Perception but Encode Non-Neutral Demographic Priors

arXiv 2503.00610 ↗First posted 1 Mar 2025cs.CY cs.AIcited by 3

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

Understanding how people perceive urban environments is essential for inclusive planning, yet conventional surveys are costly and difficult to scale. We investigate whether Multimodal Large Language Models (MLLMs) can assess perceived urban safety from street-view imagery while accounting for the observer-dependent nature of perception. Using Place Pulse 2.0, we evaluate four open and proprietary MLLMs across 56 cities under a Neutral prompt and socio-demographic personas defined by gender, age, and race or ethnicity. We also analyse the keywords generated to justify each classification. All four models display comparable zero-shot capability, with city-macro F1 scores of 65--69%, and preserve meaningful cross-city variation. However, they systematically favour the Safe class, underpredict unsafety, and compress differences between cities. Their explanations converge on a shared visual lexicon: maintenance, greenery, order, and residential character support Safe judgements, whereas deterioration, isolation, poor lighting, and limited pedestrian activity support Unsafe judgements. Persona prompting produces substantial and structured shifts while holding the image fixed. Female personas yield more Unsafe classifications than Male personas across all models; age effects are model-dependent, although Middle-aged personas generally remain closest to Neutral. Black/African American and Native American personas frequently show the largest departures, while the closest race or ethnicity match varies by model. These findings show that MLLMs can provide scalable signals of perceived urban safety, but not from a demographically neutral standpoint.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 10 of its 70 references that are in the map. First posted on arXiv 1 Mar 2025.

Builds on

10 of 70 references.

References · 10

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  3. 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 500
  4. 2023When the Majority is Wrong: Modeling Annotator Disagreement for Subjective Taskscited by 90
  5. 2023Simulating Social Media Using Large Language Models to Evaluate Alternative News Feed Algorithmscited by 65
  6. 2023Frozen Language Model Helps ECG Zero-Shot Learningcited by 62
  7. 2024ELEV-VISION-SAM: Integrated Vision Language and Foundation Model for Automated Estimation of Building Lowest Floor Elevationcited by 9
  8. 2024Bridging the Data Provenance Gap Across Text, Speech and Videocited by 2
  9. 2024Urban Visual Appeal According to ChatGPT: Contrasting AI and Human Insightscited by 1
  10. 2024Towards Civic Digital Twins: Co-Design the Citizen-Centric Future of Bolognacited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Do Vision-Language Models See Urban Scenes as People Do? An Urban Perception Benchmark
  2. 2026Benchmarks for Vision-Language Models in Urban Perception Should Be Reliability-Aware and Negotiated
  3. 2024Urban Safety Perception Assessments via Integrating Multimodal Large Language Models with Street View Images
  4. 2026Persona Prompting in Multimodal Urban Perception: Descriptive Convergence and Interpretive Variation
  5. 2025From Street Views to Urban Science: Discovering Road Safety Factors with Multimodal Large Language Models
  6. 2025Interpretable Multimodal Framework for Human-Centered Street Assessment: Integrating Visual-Language Models for Perceptual Urban Diagnostics
  7. 2025UrbanFeel: A Comprehensive Benchmark for Temporal and Perceptual Understanding of City Scenes through Human Perspective
  8. 2025Whose View of Safety? A Deep DIVE Dataset for Pluralistic Alignment of Text-to-Image Models