mlsanityData to 14 Oct 2026

Seeing the City or Recognizing the Place? What Street-View Imagery Adds Beyond Existing Urban Data in VLM-Based Urban Sensing

arXiv 2610.00031 ↗First posted 2 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Street-view imagery is increasingly analysed with vision-language models (VLMs) to infer urban attributes, but predictive accuracy alone does not show how much a photograph contributes beyond data already available for the same place. Using three VLMs, we compare image-based predictions with existing urban data for seven attributes drawn from five public resources. Each urban unit is evaluated with imagery, with location or text context, and against non-image predictions from nearby observations or public records. We also replace images and add conflicting records to test which source the predictions follow. Nearby observations or public records matched or exceeded image-only predictions for road damage, curb ramps, population, and house price. Images were more informative for building type, building function, and the floor count of low-rise buildings. For floor count, the advantage of images over nearby OpenStreetMap labels increased by 5.7 percentage points per doubling of distance to the nearest labelled building and declined for tall buildings whose rooflines often fell outside the frame. When images and records disagreed, predictions usually moved towards the supplied record. Released OpenFACADES floor annotations, generated with OpenStreetMap floor values as input, showed the same dependence: their agreement with the reference increased with building height, whereas that of image-only reruns decreased. The value of street-view imagery therefore depends on whether an attribute is visible and how well the place is already covered by existing data. Because machine-derived labels are often reused as references, these comparisons also bear on how urban datasets are documented and evaluated.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 38 references that are in the map. First posted on arXiv 2 Sep 2026.

Builds on

13 of 38 references.

References · 13

  1. 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,516
  2. 2020Shortcut Learning in Deep Neural Networkscited by 1,969
  3. 2018Datasheets for Datasetscited by 1,386
  4. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
  5. 2023Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflictscited by 341
  6. 2024Large Language Models are Geographically Biasedcited by 93
  7. 2017Using Deep Learning and Google Street View to Estimate the Demographic Makeup of the UScited by 66
  8. 2018Road Damage Detection Using Deep Neural Networks with Images Captured Through a Smartphonecited by 45
  9. 2024Coverage and Bias of Street View Imagery in Mapping the Urban Environmentcited by 12
  10. 2025OpenFACADES: An Open Framework for Architectural Caption and Attribute Data Enrichment via Street View Imagerycited by 8
  11. 2025CityLens: Evaluating Large Vision-Language Models for Urban Socioeconomic Sensingcited by 7
  12. 2024StreetviewLLM: Extracting Geographic Information Using a Chain-of-Thought Multimodal Large Language Modelcited by 6
1 more
  1. 2024Examining the Commitments and Difficulties Inherent in Multimodal Foundation Models for Street View Imagerycited by 4

Built on by

Not cited yet.