mlsanityData to 7 Oct 2026

From Street View to Visual Network: Mapping the Visibility of Urban Landmarks with Vision-Language Models

arXiv 2505.11809 ↗First posted 17 May 2025cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

Visibility analysis in urban planning has traditionally relied on line-of-sight (LoS) simulations, which capture geometric occlusion. However, these approaches depend on accurate 3D data that is often unavailable and may not adequately represent how visually distinctive urban landmarks are encountered in real streetscapes. We reformulate landmark visibility assessment as an urban visual search problem in image space by leveraging the widespread availability of street view imagery (SVI). Given a reference image of a target landmark, a Vision Language Model (VLM) is applied to detect the landmark in direction- and zoom-controlled SVI. A successful detection indicates machine-recognised landmark visibility at the corresponding viewpoint. Beyond isolated viewpoints, we construct a heterogeneous visibility graph to represent visual connectivity among landmarks, street-view locations, and the urban spaces that mediate them. This graph enables us to map where visual connections occur, how strong they are, and how multiple landmarks become jointly connected through shared visual corridors. Across six well-known landmark structures in global cities, the image-based method achieves an overall detection accuracy of 87%, with a precision score of 68% for landmark-visible locations. In a second case study along the River Thames in London, the visibility graph reveals multi-landmark connections and identifies key mediating locations, with bridges accounting for approximately 31% of all connections. The proposed method complements LoS-based visibility analysis and offers a practical alternative in data-constrained settings. It also showcases the possibility of revealing the prevalent connections of visual objects in the urban environment, opening new perspectives for urban planning and heritage conservation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 8 of its 93 references that are in the map. First posted on arXiv 17 May 2025.

Builds on

8 of 93 references.

References · 8

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  3. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  4. 2023CogVLM: Visual Expert for Pretrained Language Modelscited by 704
  5. 2023Scaling Open-Vocabulary Object Detectioncited by 335
  6. 2022Simple Open-Vocabulary Object Detection with Vision Transformerscited by 303
  7. 2019Deep Graph Library: A Graph-Centric, Highly-Performant Package for Graph Neural Networkscited by 241
  8. 2023SatCLIP: Global, General-Purpose Location Embeddings with Satellite Imagerycited by 148

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Designing streetscapes from street-view imagery using diffusion models
  2. 2025Streetscape Analysis with Generative AI (SAGAI): Vision-Language Assessment and Mapping of Urban Scenes
  3. 2026From Street View Imagery to Street Quality Indicators: Vision Language Inference for the Suburban 15-minute City
  4. 2025SceneScout: Towards AI Agent-driven Access to Street View Imagery for Blind Users
  5. 2025GeoProg3D: Compositional Visual Reasoning for City-Scale 3D Language Fields
  6. 2025Interpretable Multimodal Framework for Human-Centered Street Assessment: Integrating Visual-Language Models for Perceptual Urban Diagnostics
  7. 2025Do Vision-Language Models See Urban Scenes as People Do? An Urban Perception Benchmark
  8. 2025PlanGPT-VL: Enhancing Urban Planning with Domain-Specific Vision-Language Models