Streetscape Analysis with Generative AI (SAGAI): Vision-Language Assessment and Mapping of Urban Scenes
Not on the map. Why?
Abstract (arXiv)
Streetscapes are an essential component of urban space. Their assessment is presently either limited to morphometric properties of their mass skeleton or requires labor-intensive qualitative evaluations of visually perceived qualities. This paper introduces SAGAI: Streetscape Analysis with Generative Artificial Intelligence, a modular workflow for scoring street-level urban scenes using open-access data and vision-language models. SAGAI integrates OpenStreetMap geometries, Google Street View imagery, and a lightweight version of the LLaVA model to generate structured spatial indicators from images via customizable natural language prompts. The pipeline includes an automated mapping module that aggregates visual scores at both the point and street levels, enabling direct cartographic interpretation. It operates without task-specific training or proprietary software dependencies, supporting scalable and interpretable analysis of urban environments. Two exploratory case studies in Nice and Vienna illustrate SAGAI's capacity to produce geospatial outputs from vision-language inference. The initial results show strong performance for binary urban-rural scene classification, moderate precision in commercial feature detection, and lower estimates, but still informative, of sidewalk width. Fully deployable by any user, SAGAI can be easily adapted to a wide range of urban research themes, such as walkability, safety, or urban design, through prompt modification alone.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 13 of its 41 references that are in the map. First posted on arXiv 23 Apr 2025.
Builds on
13 of 41 references.
References · 13
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023GPT-4 Technical Reportcited by 18,396
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2023Visual Instruction Tuningcited by 7,869
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,162
- 2024Mixtral of Expertscited by 1,823
- 2023LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agentscited by 193
- 2017Using Deep Learning and Google Street View to Estimate the Demographic Makeup of the UScited by 66
1 more
Built on by
Citing papers per year: 2025: 1; 2026: 5.
6 papers.
- 2025StreetLens: Enabling Human-Centered AI Agents for Neighborhood Assessment from Street View Imagerycited by 2
- 2026Culturally uneven urban perception in large language modelscited by 1
- 2026UVLM: A Universal Vision-Language Model Loader for Reproducible Multimodal Benchmarkingcited by 0
- 2026UrbanVGGT: Scalable Sidewalk Width Estimation from Street View Imagescited by 0
- 2026From Street View Imagery to Street Quality Indicators: Vision Language Inference for the Suburban 15-minute Citycited by 0
- 2026Can VLMs Reliably Assess Sidewalk Accessibility Attributes from Pedestrian-Level Imagery?cited by 0
- 2026Can VLMs Reliably Assess Sidewalk Accessibility Attributes from Pedestrian-Level Imagery?15 Sep 2026
- 2026From Street View Imagery to Street Quality Indicators: Vision Language Inference for the Suburban 15-minute City20 Aug 2026
- 2026Culturally uneven urban perception in large language models21 Apr 2026
- 2026UrbanVGGT: Scalable Sidewalk Width Estimation from Street View Images23 Mar 2026
- 2026UVLM: A Universal Vision-Language Model Loader for Reproducible Multimodal Benchmarking14 Mar 2026
- 2025StreetLens: Enabling Human-Centered AI Agents for Neighborhood Assessment from Street View Imagery17 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2026Designing streetscapes from street-view imagery using diffusion models
- 2025UrbanSense:A Framework for Quantitative Analysis of Urban Streetscapes leveraging Vision Large Language Models
- 2024StreetviewLLM: Extracting Geographic Information Using a Chain-of-Thought Multimodal Large Language Model
- 2025Interpretable Multimodal Framework for Human-Centered Street Assessment: Integrating Visual-Language Models for Perceptual Urban Diagnostics
- 2024Towards Zero-Shot Annotation of the Built Environment with Vision-Language Models (Vision Paper)
- 2025From Street View to Visual Network: Mapping the Visibility of Urban Landmarks with Vision-Language Models
- 2025Generative AI for Urban Planning: Synthesizing Satellite Imagery via Diffusion Models
- 2024Streetscapes: Large-scale Consistent Street View Generation Using Autoregressive Video Diffusion