mlsanityData to 14 Oct 2026

Leveraging Multimodal LLMs for Built Environment and Housing Attribute Assessment from Street-View Imagery

arXiv 2604.21102 ↗First posted 22 Apr 2026cs.CV cs.AIcited by 0

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

We present a novel framework for automatically evaluating building conditions nationwide in the United States by leveraging large language models (LLMs) and Google Street View (GSV) imagery. By fine-tuning Gemma 3 27B on a modest human-labeled dataset, our approach achieves strong alignment with human mean opinion scores (MOS), outperforming even individual raters on SRCC and PLCC relative to the MOS benchmark. To enhance efficiency, we apply knowledge distillation, transferring the capabilities of Gemma 3 27B to a smaller Gemma 3 4B model that achieves comparable performance with a 3x speedup. Further, we distill the knowledge into a CNN-based model (EfficientNetV2-M) and a transformer (SwinV2-B), delivering close performance while achieving a 30x speed gain. Furthermore, we investigate LLMs' capabilities for assessing an extensive list of built environment and housing attributes through a human-AI alignment study and develop a visualization dashboard that integrates LLM assessment outcomes for downstream analysis by homeowners. Our framework offers a flexible and efficient solution for large-scale building condition assessment, enabling high accuracy with minimal human labeling effort.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 18 of its 32 references that are in the map. First posted on arXiv 22 Apr 2026.

Builds on

18 of 32 references.

References · 18

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  4. 2023Visual Instruction Tuningcited by 7,869
  5. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  6. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  7. 2023Qwen Technical Reportcited by 3,344
  8. 2019Searching for MobileNetV3cited by 1,994
  9. 2024A Survey on LLM-as-a-Judgecited by 1,423
  10. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,228
  11. 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,135
  12. 2024Gemma: Open Models Based on Gemini Research and Technologycited by 916
6 more
  1. 2024Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferencescited by 144
  2. 2025Neither Valid nor Reliable? Investigating the Use of LLMs as Judgescited by 39
  3. 2025OpenFACADES: An Open Framework for Architectural Caption and Attribute Data Enrichment via Street View Imagerycited by 8
  4. 2022Computer vision-based analysis of buildings and built environments: A systematic review of current approachescited by 3
  5. 2024Leveraging Variation Theory in Counterfactual Data Augmentation for Optimized Active Learningcited by 2
  6. 2024BuildingView: Constructing Urban Building Exteriors Databases with Street View Imagery and Multimodal Large Language Modecited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Built Environment Reasoning from Remote Sensing Imagery Using Large Vision--Language Models
  2. 2024StreetviewLLM: Extracting Geographic Information Using a Chain-of-Thought Multimodal Large Language Model
  3. 2026AI vs Human Expert Reasoning: Assessing Agreements in Building Typology Predictions based on Street View Imagery
  4. 2026Can Large Multimodal Models Inspect Buildings? A Hierarchical Benchmark for Structural Pathology Reasoning
  5. 2026USAI-Quant: A Quantitative Reasoning Benchmark for Vision-Language Models in Built Environments
  6. 2025VectorLLM: Human-like Extraction of Structured Building Contours vis Multimodal LLMs
  7. 2025On the Performance of LLMs for Real Estate Appraisal
  8. 2025UrbanFeel: A Comprehensive Benchmark for Temporal and Perceptual Understanding of City Scenes through Human Perspective