V-RoAst: Visual Road Assessment. Can VLM be a Road Safety Assessor Using the iRAP Standard?
Not on the map. Why?
Abstract (arXiv)
Road safety assessments are critical yet costly, especially in Low- and Middle-Income Countries (LMICs), where most roads remain unrated. Traditional methods require expert annotation and training data, while supervised learning-based approaches struggle to generalise across regions. In this paper, we introduce textitV-RoAst, a zero-shot Visual Question Answering (VQA) framework using Vision-Language Models (VLMs) to classify road safety attributes defined by the iRAP standard. We introduce the first open-source dataset from ThaiRAP, consisting of over 2,000 curated street-level images from Thailand annotated for this task. We evaluate Gemini-1.5-flash and GPT-4o-mini on this dataset and benchmark their performance against VGGNet and ResNet baselines. While VLMs underperform on spatial awareness, they generalise well to unseen classes and offer flexible prompt-based reasoning without retraining. Our results show that VLMs can serve as automatic road assessment tools when integrated with complementary data. This work is the first to explore VLMs for zero-shot infrastructure risk assessment and opens new directions for automatic, low-cost road safety mapping. Code and dataset: https://github.com/PongNJ/V-RoAst.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 34 of its 72 references that are in the map. First posted on arXiv 20 Aug 2024.
Builds on
34 of 72 references.
References · 34
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2015VQA: Visual Question Answeringcited by 2,489
22 more
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,114
- 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 455
- 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 357
- 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 309
- 2023NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenariocited by 258
- 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 254
- 2024ChatScene: Knowledge-Enabled Safety-Critical Scenario Generation for Autonomous Vehiclescited by 92
- 2024DriveWorld: 4D Pre-trained Scene Understanding via World Models for Autonomous Drivingcited by 89
- 2023On the Road with GPT-4V(ision): Early Explorations of Visual-Language Model on Autonomous Drivingcited by 79
- 2023UniPAD: A Universal Pre-training Paradigm for Autonomous Drivingcited by 73
- 2023GPT4GEO: How a Language Model Sees the World's Geographycited by 68
- 2023SemiVL: Semi-Supervised Semantic Segmentation with Vision-Language Guidancecited by 41
- 2022RDD2022: A multi-national image dataset for automatic Road Damage Detectioncited by 32
- 2024Delving into Multi-modal Multi-task Foundation Models for Road Scene Understanding: From Learning Paradigm Perspectivescited by 22
- 2022Computer Vision for Road Imaging and Pothole Detection: A State-of-the-Art Review of Systems and Algorithmscited by 19
- 2024Zero-shot Building Age Classification from Facade Image Using GPT-4cited by 8
- 2019FARSA: Fully Automated Roadway Safety Assessmentcited by 7
- 2024Zero-shot detection of buildings in mobile LiDAR using Language Vision Modelcited by 3
- 2022Dynamic loss balancing and sequential enhancement for road-safety assessment and traffic scene classificationcited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025CLIP the Landscape: Automated Tagging of Crowdsourced Landscape Imagescited by 0
- 2026Don't Fool Me Twice: Adapting to Adversity in the Wild with Experience-Driven Reasoningcited by 0
- 2026Multi-modal Rail Crossing Safety Analysiscited by 0
- 2026EG-ARSA: An Expert-Grounded Open Model for Visual Road Safety Auditing in Low-Resource Settingscited by 0
- 2026EG-ARSA: An Expert-Grounded Open Model for Visual Road Safety Auditing in Low-Resource Settings24 Aug 2026
- 2026Multi-modal Rail Crossing Safety Analysis1 Jul 2026
- 2026Don't Fool Me Twice: Adapting to Adversity in the Wild with Experience-Driven Reasoning29 May 2026
- 2025CLIP the Landscape: Automated Tagging of Crowdsourced Landscape Images13 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2025Evaluating Small Vision-Language Models on Distance-Dependent Traffic Perception
- 2025Descriptor: Distance-Annotated Traffic Perception Question Answering (DTPQA)
- 2025STRIDE-QA: Visual Question Answering Dataset for Spatiotemporal Reasoning in Urban Driving Scenes
- 2024Evaluation and Comparison of Visual Language Models for Transportation Engineering Problems
- 2026Inter-3D VQA: A Roadside Multimodal Benchmark for 3D Spatiotemporally Grounded Visual Question Answering
- 2025RoadSceneVQA: Benchmarking Visual Question Answering in Roadside Perception Systems for Intelligent Transportation System
- 2025Are Large Pre-trained Vision Language Models Effective Construction Safety Inspectors?
- 2026From Accuracy to Visual Dependence: Auditing and Filtering Modality Collapse in Traffic VideoQA