CrashSage: A Large Language Model-Centered Framework for Contextual and Interpretable Traffic Crash Analysis
Not on the map. Why?
Abstract (arXiv)
Road crashes claim over 1.3 million lives annually worldwide and incur global economic losses exceeding 1.8 trillion. Such profound societal and financial impacts underscore the urgent need for road safety research that uncovers crash mechanisms and delivers actionable insights. Conventional statistical models and tree ensemble approaches typically rely on structured crash data, overlooking contextual nuances and struggling to capture complex relationships and underlying semantics. Moreover, these approaches tend to incur significant information loss, particularly in narrative elements related to multi-vehicle interactions, crash progression, and rare event characteristics. This study presents CrashSage, a novel Large Language Model (LLM)-centered framework designed to advance crash analysis and modeling through four key innovations. First, we introduce a tabular-to-text transformation strategy paired with relational data integration schema, enabling the conversion of raw, heterogeneous crash data into enriched, structured textual narratives that retain essential structural and relational context. Second, we apply context-aware data augmentation using a base LLM model to improve narrative coherence while preserving factual integrity. Third, we fine-tune the LLaMA3-8B model for crash severity inference, demonstrating superior performance over baseline approaches, including zero-shot, zero-shot with chain-of-thought prompting, and few-shot learning, with multiple models (GPT-4o, GPT-4o-mini, LLaMA3-70B). Finally, we employ a gradient-based explainability technique to elucidate model decisions at both the individual crash level and across broader risk factor dimensions. This interpretability mechanism enhances transparency and enables targeted road safety interventions by providing deeper insights into the most influential factors.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 41 of its 110 references that are in the map. First posted on arXiv 8 May 2025.
Builds on
41 of 110 references.
References · 41
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2019What Does BERT Look At? An Analysis of BERT's Attentioncited by 1,003
- 2019Attention is not Explanationcited by 929
- 2021Revisiting Deep Learning Models for Tabular Datacited by 740
- 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 461
29 more
- 2019Is Attention Interpretable?cited by 389
- 2023GPT-Driver: Learning to Drive with GPTcited by 347
- 2023Explainability for Large Language Models: A Surveycited by 333
- 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generationcited by 191
- 2020Explaining Black Box Predictions and Unveiling Data Artifacts through Influence Functionscited by 144
- 2023Drive as You Speak: Enabling Human-Like Interaction with Large Language Models in Autonomous Vehiclescited by 100
- 2024Spatial-Temporal Large Language Model for Traffic Predictioncited by 83
- 2023LLMLight: Large Language Models as Traffic Signal Control Agentscited by 73
- 2023GeoLLM: Extracting Geospatial Knowledge from Large Language Modelscited by 64
- 2023From Language Modeling to Instruction Following: Understanding the Behavior Shift in LLMs after Instruction Tuningcited by 56
- 2024Usable XAI: 10 Strategies Towards Exploiting Explainability in the LLM Eracited by 46
- 2024ChatSUMO: Large Language Model for Automating Traffic Scenario Generation in Simulation of Urban MObilitycited by 34
- 2023ChatGraph: Interpretable Text Classification by Converting ChatGPT Knowledge to Graphscited by 27
- 2025Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmapcited by 26
- 2023MKRAG: Medical Knowledge Retrieval Augmented Generation for Medical Question Answeringcited by 23
- 2024TPLLM: A Traffic Prediction Framework Based on Pretrained Large Language Modelscited by 23
- 2025Integrating LLMs with ITS: Recent Advances, Potentials, Challenges, and Future Directionscited by 23
- 2025When language and vision meet road safety: leveraging multimodal large language models for video-based traffic accident analysiscited by 21
- 2024Retrieval-enhanced Knowledge Editing in Language Models for Multi-Hop Question Answeringcited by 20
- 2024Traffic Performance GPT (TP-GPT): Real-Time Data Informed Intelligent ChatBot for Transportation Surveillance and Managementcited by 15
- 2024Geolocation Representation from Large Language Models are Generic Enhancers for Spatio-Temporal Learningcited by 15
- 2024Leveraging Large Language Models with Chain-of-Thought and Prompt Engineering for Traffic Crash Severity Analysis and Inferencecited by 14
- 2024Large Language Models (LLMs) as Traffic Control Systems at Urban Intersections: A New Paradigmcited by 12
- 2025Enhancing Cognition and Explainability of Multimodal Foundation Models with Self-Synthesized Datacited by 12
- 2024Learning Traffic Crashes as Language: Datasets, Benchmarks, and What-if Causal Analysescited by 10
- 2025SearchRAG: Can Search Engines Be Helpful for LLM-based Medical Question Answering?cited by 9
- 2025Exploring the Potential of Large Language Models in Public Transportation: San Antonio Case Studycited by 5
- 2024Beyond Words: Evaluating Large Language Models in Transportation Planningcited by 3
- 2024Feature Group Tabular Transformer: A Novel Approach to Traffic Crash Modeling and Causality Analysiscited by 3
Built on by
Citing papers per year: 2025: 3; 2026: 3.
6 papers.
- 2026Calibrated Decisions at Scale: Converting Police Crash Narratives into Probabilistic Crash Variables with a System One Model (Jev)cited by 14
- 2025STER-VLM: Spatio-Temporal With Enhanced Reference Vision-Language Modelscited by 9
- 2025How to Auto-optimize Prompts for Domain Tasks? Adaptive Prompting and Reasoning through Evolutionary Domain Knowledge Adaptationcited by 4
- 2025EvolveSignal: A Large Language Model Powered Coding Agent for Discovering Traffic Signal Control Strategiescited by 1
- 2026Automating Crash Diagram Generation Using Vision-Language Models: A Case Study on Multi-Lane Roundaboutscited by 0
- 2026Responsibility Distribution Estimation in Ego-View Accident Videos with Multimodal Large Language Modelscited by 0
- 2026Calibrated Decisions at Scale: Converting Police Crash Narratives into Probabilistic Crash Variables with a System One Model (Jev)21 Sep 2026
- 2026Responsibility Distribution Estimation in Ego-View Accident Videos with Multimodal Large Language Models3 Jul 2026
- 2026Automating Crash Diagram Generation Using Vision-Language Models: A Case Study on Multi-Lane Roundabouts9 Mar 2026
- 2025How to Auto-optimize Prompts for Domain Tasks? Adaptive Prompting and Reasoning through Evolutionary Domain Knowledge Adaptation24 Oct 2025
- 2025EvolveSignal: A Large Language Model Powered Coding Agent for Discovering Traffic Signal Control Strategies3 Sep 2025
- 2025STER-VLM: Spatio-Temporal With Enhanced Reference Vision-Language Models19 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2025Domain-Adapted Pre-trained Language Models for Implicit Information Extraction in Crash Narratives
- 2025From Narratives to Probabilistic Reasoning: Predicting and Interpreting Drivers' Hazardous Actions in Crashes Using Large Language Model
- 2025Improving Crash Data Quality with Large Language Models: Evidence from Secondary Crash Narratives in Kentucky
- 2026Crash Narrative-Guided Countermeasure Recommendation Using Large Language Models: A Retrieval-Augmented Generation Framework for Intersection Safety
- 2025CrashChat: A Multimodal Large Language Model for Multitask Traffic Crash Video Analysis
- 2025From Street Views to Urban Science: Discovering Road Safety Factors with Multimodal Large Language Models
- 2025Large Language Models and Their Applications in Roadway Safety and Mobility Enhancement: A Comprehensive Review
- 2025Large Language Models for Crash Detection in Video: A Survey of Methods, Datasets, and Challenges