mlsanityData to 14 Oct 2026

CrashSage: A Large Language Model-Centered Framework for Contextual and Interpretable Traffic Crash Analysis

arXiv 2505.07853 ↗First posted 8 May 2025cs.CL cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

Road crashes claim over 1.3 million lives annually worldwide and incur global economic losses exceeding 1.8 trillion. Such profound societal and financial impacts underscore the urgent need for road safety research that uncovers crash mechanisms and delivers actionable insights. Conventional statistical models and tree ensemble approaches typically rely on structured crash data, overlooking contextual nuances and struggling to capture complex relationships and underlying semantics. Moreover, these approaches tend to incur significant information loss, particularly in narrative elements related to multi-vehicle interactions, crash progression, and rare event characteristics. This study presents CrashSage, a novel Large Language Model (LLM)-centered framework designed to advance crash analysis and modeling through four key innovations. First, we introduce a tabular-to-text transformation strategy paired with relational data integration schema, enabling the conversion of raw, heterogeneous crash data into enriched, structured textual narratives that retain essential structural and relational context. Second, we apply context-aware data augmentation using a base LLM model to improve narrative coherence while preserving factual integrity. Third, we fine-tune the LLaMA3-8B model for crash severity inference, demonstrating superior performance over baseline approaches, including zero-shot, zero-shot with chain-of-thought prompting, and few-shot learning, with multiple models (GPT-4o, GPT-4o-mini, LLaMA3-70B). Finally, we employ a gradient-based explainability technique to elucidate model decisions at both the individual crash level and across broader risk factor dimensions. This interpretability mechanism enhances transparency and enables targeted road safety interventions by providing deeper insights into the most influential factors.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 41 of its 110 references that are in the map. First posted on arXiv 8 May 2025.

Builds on

41 of 110 references.

References · 41

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  6. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  7. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  8. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  9. 2019What Does BERT Look At? An Analysis of BERT's Attentioncited by 1,003
  10. 2019Attention is not Explanationcited by 929
  11. 2021Revisiting Deep Learning Models for Tabular Datacited by 740
  12. 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 461
29 more
  1. 2019Is Attention Interpretable?cited by 389
  2. 2023GPT-Driver: Learning to Drive with GPTcited by 347
  3. 2023Explainability for Large Language Models: A Surveycited by 333
  4. 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generationcited by 191
  5. 2020Explaining Black Box Predictions and Unveiling Data Artifacts through Influence Functionscited by 144
  6. 2023Drive as You Speak: Enabling Human-Like Interaction with Large Language Models in Autonomous Vehiclescited by 100
  7. 2024Spatial-Temporal Large Language Model for Traffic Predictioncited by 83
  8. 2023LLMLight: Large Language Models as Traffic Signal Control Agentscited by 73
  9. 2023GeoLLM: Extracting Geospatial Knowledge from Large Language Modelscited by 64
  10. 2023From Language Modeling to Instruction Following: Understanding the Behavior Shift in LLMs after Instruction Tuningcited by 56
  11. 2024Usable XAI: 10 Strategies Towards Exploiting Explainability in the LLM Eracited by 46
  12. 2024ChatSUMO: Large Language Model for Automating Traffic Scenario Generation in Simulation of Urban MObilitycited by 34
  13. 2023ChatGraph: Interpretable Text Classification by Converting ChatGPT Knowledge to Graphscited by 27
  14. 2025Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmapcited by 26
  15. 2023MKRAG: Medical Knowledge Retrieval Augmented Generation for Medical Question Answeringcited by 23
  16. 2024TPLLM: A Traffic Prediction Framework Based on Pretrained Large Language Modelscited by 23
  17. 2025Integrating LLMs with ITS: Recent Advances, Potentials, Challenges, and Future Directionscited by 23
  18. 2025When language and vision meet road safety: leveraging multimodal large language models for video-based traffic accident analysiscited by 21
  19. 2024Retrieval-enhanced Knowledge Editing in Language Models for Multi-Hop Question Answeringcited by 20
  20. 2024Traffic Performance GPT (TP-GPT): Real-Time Data Informed Intelligent ChatBot for Transportation Surveillance and Managementcited by 15
  21. 2024Geolocation Representation from Large Language Models are Generic Enhancers for Spatio-Temporal Learningcited by 15
  22. 2024Leveraging Large Language Models with Chain-of-Thought and Prompt Engineering for Traffic Crash Severity Analysis and Inferencecited by 14
  23. 2024Large Language Models (LLMs) as Traffic Control Systems at Urban Intersections: A New Paradigmcited by 12
  24. 2025Enhancing Cognition and Explainability of Multimodal Foundation Models with Self-Synthesized Datacited by 12
  25. 2024Learning Traffic Crashes as Language: Datasets, Benchmarks, and What-if Causal Analysescited by 10
  26. 2025SearchRAG: Can Search Engines Be Helpful for LLM-based Medical Question Answering?cited by 9
  27. 2025Exploring the Potential of Large Language Models in Public Transportation: San Antonio Case Studycited by 5
  28. 2024Beyond Words: Evaluating Large Language Models in Transportation Planningcited by 3
  29. 2024Feature Group Tabular Transformer: A Novel Approach to Traffic Crash Modeling and Causality Analysiscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 3.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Domain-Adapted Pre-trained Language Models for Implicit Information Extraction in Crash Narratives
  2. 2025From Narratives to Probabilistic Reasoning: Predicting and Interpreting Drivers' Hazardous Actions in Crashes Using Large Language Model
  3. 2025Improving Crash Data Quality with Large Language Models: Evidence from Secondary Crash Narratives in Kentucky
  4. 2026Crash Narrative-Guided Countermeasure Recommendation Using Large Language Models: A Retrieval-Augmented Generation Framework for Intersection Safety
  5. 2025CrashChat: A Multimodal Large Language Model for Multitask Traffic Crash Video Analysis
  6. 2025From Street Views to Urban Science: Discovering Road Safety Factors with Multimodal Large Language Models
  7. 2025Large Language Models and Their Applications in Roadway Safety and Mobility Enhancement: A Comprehensive Review
  8. 2025Large Language Models for Crash Detection in Video: A Survey of Methods, Datasets, and Challenges