mlsanityData to 14 Oct 2026

Large Language Models in Transportation Systems Management and Operations: From Text Reasoning to Multi-modal Decision Support

arXiv 2606.00991 ↗First posted 31 May 2026cs.AIcited by 0

On the map: LLM reasoning → Chain-of-thought reasoning for driving

Abstract (arXiv)

Transportation systems management and operations (TSMO) increasingly depends on timely interpretation of heterogeneous data, from various sensor streams, incident reports, traveler feedback, and visual observations. Large language models (LLMs), including emerging multi-modal large language models (MM-LLMs), provide a new mechanism for integrating these structured and unstructured inputs into operator-facing decision support. This survey paper reviews LLM- and MM-LLM-based applications in TSMO across three domains: transportation operations & services (supply), mobility & fleet services (demand), and data, modeling & decision support. Using a PRISMA-guided screening process, we synthesize current studies while distinguishing operationally oriented applications from prototype and emerging concepts. We further identify recurring challenges in data heterogeneity, real-time inference, explainability, multi-modal fusion, and governance. Finally, we outline existing gaps and future directions in localized adaptation, edge deployment, benchmarking, and cross-agency collaboration. Overall, LLM-based systems appear most promising as a decision-support layer, with MM-LLMs offering particular value when heterogeneous text, visual, and sensor inputs must be integrated.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Chain-of-thought reasoning for driving, one of 17 directions in LLM reasoning. Builds on 65 of its 111 references that are in the map. First posted on arXiv 31 May 2026.

Builds on

65 of 111 references.

Closest ancestors · 4

Same direction, newest first

  1. 2024Driving with Regulation: Trustworthy and Interpretable Decision-Making for Autonomous Driving with Retrieval-Augmented Reasoning7 Oct
  2. 2024Controllable Traffic Simulation through LLM-Guided Hierarchical Reasoning and Refinement23 Sep
  3. 2024Benchmarking the Capabilities of Large Language Models in Transportation System Engineering: Accuracy, Consistency, and Reasoning Behaviors15 Aug
  4. 2024Leveraging Large Language Models with Chain-of-Thought and Prompt Engineering for Traffic Crash Severity Analysis and Inference4 Aug

Other references · 61

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  6. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  7. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  8. 2023A Survey of Large Language Modelscited by 2,576
  9. 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
  10. 2023A Survey on Multimodal Large Language Modelscited by 909
  11. 2025Why Do Multi-Agent LLM Systems Fail?cited by 604
  12. 2023A Survey on Multimodal Large Language Models for Autonomous Drivingcited by 290
38 more
  1. 2023LLM4Drive: A Survey of Large Language Models for Autonomous Drivingcited by 136
  2. 2024ORLM: A Customizable Framework in Training Large Models for Automated Optimization Modelingcited by 124
  3. 2023Language-Guided Traffic Simulation via Scene-Level Diffusioncited by 111
  4. 2024Large Language Models as Urban Residents: An LLM Agent Framework for Personal Mobility Generationcited by 100
  5. 2024Editable Scene Simulation for Autonomous Driving via Collaborative LLM-Agentscited by 91
  6. 2024Spatial-Temporal Large Language Model for Traffic Predictioncited by 83
  7. 2023LLMLight: Large Language Models as Traffic Signal Control Agentscited by 73
  8. 2022LAVIS: A Library for Language-Vision Intelligencecited by 55
  9. 2024Driving Everywhere with Large Language Model Policy Adaptationcited by 53
  10. 2024V2X-VLM: End-to-End V2X Cooperative Autonomous Driving Through Large Vision-Language Modelscited by 47
  11. 2024Visual Mamba: A Survey and New Outlookscited by 41
  12. 2024LLM-PBE: Assessing Data Privacy in Large Language Modelscited by 41
  13. 2023Prompt to Transfer: Sim-to-Real Transfer for Traffic Signal Control with Prompt Learningcited by 36
  14. 2023WEDGE: A multi-weather autonomous driving dataset built from generative vision-language modelscited by 28
  15. 2023TrafficSafetyGPT: Tuning a Pre-trained Large Language Model to a Domain-Specific Expert in Transportation Safetycited by 27
  16. 2024CrisisSense-LLM: Instruction Fine-Tuned Large Language Model for Multi-label Social Media Text Classification in Disaster Informaticscited by 25
  17. 2024iLLM-TSC: Integration reinforcement learning and large language model for traffic signal control policy improvementcited by 23
  18. 2025Integrating LLMs with ITS: Recent Advances, Potentials, Challenges, and Future Directionscited by 23
  19. 2025A Survey on Agentic Multimodal Large Language Modelscited by 23
  20. 2023Can ChatGPT Enable ITS? The Case of Mixed Traffic Control via Reinforcement Learningcited by 20
  21. 2024Towards Explainable Traffic Flow Prediction with Large Language Modelscited by 20
  22. 2023AccidentGPT: Accident Analysis and Prevention from V2X Environmental Perception with Multi-modal Large Modelcited by 17
  23. 2024Traffic Performance GPT (TP-GPT): Real-Time Data Informed Intelligent ChatBot for Transportation Surveillance and Managementcited by 15
  24. 2024TransGPT: Multi-modal Generative Pre-trained Transformer for Transportationcited by 13
  25. 2025ARS: Automatic Routing Solver with Large Language Modelscited by 13
  26. 2024GenAI-powered Multi-Agent Paradigm for Smart Urban Mobility: Opportunities and Challenges for Integrating Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) with Intelligent Transportation Systemscited by 9
  27. 2024TransportationGames: Benchmarking Transportation Knowledge of (Multimodal) Large Language Modelscited by 8
  28. 2025Federated Fine-Tuning of LLMs: Framework Comparison and Research Directionscited by 8
  29. 2026MobilityBench: A Benchmark for Evaluating Route-Planning Agents in Real-World Mobility Scenarioscited by 8
  30. 2024Enhancing Traffic Incident Management with Large Language Models: A Hybrid Machine Learning Approach for Severity Classificationcited by 7
  31. 2025Generative AI for Autonomous Driving: Frontiers and Opportunitiescited by 7
  32. 2025How Well Do LLMs Predict Prerequisite Skills? Zero-Shot Comparison to Expert-Defined Conceptscited by 7
  33. 2024Leveraging Large Language Models (LLMs) for Traffic Management at Urban Intersections: The Case of Mixed Traffic Scenarioscited by 6
  34. 2024DelayPTC-LLM: Metro Passenger Travel Choice Prediction under Train Delays with Large Language Modelscited by 6
  35. 2024Multimodal LLM for Intelligent Transportation Systemscited by 6
  36. 2025Large Language Models for Traffic and Transportation Research: Methodologies, State of the Art, and Future Opportunitiescited by 6
  37. 2024TraveLLM: Could you plan my new public transit route in face of a network disruption?cited by 5
  38. 2024TransitGPT: A Generative AI-based framework for interacting with GTFS data using Large Language Modelscited by 5

50 most cited of 61 All 61 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025LLM-ABM for Transportation: Assessing the Potential of LLM Agents in System Analysis
  2. 2024Toward LLM-Agent-Based Modeling of Transportation Systems: A Conceptual Framework
  3. 2025Large Language Models and Their Applications in Roadway Safety and Mobility Enhancement: A Comprehensive Review
  4. 2025Using LLMs for Analyzing AIS Data
  5. 2024Multimodal Road Network Generation Based on Large Language Model ↗
  6. 2023Evaluation of Large Language Models for Decision Making in Autonomous Driving
  7. 2026TRIP-Evaluate: An Open Multimodal Benchmark for Evaluating Large Models in Transportation
  8. 2026Large Language Model Assisted Transportation Planning through a Differentiable User Equilibrium Layer