mlsanityData to 14 Oct 2026

Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmap

arXiv 2503.21411 ↗First posted 27 Mar 2025cs.AIcited by 26

Not on the map. Why?

Abstract (arXiv)

Modern transportation systems face pressing challenges due to increasing demand, dynamic environments, and heterogeneous information integration. The rapid evolution of Large Language Models (LLMs) offers transformative potential to address these challenges. Extensive knowledge and high-level capabilities derived from pretraining evolve the default role of LLMs as text generators to become versatile, knowledge-driven task solvers for intelligent transportation systems. This survey first presents LLM4TR, a novel conceptual framework that systematically categorizes the roles of LLMs in transportation into four synergetic dimensions: information processors, knowledge encoders, component generators, and decision facilitators. Through a unified taxonomy, we systematically elucidate how LLMs bridge fragmented data pipelines, enhance predictive analytics, simulate human-like reasoning, and enable closed-loop interactions across sensing, learning, modeling, and managing tasks in transportation systems. For each role, our review spans diverse applications, from traffic prediction and autonomous driving to safety analytics and urban mobility optimization, highlighting how emergent capabilities of LLMs such as in-context learning and step-by-step reasoning can enhance the operation and management of transportation systems. We further curate practical guidance, including available resources and computational guidelines, to support real-world deployment. By identifying challenges in existing LLM-based solutions, this survey charts a roadmap for advancing LLM-driven transportation research, positioning LLMs as central actors in the next generation of cyber-physical-social mobility ecosystems. Online resources can be found in the project page: https://github.com/tongnie/awesome-llm4tr.

Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Builds on 229 of its 343 references that are in the map. First posted on arXiv 27 Mar 2025.

Builds on

229 of 343 references.

References · 229

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2020Language Models are Few-Shot Learnerscited by 32,419
  5. 2022Training language models to follow instructions with human feedbackcited by 15,971
  6. 2017Proximal Policy Optimization Algorithmscited by 15,215
  7. 2024The Llama 3 Herd of Modelscited by 14,715
  8. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  9. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  10. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  11. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  12. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
38 more
  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  4. 2020Scaling Laws for Neural Language Modelscited by 6,586
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  6. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  7. 2016Layer Normalizationcited by 5,669
  8. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  9. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  10. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  11. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  12. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  13. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  14. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  15. 2017Deep reinforcement learning from human preferencescited by 3,912
  16. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  17. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  18. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  19. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  20. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  21. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
  22. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  23. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  24. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  25. 2023A Survey of Large Language Modelscited by 2,576
  26. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  27. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  28. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  29. 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
  30. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  31. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  32. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,868
  33. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  34. 2019Generating Long Sequences with Sparse Transformerscited by 1,546
  35. 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,546
  36. 2019Root Mean Square Layer Normalizationcited by 1,480
  37. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
  38. 2023AWQ: Activation-aware Weight Quantization for LLM Compression and Accelerationcited by 1,298

50 most cited of 229 All 229 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 17; 2026: 9.

26 papers.

Sort:

By area:

  1. 2025Large Language Models and Their Applications in Roadway Safety and Mobility Enhancement: A Comprehensive Reviewcited by 8
  2. 2025Seeking to Collide: Online Safety-Critical Scenario Generation for Autonomous Driving with Retrieval Augmented Large Language Modelscited by 7
  3. 2025CoReVLA: A Dual-Stage End-to-End Autonomous Driving Framework for Long-Tail Scenarios via Collect-and-Refinecited by 7
  4. 2025CrashSage: A Large Language Model-Centered Framework for Contextual and Interpretable Traffic Crash Analysiscited by 6
  5. 2025Domain Specific Benchmarks for Evaluating Multimodal Large Language Modelscited by 3
  6. 2025Generative AI for Testing of Autonomous Driving Systems: A Surveycited by 3
  7. 2025Aligning LLM agents with human learning and adjustment behavior: a dual agent approachcited by 3
  8. 2025Image Segmentation with Large Language Models: A Survey with Perspectives for Intelligent Transportation Systemscited by 2
  9. 2025Towards Locally Deployable Fine-Tuned Causal Large Language Models for Mode Choice Behaviourcited by 1
  10. 2025Getting out of the Big-Muddy: Escalation of Commitment in LLMscited by 1
  11. 2025Benchmarking Retrieval-Augmented Generation Strategies for Large Language Model-Based Travel Mode Choice Predictioncited by 1
  12. 2025EvolveSignal: A Large Language Model Powered Coding Agent for Discovering Traffic Signal Control Strategiescited by 1
14 more
  1. 2025Bounded PCTL Model Checking of Large Language Model Outputscited by 1
  2. 2025Jailbreaking Large Vision Language Models in Intelligent Transportation Systemscited by 1
  3. 2026Virtual Traffic Police: Large Language Model-Augmented Traffic Signal Control for Unforeseen Incidentscited by 1
  4. 2025From Street Views to Urban Science: Discovering Road Safety Factors with Multimodal Large Language Modelscited by 0
  5. 2025GraphTrafficGPT: Enhancing Traffic Management Through Graph-Based AI Agent Coordinationcited by 0
  6. 2025Advanced Assistance for Traffic Crash Analysis: An AI-Driven Multi-Agent Approach to Pre-Crash Reconstructioncited by 0
  7. 2026Broadening Access to Transportation Safety Data with Generative AI: A Schema-Grounded Framework for Spatial Natural Language Queriescited by 0
  8. 2026ChatPlanner: A Large Language Model Framework for Personalized Public Transit Routingcited by 0
  9. 2026Autonomous discovery of traffic laws with AI traffic scientistscited by 0
  10. 2026Artificial Intelligence for Understanding and Managing Transportation Behavior in Sustainable Smart Citiescited by 0
  11. 2026Large Multimodal Agents for Intelligent Transportation Systems: Architectures, Evidence, and Deployment Challengescited by 0
  12. 2026Industrial Kinematic Trajectory Model (IKTM): Coordinate-Free Autoregressive Generatorcited by 0
  13. 2026On the security and privacy of LLMs in Mobilitycited by 0
  14. 2026VLALight: Lightweight Vision-Language-Action Models for Emergency-Aware Traffic Signal Controlcited by 0