Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmap
Not on the map. Why?
Abstract (arXiv)
Modern transportation systems face pressing challenges due to increasing demand, dynamic environments, and heterogeneous information integration. The rapid evolution of Large Language Models (LLMs) offers transformative potential to address these challenges. Extensive knowledge and high-level capabilities derived from pretraining evolve the default role of LLMs as text generators to become versatile, knowledge-driven task solvers for intelligent transportation systems. This survey first presents LLM4TR, a novel conceptual framework that systematically categorizes the roles of LLMs in transportation into four synergetic dimensions: information processors, knowledge encoders, component generators, and decision facilitators. Through a unified taxonomy, we systematically elucidate how LLMs bridge fragmented data pipelines, enhance predictive analytics, simulate human-like reasoning, and enable closed-loop interactions across sensing, learning, modeling, and managing tasks in transportation systems. For each role, our review spans diverse applications, from traffic prediction and autonomous driving to safety analytics and urban mobility optimization, highlighting how emergent capabilities of LLMs such as in-context learning and step-by-step reasoning can enhance the operation and management of transportation systems. We further curate practical guidance, including available resources and computational guidelines, to support real-world deployment. By identifying challenges in existing LLM-based solutions, this survey charts a roadmap for advancing LLM-driven transportation research, positioning LLMs as central actors in the next generation of cyber-physical-social mobility ecosystems. Online resources can be found in the project page: https://github.com/tongnie/awesome-llm4tr.
Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Builds on 229 of its 343 references that are in the map. First posted on arXiv 27 Mar 2025.
Builds on
229 of 343 references.
References · 229
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
38 more
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2016Layer Normalizationcited by 5,669
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2023A Survey of Large Language Modelscited by 2,576
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
- 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,868
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
- 2019Generating Long Sequences with Sparse Transformerscited by 1,546
- 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,546
- 2019Root Mean Square Layer Normalizationcited by 1,480
- 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
- 2023AWQ: Activation-aware Weight Quantization for LLM Compression and Accelerationcited by 1,298
50 most cited of 229 All 229 (JSON)
Built on by
Citing papers per year: 2025: 17; 2026: 9.
26 papers.
Sort:
By area:
- 2025Large Language Models and Their Applications in Roadway Safety and Mobility Enhancement: A Comprehensive Reviewcited by 8
- 2025Seeking to Collide: Online Safety-Critical Scenario Generation for Autonomous Driving with Retrieval Augmented Large Language Modelscited by 7
- 2025CoReVLA: A Dual-Stage End-to-End Autonomous Driving Framework for Long-Tail Scenarios via Collect-and-Refinecited by 7
- 2025CrashSage: A Large Language Model-Centered Framework for Contextual and Interpretable Traffic Crash Analysiscited by 6
- 2025Domain Specific Benchmarks for Evaluating Multimodal Large Language Modelscited by 3
- 2025Generative AI for Testing of Autonomous Driving Systems: A Surveycited by 3
- 2025Aligning LLM agents with human learning and adjustment behavior: a dual agent approachcited by 3
- 2025Image Segmentation with Large Language Models: A Survey with Perspectives for Intelligent Transportation Systemscited by 2
- 2025Towards Locally Deployable Fine-Tuned Causal Large Language Models for Mode Choice Behaviourcited by 1
- 2025Getting out of the Big-Muddy: Escalation of Commitment in LLMscited by 1
- 2025Benchmarking Retrieval-Augmented Generation Strategies for Large Language Model-Based Travel Mode Choice Predictioncited by 1
- 2025EvolveSignal: A Large Language Model Powered Coding Agent for Discovering Traffic Signal Control Strategiescited by 1
14 more
- 2025Bounded PCTL Model Checking of Large Language Model Outputscited by 1
- 2025Jailbreaking Large Vision Language Models in Intelligent Transportation Systemscited by 1
- 2026Virtual Traffic Police: Large Language Model-Augmented Traffic Signal Control for Unforeseen Incidentscited by 1
- 2025From Street Views to Urban Science: Discovering Road Safety Factors with Multimodal Large Language Modelscited by 0
- 2025GraphTrafficGPT: Enhancing Traffic Management Through Graph-Based AI Agent Coordinationcited by 0
- 2025Advanced Assistance for Traffic Crash Analysis: An AI-Driven Multi-Agent Approach to Pre-Crash Reconstructioncited by 0
- 2026Broadening Access to Transportation Safety Data with Generative AI: A Schema-Grounded Framework for Spatial Natural Language Queriescited by 0
- 2026ChatPlanner: A Large Language Model Framework for Personalized Public Transit Routingcited by 0
- 2026Autonomous discovery of traffic laws with AI traffic scientistscited by 0
- 2026Artificial Intelligence for Understanding and Managing Transportation Behavior in Sustainable Smart Citiescited by 0
- 2026Large Multimodal Agents for Intelligent Transportation Systems: Architectures, Evidence, and Deployment Challengescited by 0
- 2026Industrial Kinematic Trajectory Model (IKTM): Coordinate-Free Autoregressive Generatorcited by 0
- 2026On the security and privacy of LLMs in Mobilitycited by 0
- 2026VLALight: Lightweight Vision-Language-Action Models for Emergency-Aware Traffic Signal Controlcited by 0
- 2026VLALight: Lightweight Vision-Language-Action Models for Emergency-Aware Traffic Signal Control25 Sep 2026
- 2026On the security and privacy of LLMs in Mobility22 Sep 2026
- 2026Industrial Kinematic Trajectory Model (IKTM): Coordinate-Free Autoregressive Generator27 Aug 2026
- 2026Large Multimodal Agents for Intelligent Transportation Systems: Architectures, Evidence, and Deployment Challenges8 Aug 2026
- 2026Artificial Intelligence for Understanding and Managing Transportation Behavior in Sustainable Smart Cities20 Jul 2026
- 2026Autonomous discovery of traffic laws with AI traffic scientists2 Jul 2026
- 2026ChatPlanner: A Large Language Model Framework for Personalized Public Transit Routing13 Jun 2026
- 2026Broadening Access to Transportation Safety Data with Generative AI: A Schema-Grounded Framework for Spatial Natural Language Queries20 May 2026
- 2026Virtual Traffic Police: Large Language Model-Augmented Traffic Signal Control for Unforeseen Incidents22 Jan 2026
- 2025Jailbreaking Large Vision Language Models in Intelligent Transportation Systems17 Nov 2025
- 2025Advanced Assistance for Traffic Crash Analysis: An AI-Driven Multi-Agent Approach to Pre-Crash Reconstruction13 Nov 2025
- 2025Aligning LLM agents with human learning and adjustment behavior: a dual agent approach2 Nov 2025
14 more
- 2025Bounded PCTL Model Checking of Large Language Model Outputs23 Sep 2025
- 2025CoReVLA: A Dual-Stage End-to-End Autonomous Driving Framework for Long-Tail Scenarios via Collect-and-Refine19 Sep 2025
- 2025EvolveSignal: A Large Language Model Powered Coding Agent for Discovering Traffic Signal Control Strategies3 Sep 2025
- 2025Generative AI for Testing of Autonomous Driving Systems: A Survey27 Aug 2025
- 2025Benchmarking Retrieval-Augmented Generation Strategies for Large Language Model-Based Travel Mode Choice Prediction24 Aug 2025
- 2025Getting out of the Big-Muddy: Escalation of Commitment in LLMs3 Aug 2025
- 2025Towards Locally Deployable Fine-Tuned Causal Large Language Models for Mode Choice Behaviour29 Jul 2025
- 2025GraphTrafficGPT: Enhancing Traffic Management Through Graph-Based AI Agent Coordination17 Jul 2025
- 2025Image Segmentation with Large Language Models: A Survey with Perspectives for Intelligent Transportation Systems17 Jun 2025
- 2025Domain Specific Benchmarks for Evaluating Multimodal Large Language Models15 Jun 2025
- 2025From Street Views to Urban Science: Discovering Road Safety Factors with Multimodal Large Language Models2 Jun 2025
- 2025Large Language Models and Their Applications in Roadway Safety and Mobility Enhancement: A Comprehensive Review19 May 2025
- 2025CrashSage: A Large Language Model-Centered Framework for Contextual and Interpretable Traffic Crash Analysis8 May 2025
- 2025Seeking to Collide: Online Safety-Critical Scenario Generation for Autonomous Driving with Retrieval Augmented Large Language Models2 May 2025
- 2025Aligning LLM agents with human learning and adjustment behavior: a dual agent approachcited by 3
- 2025EvolveSignal: A Large Language Model Powered Coding Agent for Discovering Traffic Signal Control Strategiescited by 1
- 2025GraphTrafficGPT: Enhancing Traffic Management Through Graph-Based AI Agent Coordinationcited by 0
- 2025Aligning LLM agents with human learning and adjustment behavior: a dual agent approach2 Nov 2025
- 2025EvolveSignal: A Large Language Model Powered Coding Agent for Discovering Traffic Signal Control Strategies3 Sep 2025
- 2025GraphTrafficGPT: Enhancing Traffic Management Through Graph-Based AI Agent Coordination17 Jul 2025
- 2025Large Language Models and Their Applications in Roadway Safety and Mobility Enhancement: A Comprehensive Reviewcited by 8
- 2025CrashSage: A Large Language Model-Centered Framework for Contextual and Interpretable Traffic Crash Analysiscited by 6
- 2025Generative AI for Testing of Autonomous Driving Systems: A Surveycited by 3
- 2025Image Segmentation with Large Language Models: A Survey with Perspectives for Intelligent Transportation Systemscited by 2
- 2025Towards Locally Deployable Fine-Tuned Causal Large Language Models for Mode Choice Behaviourcited by 1
- 2025Getting out of the Big-Muddy: Escalation of Commitment in LLMscited by 1
- 2025Bounded PCTL Model Checking of Large Language Model Outputscited by 1
- 2026Virtual Traffic Police: Large Language Model-Augmented Traffic Signal Control for Unforeseen Incidentscited by 1
- 2025Advanced Assistance for Traffic Crash Analysis: An AI-Driven Multi-Agent Approach to Pre-Crash Reconstructioncited by 0
- 2026Broadening Access to Transportation Safety Data with Generative AI: A Schema-Grounded Framework for Spatial Natural Language Queriescited by 0
- 2026ChatPlanner: A Large Language Model Framework for Personalized Public Transit Routingcited by 0
- 2026Autonomous discovery of traffic laws with AI traffic scientistscited by 0
12 most cited of 17 All 17 (JSON)
- 2026VLALight: Lightweight Vision-Language-Action Models for Emergency-Aware Traffic Signal Control25 Sep 2026
- 2026On the security and privacy of LLMs in Mobility22 Sep 2026
- 2026Industrial Kinematic Trajectory Model (IKTM): Coordinate-Free Autoregressive Generator27 Aug 2026
- 2026Large Multimodal Agents for Intelligent Transportation Systems: Architectures, Evidence, and Deployment Challenges8 Aug 2026
- 2026Artificial Intelligence for Understanding and Managing Transportation Behavior in Sustainable Smart Cities20 Jul 2026
- 2026Autonomous discovery of traffic laws with AI traffic scientists2 Jul 2026
- 2026ChatPlanner: A Large Language Model Framework for Personalized Public Transit Routing13 Jun 2026
- 2026Broadening Access to Transportation Safety Data with Generative AI: A Schema-Grounded Framework for Spatial Natural Language Queries20 May 2026
- 2026Virtual Traffic Police: Large Language Model-Augmented Traffic Signal Control for Unforeseen Incidents22 Jan 2026
- 2025Advanced Assistance for Traffic Crash Analysis: An AI-Driven Multi-Agent Approach to Pre-Crash Reconstruction13 Nov 2025
- 2025Bounded PCTL Model Checking of Large Language Model Outputs23 Sep 2025
- 2025Generative AI for Testing of Autonomous Driving Systems: A Survey27 Aug 2025
12 newest of 17 All 17 (JSON)