FedLLM: A Privacy-Preserving Federated Large Language Model for Explainable Traffic Flow Prediction
Not on the map. Why?
Abstract (arXiv)
Traffic prediction plays a central role in intelligent transportation systems (ITS) by supporting real-time decision-making, congestion management, and long-term planning. However, many existing approaches face practical limitations. Most spatio-temporal models are trained on centralized data, rely on numerical representations, and offer limited explainability. Recent Large Language Model (LLM) methods improve reasoning capabilities but typically assume centralized data availability and do not fully capture the distributed and heterogeneous nature of real-world traffic systems. To address these challenges, this study proposes FedLLM (Federated LLM), a privacy-preserving and distributed framework for explainable multi-horizon short-term traffic flow prediction (15-60 minutes). The framework introduces four key contributions: 1) a Composite Selection Score (CSS) for data-driven freeway selection that captures structural diversity across traffic regions 2) a domain-adapted LLM fine-tuned on structured traffic prompts encoding spatial, temporal, and statistical context 3) FedLLM framework, that enables collaborative training across heterogeneous clients while exchanging only lightweight LoRA adapter parameters, 4) a structured prompt representation that supports contextual reasoning and cross-region generalization. The FedLLM design allows each client to learn from local traffic patterns while contributing to a shared global model through efficient parameter exchange, reducing communication overhead and keeping data private. This setup supports learning under non-IID traffic distributions. Experimental results show that FedLLM achieves improved predictive performance over centralized baselines, while producing structured and explainable outputs. These findings highlight the potential of combining FL with domain-adapted LLMs for scalable, privacy-aware, and explainable traffic prediction.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 49 references that are in the map. First posted on arXiv 17 Apr 2026.
Builds on
18 of 49 references.
References · 18
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2019Advances and Open Problems in Federated Learningcited by 3,021
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
- 2020Adaptive Federated Optimizationcited by 1,036
- 2019Towards Federated Learning at Scale: System Designcited by 826
- 2023Large Language Modelscited by 774
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
- 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 525
- 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 491
6 more
- 2020Flower: A Friendly Federated Learning Research Frameworkcited by 449
- 2021Federated Learning on Non-IID Data: A Surveycited by 345
- 2024TPLLM: A Traffic Prediction Framework Based on Pretrained Large Language Modelscited by 23
- 2024TrafficGPT: Breaking the Token Barrier for Efficient Long Traffic Analysis and Generationcited by 15
- 2017A Neural Network Architecture Combining Gated Recurrent Unit (GRU) and Support Vector Machine (SVM) for Intrusion Detection in Network Traffic Datacited by 8
- 2022CC-FedAvg: Computationally Customized Federated Averagingcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026MoE Enhanced Federated Learning for Spatiotemporal Prediction
- 2024STLLM-DF: A Spatial-Temporal Large Language Model with Diffusion for Enhanced Multi-Mode Traffic System Forecasting
- 2025Large Language Models and Their Applications in Roadway Safety and Mobility Enhancement: A Comprehensive Review
- 2023LLMLight: Large Language Models as Traffic Signal Control Agents
- 2024Large Language Models (LLMs) as Traffic Control Systems at Urban Intersections: A New Paradigm
- 2025CoLLMLight: Cooperative Large Language Model Agents for Network-Wide Traffic Signal Control
- 2024TR2MTL: LLM based framework for Metric Temporal Logic Formalization of Traffic Rules
- 2024Large Language Models Powered Context-aware Motion Prediction in Autonomous Driving