LLM4Delay: Flight Delay Prediction via Cross-Modality Adaptation of Large Language Models and Aircraft Trajectory Representation
Not on the map. Why?
Abstract (arXiv)
Flight delay prediction has become a key focus in air traffic management (ATM), as delays reflect inefficiencies in the system. This paper proposes LLM4Delay, a large language model (LLM)-based framework for predicting flight delays from the perspective of air traffic controllers monitoring aircraft after they enter the terminal maneuvering area (TMA). LLM4Delay is designed to integrate textual aeronautical information, including flight data, weather reports, and aerodrome notices, together with multiple trajectories that model airspace conditions, forming a comprehensive delay-relevant context. By jointly leveraging comprehensive textual and trajectory contexts via instance-level projection, an effective cross-modality adaptation strategy that maps multiple instance-level trajectory representations into the language modality, the framework improves delay prediction accuracy. LLM4Delay demonstrates superior performance compared to existing ATM frameworks and prior time-series-to-language adaptation methods. This highlights the complementary roles of textual and trajectory data while leveraging knowledge from both the pretrained trajectory encoder and the pretrained LLM. The proposed framework enables continuous updates to predictions as new information becomes available, indicating potential operational relevance.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 35 of its 90 references that are in the map. First posted on arXiv 24 Oct 2025.
Builds on
35 of 90 references.
References · 35
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2025Qwen3 Technical Reportcited by 8,195
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2023Qwen Technical Reportcited by 3,273
23 more
- 2015Fast R-CNNcited by 2,930
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
- 2024Qwen2 Technical Reportcited by 2,076
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
- 2024Mixtral of Expertscited by 1,785
- 2023Pythia: A Suite for Analyzing Large Language Models Across Training and Scalingcited by 1,734
- 2025Gemma 3 Technical Reportcited by 1,686
- 2024Gemma: Open Models Based on Gemini Research and Technologycited by 889
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
- 2023Textbooks Are All You Needcited by 561
- 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 491
- 2021TS2Vec: Towards Universal Representation of Time Seriescited by 463
- 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 342
- 2019Unsupervised Scalable Representation Learning for Multivariate Time Seriescited by 267
- 2021Unsupervised Representation Learning for Time Series with Temporal Neighborhood Codingcited by 223
- 2023LLM4TS: Aligning Pre-Trained LLMs as Data-Efficient Time-Series Forecasterscited by 127
- 2024AutoTimes: Autoregressive Time Series Forecasters via Large Language Modelscited by 63
- 2023From Language Modeling to Instruction Following: Understanding the Behavior Shift in LLMs after Instruction Tuningcited by 56
- 2023Time Series Contrastive Learning with Information-Aware Augmentationscited by 52
- 2019Flight Delay Prediction using Airport Situational Awareness Mapcited by 5
- 2024Aircraft Trajectory Segmentation-based Contrastive Coding: A Framework for Self-supervised Trajectory Representationcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.