mlsanityData to 7 Oct 2026

LLM4Delay: Flight Delay Prediction via Cross-Modality Adaptation of Large Language Models and Aircraft Trajectory Representation

arXiv 2510.23636 ↗First posted 24 Oct 2025cs.LG cs.AI cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Flight delay prediction has become a key focus in air traffic management (ATM), as delays reflect inefficiencies in the system. This paper proposes LLM4Delay, a large language model (LLM)-based framework for predicting flight delays from the perspective of air traffic controllers monitoring aircraft after they enter the terminal maneuvering area (TMA). LLM4Delay is designed to integrate textual aeronautical information, including flight data, weather reports, and aerodrome notices, together with multiple trajectories that model airspace conditions, forming a comprehensive delay-relevant context. By jointly leveraging comprehensive textual and trajectory contexts via instance-level projection, an effective cross-modality adaptation strategy that maps multiple instance-level trajectory representations into the language modality, the framework improves delay prediction accuracy. LLM4Delay demonstrates superior performance compared to existing ATM frameworks and prior time-series-to-language adaptation methods. This highlights the complementary roles of textual and trajectory data while leveraging knowledge from both the pretrained trajectory encoder and the pretrained LLM. The proposed framework enables continuous updates to predictions as new information becomes available, indicating potential operational relevance.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 35 of its 90 references that are in the map. First posted on arXiv 24 Oct 2025.

Builds on

35 of 90 references.

References · 35

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2024The Llama 3 Herd of Modelscited by 14,192
  7. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  8. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  9. 2025Qwen3 Technical Reportcited by 8,195
  10. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  11. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  12. 2023Qwen Technical Reportcited by 3,273
23 more
  1. 2015Fast R-CNNcited by 2,930
  2. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
  3. 2024Qwen2 Technical Reportcited by 2,076
  4. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  5. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
  6. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
  7. 2024Mixtral of Expertscited by 1,785
  8. 2023Pythia: A Suite for Analyzing Large Language Models Across Training and Scalingcited by 1,734
  9. 2025Gemma 3 Technical Reportcited by 1,686
  10. 2024Gemma: Open Models Based on Gemini Research and Technologycited by 889
  11. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
  12. 2023Textbooks Are All You Needcited by 561
  13. 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 491
  14. 2021TS2Vec: Towards Universal Representation of Time Seriescited by 463
  15. 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 342
  16. 2019Unsupervised Scalable Representation Learning for Multivariate Time Seriescited by 267
  17. 2021Unsupervised Representation Learning for Time Series with Temporal Neighborhood Codingcited by 223
  18. 2023LLM4TS: Aligning Pre-Trained LLMs as Data-Efficient Time-Series Forecasterscited by 127
  19. 2024AutoTimes: Autoregressive Time Series Forecasters via Large Language Modelscited by 63
  20. 2023From Language Modeling to Instruction Following: Understanding the Behavior Shift in LLMs after Instruction Tuningcited by 56
  21. 2023Time Series Contrastive Learning with Information-Aware Augmentationscited by 52
  22. 2019Flight Delay Prediction using Airport Situational Awareness Mapcited by 5
  23. 2024Aircraft Trajectory Segmentation-based Contrastive Coding: A Framework for Self-supervised Trajectory Representationcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.